[==========] Running 5 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 5 tests from TabletCopyClientSessionITest
[ RUN ] TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping
2024-05-02T01:56:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-02T01:56:06Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20240502 01:56:06.336098 28510 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ga2ld/build/asan/bin/kudu
/tmp/dist-test-task7ga2ld/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.215.190:44137
--webserver_interface=127.27.215.190
--webserver_port=0
--builtin_ntp_servers=127.27.215.148:42231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.215.190:44137
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240502 01:56:06.696779 28518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:56:06.697136 28518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:56:06.697238 28518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:56:06.705060 28518 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 01:56:06.705206 28518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:56:06.705255 28518 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 01:56:06.705305 28518 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 01:56:06.717736 28518 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.215.148:42231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.27.215.190:44137
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.215.190:44137
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.215.190
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 02 May 2024 01:43:22 UTC on efd1337a2aa3
build id 83
ASAN enabled
I20240502 01:56:06.719851 28518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:56:06.721904 28518 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:56:06.734421 28526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:06.734059 28524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:06.734086 28523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:56:06.735093 28518 server_base.cc:1034] running on GCE node
I20240502 01:56:06.736001 28518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:56:06.737679 28518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:56:06.738952 28518 hybrid_clock.cc:648] HybridClock initialized: now 1714614966738881 us; error 47 us; skew 500 ppm
I20240502 01:56:06.739349 28518 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:56:06.747345 28518 webserver.cc:460] Webserver started at http://127.27.215.190:33147/ using document root <none> and password file <none>
I20240502 01:56:06.748231 28518 fs_manager.cc:359] Metadata directory not provided
I20240502 01:56:06.748402 28518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:56:06.748742 28518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:56:06.752204 28518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/master-0/data/instance:
uuid: "0e02f0f6ccba4b2984027505c541ed08"
format_stamp: "Formatted at 2024-05-02 01:56:06 on dist-test-slave-v8sz"
I20240502 01:56:06.753168 28518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/master-0/wal/instance:
uuid: "0e02f0f6ccba4b2984027505c541ed08"
format_stamp: "Formatted at 2024-05-02 01:56:06 on dist-test-slave-v8sz"
I20240502 01:56:06.759474 28518 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20240502 01:56:06.764029 28532 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:06.765839 28518 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20240502 01:56:06.766072 28518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/master-0/data,/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/master-0/wal
uuid: "0e02f0f6ccba4b2984027505c541ed08"
format_stamp: "Formatted at 2024-05-02 01:56:06 on dist-test-slave-v8sz"
I20240502 01:56:06.766310 28518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:56:06.780587 28518 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:56:06.781649 28518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:56:06.782016 28518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:56:06.803218 28518 rpc_server.cc:307] RPC server started. Bound to: 127.27.215.190:44137
I20240502 01:56:06.803237 28583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.215.190:44137 every 8 connection(s)
I20240502 01:56:06.804919 28518 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/master-0/data/info.pb
I20240502 01:56:06.809325 28584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:06.813192 28510 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ga2ld/build/asan/bin/kudu as pid 28518
I20240502 01:56:06.813527 28510 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/master-0/wal/instance
I20240502 01:56:06.819684 28584 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08: Bootstrap starting.
I20240502 01:56:06.823315 28584 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08: Neither blocks nor log segments found. Creating new log.
I20240502 01:56:06.824429 28584 log.cc:824] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08: Log is configured to *not* fsync() on all Append() calls
I20240502 01:56:06.827443 28584 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08: No bootstrap required, opened a new log
I20240502 01:56:06.836547 28584 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e02f0f6ccba4b2984027505c541ed08" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 44137 } }
I20240502 01:56:06.837100 28584 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:56:06.837244 28584 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e02f0f6ccba4b2984027505c541ed08, State: Initialized, Role: FOLLOWER
I20240502 01:56:06.838009 28584 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e02f0f6ccba4b2984027505c541ed08" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 44137 } }
I20240502 01:56:06.838229 28584 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:06.838367 28584 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:06.838521 28584 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:56:06.841338 28584 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e02f0f6ccba4b2984027505c541ed08" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 44137 } }
I20240502 01:56:06.842049 28584 leader_election.cc:302] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0e02f0f6ccba4b2984027505c541ed08; no voters:
I20240502 01:56:06.843240 28584 leader_election.cc:288] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:56:06.843333 28589 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:56:06.844835 28589 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08 [term 1 LEADER]: Becoming Leader. State: Replica: 0e02f0f6ccba4b2984027505c541ed08, State: Running, Role: LEADER
I20240502 01:56:06.845432 28589 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e02f0f6ccba4b2984027505c541ed08" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 44137 } }
I20240502 01:56:06.845562 28584 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08 [sys.catalog]: configured and running, proceeding with master startup.
I20240502 01:56:06.848273 28590 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0e02f0f6ccba4b2984027505c541ed08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e02f0f6ccba4b2984027505c541ed08" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 44137 } } }
I20240502 01:56:06.848668 28590 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08 [sys.catalog]: This master's current role is: LEADER
I20240502 01:56:06.849099 28591 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e02f0f6ccba4b2984027505c541ed08. Latest consensus state: current_term: 1 leader_uuid: "0e02f0f6ccba4b2984027505c541ed08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e02f0f6ccba4b2984027505c541ed08" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 44137 } } }
I20240502 01:56:06.849429 28591 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08 [sys.catalog]: This master's current role is: LEADER
I20240502 01:56:06.850764 28598 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 01:56:06.856690 28598 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 01:56:06.858098 28607 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20240502 01:56:06.867617 28598 catalog_manager.cc:1347] Generated new cluster ID: d47e9ddc8aea478f8a6a60093d73653c
I20240502 01:56:06.867765 28598 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 01:56:06.883405 28598 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 01:56:06.884734 28598 catalog_manager.cc:1504] Loading token signing keys...
I20240502 01:56:06.900813 28598 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08: Generated new TSK 0
I20240502 01:56:06.902163 28598 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 01:56:06.917579 28510 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ga2ld/build/asan/bin/kudu
/tmp/dist-test-task7ga2ld/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.215.129:0
--local_ip_for_outbound_sockets=127.27.215.129
--webserver_interface=127.27.215.129
--webserver_port=0
--tserver_master_addrs=127.27.215.190:44137
--builtin_ntp_servers=127.27.215.148:42231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240502 01:56:07.280970 28609 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:56:07.281333 28609 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:56:07.281513 28609 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:56:07.290166 28609 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:56:07.290438 28609 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.215.129
I20240502 01:56:07.300069 28609 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.215.148:42231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.215.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.215.129
--webserver_port=0
--tserver_master_addrs=127.27.215.190:44137
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.215.129
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 02 May 2024 01:43:22 UTC on efd1337a2aa3
build id 83
ASAN enabled
I20240502 01:56:07.301601 28609 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:56:07.303508 28609 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:56:07.316480 28615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:07.316450 28614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:07.316402 28617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:56:07.317457 28609 server_base.cc:1034] running on GCE node
I20240502 01:56:07.318145 28609 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:56:07.319180 28609 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:56:07.320472 28609 hybrid_clock.cc:648] HybridClock initialized: now 1714614967320394 us; error 39 us; skew 500 ppm
I20240502 01:56:07.320822 28609 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:56:07.323576 28609 webserver.cc:460] Webserver started at http://127.27.215.129:33843/ using document root <none> and password file <none>
I20240502 01:56:07.324385 28609 fs_manager.cc:359] Metadata directory not provided
I20240502 01:56:07.324541 28609 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:56:07.324858 28609 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:56:07.327814 28609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/data/instance:
uuid: "5a4e2f766b1f420684cafd0aa798e0e8"
format_stamp: "Formatted at 2024-05-02 01:56:07 on dist-test-slave-v8sz"
I20240502 01:56:07.328687 28609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/wal/instance:
uuid: "5a4e2f766b1f420684cafd0aa798e0e8"
format_stamp: "Formatted at 2024-05-02 01:56:07 on dist-test-slave-v8sz"
I20240502 01:56:07.334848 28609 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20240502 01:56:07.339085 28623 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:07.340584 28609 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20240502 01:56:07.340785 28609 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/wal
uuid: "5a4e2f766b1f420684cafd0aa798e0e8"
format_stamp: "Formatted at 2024-05-02 01:56:07 on dist-test-slave-v8sz"
I20240502 01:56:07.341006 28609 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:56:07.369427 28609 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:56:07.370440 28609 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:56:07.370761 28609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:56:07.371901 28609 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:56:07.373747 28609 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:56:07.373845 28609 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:07.373991 28609 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:56:07.374050 28609 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:07.408674 28609 rpc_server.cc:307] RPC server started. Bound to: 127.27.215.129:35033
I20240502 01:56:07.408751 28735 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.215.129:35033 every 8 connection(s)
I20240502 01:56:07.410152 28609 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/data/info.pb
I20240502 01:56:07.418219 28510 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ga2ld/build/asan/bin/kudu as pid 28609
I20240502 01:56:07.418438 28510 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/wal/instance
I20240502 01:56:07.422556 28510 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ga2ld/build/asan/bin/kudu
/tmp/dist-test-task7ga2ld/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.215.130:0
--local_ip_for_outbound_sockets=127.27.215.130
--webserver_interface=127.27.215.130
--webserver_port=0
--tserver_master_addrs=127.27.215.190:44137
--builtin_ntp_servers=127.27.215.148:42231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240502 01:56:07.425597 28736 heartbeater.cc:347] Connected to a master server at 127.27.215.190:44137
I20240502 01:56:07.425997 28736 heartbeater.cc:464] Registering TS with master...
I20240502 01:56:07.427098 28736 heartbeater.cc:511] Master 127.27.215.190:44137 requested a full tablet report, sending...
I20240502 01:56:07.429646 28549 ts_manager.cc:194] Registered new tserver with Master: 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:07.431342 28549 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.215.129:56589
W20240502 01:56:07.790179 28740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:56:07.790519 28740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:56:07.790676 28740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:56:07.798880 28740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:56:07.799119 28740 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.215.130
I20240502 01:56:07.809410 28740 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.215.148:42231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.215.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.215.130
--webserver_port=0
--tserver_master_addrs=127.27.215.190:44137
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.215.130
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 02 May 2024 01:43:22 UTC on efd1337a2aa3
build id 83
ASAN enabled
I20240502 01:56:07.810915 28740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:56:07.812974 28740 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:56:07.826757 28746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:07.826861 28748 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:07.826839 28745 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:56:07.827884 28740 server_base.cc:1034] running on GCE node
I20240502 01:56:07.828584 28740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:56:07.829727 28740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:56:07.831012 28740 hybrid_clock.cc:648] HybridClock initialized: now 1714614967830912 us; error 65 us; skew 500 ppm
I20240502 01:56:07.831432 28740 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:56:07.834291 28740 webserver.cc:460] Webserver started at http://127.27.215.130:37647/ using document root <none> and password file <none>
I20240502 01:56:07.835109 28740 fs_manager.cc:359] Metadata directory not provided
I20240502 01:56:07.835266 28740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:56:07.835601 28740 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:56:07.838584 28740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data/instance:
uuid: "f991532a36db458dac9ef9190ed6e16f"
format_stamp: "Formatted at 2024-05-02 01:56:07 on dist-test-slave-v8sz"
I20240502 01:56:07.839419 28740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/wal/instance:
uuid: "f991532a36db458dac9ef9190ed6e16f"
format_stamp: "Formatted at 2024-05-02 01:56:07 on dist-test-slave-v8sz"
I20240502 01:56:07.845223 28740 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20240502 01:56:07.849198 28754 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:07.850909 28740 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240502 01:56:07.851109 28740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/wal
uuid: "f991532a36db458dac9ef9190ed6e16f"
format_stamp: "Formatted at 2024-05-02 01:56:07 on dist-test-slave-v8sz"
I20240502 01:56:07.851341 28740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:56:07.890967 28740 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:56:07.891938 28740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:56:07.892263 28740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:56:07.893431 28740 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:56:07.895176 28740 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:56:07.895275 28740 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:07.895423 28740 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:56:07.895483 28740 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:07.929972 28740 rpc_server.cc:307] RPC server started. Bound to: 127.27.215.130:39541
I20240502 01:56:07.930058 28867 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.215.130:39541 every 8 connection(s)
I20240502 01:56:07.931450 28740 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data/info.pb
I20240502 01:56:07.934581 28510 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ga2ld/build/asan/bin/kudu as pid 28740
I20240502 01:56:07.934825 28510 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/wal/instance
I20240502 01:56:07.945339 28868 heartbeater.cc:347] Connected to a master server at 127.27.215.190:44137
I20240502 01:56:07.945731 28868 heartbeater.cc:464] Registering TS with master...
I20240502 01:56:07.946719 28868 heartbeater.cc:511] Master 127.27.215.190:44137 requested a full tablet report, sending...
I20240502 01:56:07.948153 28549 ts_manager.cc:194] Registered new tserver with Master: f991532a36db458dac9ef9190ed6e16f (127.27.215.130:39541)
I20240502 01:56:07.949005 28549 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.215.130:52127
I20240502 01:56:07.952059 28510 external_mini_cluster.cc:930] 2 TS(s) registered with all masters
I20240502 01:56:07.972718 28510 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task7ga2ld/build/asan/bin/kudu pid 28740
I20240502 01:56:07.981774 28863 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 01:56:08.067078 28510 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ga2ld/build/asan/bin/kudu with pid 28740
I20240502 01:56:08.084599 28510 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task7ga2ld/build/asan/bin/kudu pid 28518
I20240502 01:56:08.085932 28579 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 01:56:08.188355 28510 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ga2ld/build/asan/bin/kudu with pid 28518
I20240502 01:56:08.210291 28510 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ga2ld/build/asan/bin/kudu
/tmp/dist-test-task7ga2ld/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.215.190:44137
--webserver_interface=127.27.215.190
--webserver_port=33147
--builtin_ntp_servers=127.27.215.148:42231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.215.190:44137
--master_tombstone_evicted_tablet_replicas=false with env {}
I20240502 01:56:08.435632 28736 heartbeater.cc:503] Master 127.27.215.190:44137 was elected leader, sending a full tablet report...
W20240502 01:56:08.437628 28736 heartbeater.cc:644] Failed to heartbeat to 127.27.215.190:44137 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.27.215.190:44137: connect: Connection refused (error 111)
W20240502 01:56:08.564327 28881 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:56:08.564677 28881 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:56:08.564762 28881 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:56:08.572671 28881 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 01:56:08.572803 28881 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:56:08.572847 28881 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 01:56:08.572916 28881 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 01:56:08.582631 28881 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.215.148:42231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.27.215.190:44137
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.215.190:44137
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.215.190
--webserver_port=33147
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 02 May 2024 01:43:22 UTC on efd1337a2aa3
build id 83
ASAN enabled
I20240502 01:56:08.584020 28881 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:56:08.585935 28881 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:56:08.597667 28890 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:08.597810 28888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:08.597791 28887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:56:08.598742 28881 server_base.cc:1034] running on GCE node
I20240502 01:56:08.599665 28881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:56:08.601393 28881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:56:08.602725 28881 hybrid_clock.cc:648] HybridClock initialized: now 1714614968602641 us; error 50 us; skew 500 ppm
I20240502 01:56:08.603137 28881 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:56:08.605965 28881 webserver.cc:460] Webserver started at http://127.27.215.190:33147/ using document root <none> and password file <none>
I20240502 01:56:08.606796 28881 fs_manager.cc:359] Metadata directory not provided
I20240502 01:56:08.606964 28881 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:56:08.613754 28881 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.006s sys 0.001s
I20240502 01:56:08.617555 28896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:08.619298 28881 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20240502 01:56:08.619545 28881 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/master-0/data,/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/master-0/wal
uuid: "0e02f0f6ccba4b2984027505c541ed08"
format_stamp: "Formatted at 2024-05-02 01:56:06 on dist-test-slave-v8sz"
I20240502 01:56:08.620534 28881 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:56:08.636184 28881 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:56:08.637182 28881 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:56:08.637539 28881 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:56:08.657785 28881 rpc_server.cc:307] RPC server started. Bound to: 127.27.215.190:44137
I20240502 01:56:08.657809 28947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.215.190:44137 every 8 connection(s)
I20240502 01:56:08.659528 28881 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/master-0/data/info.pb
I20240502 01:56:08.661844 28510 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ga2ld/build/asan/bin/kudu as pid 28881
I20240502 01:56:08.667831 28948 sys_catalog.cc:263] Verifying existing consensus state
I20240502 01:56:08.672353 28948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08: Bootstrap starting.
I20240502 01:56:08.690686 28948 log.cc:824] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08: Log is configured to *not* fsync() on all Append() calls
I20240502 01:56:08.700222 28948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:56:08.700840 28948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08: Bootstrap complete.
I20240502 01:56:08.709304 28948 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e02f0f6ccba4b2984027505c541ed08" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 44137 } }
I20240502 01:56:08.710281 28948 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e02f0f6ccba4b2984027505c541ed08, State: Initialized, Role: FOLLOWER
I20240502 01:56:08.711006 28948 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e02f0f6ccba4b2984027505c541ed08" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 44137 } }
I20240502 01:56:08.711264 28948 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:08.711388 28948 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:08.711580 28948 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:56:08.715615 28948 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e02f0f6ccba4b2984027505c541ed08" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 44137 } }
I20240502 01:56:08.716332 28948 leader_election.cc:302] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0e02f0f6ccba4b2984027505c541ed08; no voters:
I20240502 01:56:08.717099 28948 leader_election.cc:288] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 01:56:08.717319 28953 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:56:08.719206 28953 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08 [term 2 LEADER]: Becoming Leader. State: Replica: 0e02f0f6ccba4b2984027505c541ed08, State: Running, Role: LEADER
I20240502 01:56:08.719759 28953 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e02f0f6ccba4b2984027505c541ed08" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 44137 } }
I20240502 01:56:08.720124 28948 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08 [sys.catalog]: configured and running, proceeding with master startup.
I20240502 01:56:08.722653 28955 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e02f0f6ccba4b2984027505c541ed08. Latest consensus state: current_term: 2 leader_uuid: "0e02f0f6ccba4b2984027505c541ed08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e02f0f6ccba4b2984027505c541ed08" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 44137 } } }
I20240502 01:56:08.722572 28954 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "0e02f0f6ccba4b2984027505c541ed08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e02f0f6ccba4b2984027505c541ed08" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 44137 } } }
I20240502 01:56:08.723081 28955 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08 [sys.catalog]: This master's current role is: LEADER
I20240502 01:56:08.723089 28954 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08 [sys.catalog]: This master's current role is: LEADER
I20240502 01:56:08.732229 28961 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 01:56:08.739528 28961 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 01:56:08.741379 28961 catalog_manager.cc:1259] Loaded cluster ID: d47e9ddc8aea478f8a6a60093d73653c
I20240502 01:56:08.741505 28961 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 01:56:08.745434 28961 catalog_manager.cc:1504] Loading token signing keys...
I20240502 01:56:08.746837 28961 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0e02f0f6ccba4b2984027505c541ed08: Loaded TSK: 0
I20240502 01:56:08.748198 28961 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 01:56:09.445833 28736 heartbeater.cc:347] Connected to a master server at 127.27.215.190:44137
I20240502 01:56:09.446069 28736 heartbeater.cc:503] Master 127.27.215.190:44137 was elected leader, sending a full tablet report...
I20240502 01:56:09.448293 28913 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "5a4e2f766b1f420684cafd0aa798e0e8" instance_seqno: 1714614967400546) as {username='slave'} at 127.27.215.129:35713; Asking this server to re-register.
I20240502 01:56:09.449460 28736 heartbeater.cc:464] Registering TS with master...
I20240502 01:56:09.449774 28736 heartbeater.cc:511] Master 127.27.215.190:44137 requested a full tablet report, sending...
I20240502 01:56:09.451261 28913 ts_manager.cc:194] Registered new tserver with Master: 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:09.457734 28510 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20240502 01:56:09.458072 28510 test_util.cc:268] Using random seed: -399614607
I20240502 01:56:09.484706 28913 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49902:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20240502 01:56:09.511857 28671 tablet_service.cc:1467] Processing CreateTablet for tablet ed28938f86c44ee38b42d4c8108d35fa (DEFAULT_TABLE table=test-workload [id=053664eb01084876be63e5bfca914418]), partition=RANGE (key) PARTITION UNBOUNDED
I20240502 01:56:09.513283 28671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed28938f86c44ee38b42d4c8108d35fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:09.524844 28983 tablet_bootstrap.cc:492] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8: Bootstrap starting.
I20240502 01:56:09.528227 28983 tablet_bootstrap.cc:654] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8: Neither blocks nor log segments found. Creating new log.
I20240502 01:56:09.529346 28983 log.cc:824] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8: Log is configured to *not* fsync() on all Append() calls
I20240502 01:56:09.532198 28983 tablet_bootstrap.cc:492] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8: No bootstrap required, opened a new log
I20240502 01:56:09.532511 28983 ts_tablet_manager.cc:1367] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20240502 01:56:09.539026 28983 raft_consensus.cc:348] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a4e2f766b1f420684cafd0aa798e0e8" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 35033 } }
I20240502 01:56:09.539463 28983 raft_consensus.cc:374] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:56:09.539558 28983 raft_consensus.cc:729] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a4e2f766b1f420684cafd0aa798e0e8, State: Initialized, Role: FOLLOWER
I20240502 01:56:09.540226 28983 consensus_queue.cc:260] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a4e2f766b1f420684cafd0aa798e0e8" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 35033 } }
I20240502 01:56:09.540447 28983 raft_consensus.cc:388] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:09.540560 28983 raft_consensus.cc:482] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:09.540697 28983 raft_consensus.cc:3037] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:56:09.542898 28983 raft_consensus.cc:504] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a4e2f766b1f420684cafd0aa798e0e8" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 35033 } }
I20240502 01:56:09.543496 28983 leader_election.cc:302] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a4e2f766b1f420684cafd0aa798e0e8; no voters:
I20240502 01:56:09.544202 28983 leader_election.cc:288] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:56:09.544396 28985 raft_consensus.cc:2781] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:56:09.545055 28985 raft_consensus.cc:686] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [term 1 LEADER]: Becoming Leader. State: Replica: 5a4e2f766b1f420684cafd0aa798e0e8, State: Running, Role: LEADER
I20240502 01:56:09.545737 28985 consensus_queue.cc:237] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a4e2f766b1f420684cafd0aa798e0e8" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 35033 } }
I20240502 01:56:09.546308 28983 ts_tablet_manager.cc:1398] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8: Time spent starting tablet: real 0.014s user 0.011s sys 0.004s
I20240502 01:56:09.551517 28913 catalog_manager.cc:5484] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129). New cstate: current_term: 1 leader_uuid: "5a4e2f766b1f420684cafd0aa798e0e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a4e2f766b1f420684cafd0aa798e0e8" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 35033 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:10.276515 28510 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ga2ld/build/asan/bin/kudu
/tmp/dist-test-task7ga2ld/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.215.130:39541
--local_ip_for_outbound_sockets=127.27.215.130
--tserver_master_addrs=127.27.215.190:44137
--webserver_port=37647
--webserver_interface=127.27.215.130
--builtin_ntp_servers=127.27.215.148:42231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240502 01:56:10.628136 29001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:56:10.628564 29001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:56:10.628726 29001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:56:10.637053 29001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:56:10.637282 29001 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.215.130
I20240502 01:56:10.647382 29001 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.215.148:42231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.215.130:39541
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.215.130
--webserver_port=37647
--tserver_master_addrs=127.27.215.190:44137
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.215.130
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 02 May 2024 01:43:22 UTC on efd1337a2aa3
build id 83
ASAN enabled
I20240502 01:56:10.648828 29001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:56:10.650826 29001 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:56:10.665235 29007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:10.665542 29009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:10.665854 29006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:56:10.667455 29001 server_base.cc:1034] running on GCE node
I20240502 01:56:10.668138 29001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:56:10.669190 29001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:56:10.670473 29001 hybrid_clock.cc:648] HybridClock initialized: now 1714614970670361 us; error 62 us; skew 500 ppm
I20240502 01:56:10.670840 29001 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:56:10.673498 29001 webserver.cc:460] Webserver started at http://127.27.215.130:37647/ using document root <none> and password file <none>
I20240502 01:56:10.674293 29001 fs_manager.cc:359] Metadata directory not provided
I20240502 01:56:10.674436 29001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:56:10.680317 29001 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20240502 01:56:10.683785 29015 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:10.685428 29001 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20240502 01:56:10.685638 29001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/wal
uuid: "f991532a36db458dac9ef9190ed6e16f"
format_stamp: "Formatted at 2024-05-02 01:56:07 on dist-test-slave-v8sz"
I20240502 01:56:10.686595 29001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:56:10.705612 29001 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:56:10.706547 29001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:56:10.706825 29001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:56:10.707867 29001 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:56:10.709583 29001 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:56:10.709702 29001 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:10.709826 29001 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:56:10.709903 29001 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:10.744078 29001 rpc_server.cc:307] RPC server started. Bound to: 127.27.215.130:39541
I20240502 01:56:10.744132 29128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.215.130:39541 every 8 connection(s)
I20240502 01:56:10.745707 29001 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data/info.pb
I20240502 01:56:10.747443 28510 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ga2ld/build/asan/bin/kudu as pid 29001
I20240502 01:56:10.752728 28510 tablet_copy_client_session-itest.cc:139] Starting loop 0
I20240502 01:56:10.753013 28510 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task7ga2ld/build/asan/bin/kudu pid 28609
I20240502 01:56:10.754266 28731 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 01:56:10.765513 29129 heartbeater.cc:347] Connected to a master server at 127.27.215.190:44137
I20240502 01:56:10.765873 29129 heartbeater.cc:464] Registering TS with master...
I20240502 01:56:10.766781 29129 heartbeater.cc:511] Master 127.27.215.190:44137 requested a full tablet report, sending...
I20240502 01:56:10.768333 28911 ts_manager.cc:194] Registered new tserver with Master: f991532a36db458dac9ef9190ed6e16f (127.27.215.130:39541)
I20240502 01:56:10.769538 28911 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.215.130:47873
I20240502 01:56:10.854004 28510 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ga2ld/build/asan/bin/kudu with pid 28609
I20240502 01:56:10.876289 28510 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ga2ld/build/asan/bin/kudu
/tmp/dist-test-task7ga2ld/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.215.129:35033
--local_ip_for_outbound_sockets=127.27.215.129
--tserver_master_addrs=127.27.215.190:44137
--webserver_port=33843
--webserver_interface=127.27.215.129
--builtin_ntp_servers=127.27.215.148:42231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240502 01:56:10.912950 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:10.920593 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:10.923856 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:10.925123 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:10.956983 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:10.958307 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:10.964190 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:10.966146 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:10.977962 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:10.979465 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:10.997783 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:10.999411 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.009873 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.011252 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.019210 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.021615 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.040095 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.041447 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.050318 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.051707 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.063982 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.065387 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.079481 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.080811 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.083734 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.084925 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.088740 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.089823 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.092869 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.094081 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.103760 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.105665 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.121299 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.124986 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.131709 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.133103 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.140992 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.142351 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.146400 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.153942 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.156661 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.157986 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.164884 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.166214 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.198469 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.199844 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.206622 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.209020 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.223711 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.225001 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.232473 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.233814 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.238837 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.239995 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.259043 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.260311 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
W20240502 01:56:11.267102 29140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:56:11.267446 29140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:56:11.267601 29140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20240502 01:56:11.272392 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.273707 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.276698 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
W20240502 01:56:11.277801 29140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:56:11.278051 29140 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.215.129
I20240502 01:56:11.278842 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.285274 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.286480 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.289005 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.290151 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.290100 29140 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.215.148:42231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.215.129:35033
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.215.129
--webserver_port=33843
--tserver_master_addrs=127.27.215.190:44137
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.215.129
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 02 May 2024 01:43:22 UTC on efd1337a2aa3
build id 83
ASAN enabled
I20240502 01:56:11.291893 29140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:56:11.293951 29140 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20240502 01:56:11.294682 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.296054 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
W20240502 01:56:11.307351 29283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:11.307361 29285 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:56:11.307740 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
W20240502 01:56:11.308362 29282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:56:11.308817 29140 server_base.cc:1034] running on GCE node
I20240502 01:56:11.309392 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.309756 29140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:56:11.311067 29140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:56:11.312331 29140 hybrid_clock.cc:648] HybridClock initialized: now 1714614971312245 us; error 58 us; skew 500 ppm
I20240502 01:56:11.312672 29140 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:56:11.314992 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.315588 29140 webserver.cc:460] Webserver started at http://127.27.215.129:33843/ using document root <none> and password file <none>
I20240502 01:56:11.316385 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.316574 29140 fs_manager.cc:359] Metadata directory not provided
I20240502 01:56:11.316735 29140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:56:11.322536 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.322995 29140 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20240502 01:56:11.323752 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.326891 29303 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:11.327729 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.328799 29140 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20240502 01:56:11.328987 29140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/wal
uuid: "5a4e2f766b1f420684cafd0aa798e0e8"
format_stamp: "Formatted at 2024-05-02 01:56:07 on dist-test-slave-v8sz"
I20240502 01:56:11.330027 29140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:56:11.333694 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.342299 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.343514 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.345716 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.346920 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.349982 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.351302 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.357211 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.358613 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.367760 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.369086 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.374997 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.376319 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.376693 29140 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:56:11.377846 29140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:56:11.378201 29140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:56:11.379431 29140 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:56:11.381707 29338 ts_tablet_manager.cc:522] Loading tablet metadata (0/1 complete)
I20240502 01:56:11.382298 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.383512 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.388301 29140 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240502 01:56:11.388511 29140 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20240502 01:56:11.388665 29140 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240502 01:56:11.391884 29140 ts_tablet_manager.cc:590] Registered 1 tablets
I20240502 01:56:11.392004 29140 ts_tablet_manager.cc:569] Time spent register tablets: real 0.003s user 0.001s sys 0.000s
I20240502 01:56:11.392565 29338 tablet_bootstrap.cc:492] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8: Bootstrap starting.
I20240502 01:56:11.397994 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.401804 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.406880 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.416718 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.423911 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.427446 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.442358 29142 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.445545 29142 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.455483 29142 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.458092 29142 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.466173 29140 rpc_server.cc:307] RPC server started. Bound to: 127.27.215.129:35033
I20240502 01:56:11.466210 29468 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.215.129:35033 every 8 connection(s)
I20240502 01:56:11.468478 29140 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/data/info.pb
I20240502 01:56:11.468889 28510 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ga2ld/build/asan/bin/kudu as pid 29140
I20240502 01:56:11.471453 29142 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.472723 29142 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.488072 29469 heartbeater.cc:347] Connected to a master server at 127.27.215.190:44137
I20240502 01:56:11.488507 29469 heartbeater.cc:464] Registering TS with master...
I20240502 01:56:11.489235 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.489704 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
I20240502 01:56:11.489883 29469 heartbeater.cc:511] Master 127.27.215.190:44137 requested a full tablet report, sending...
W20240502 01:56:11.491495 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.495756 28911 ts_manager.cc:194] Re-registered known tserver with Master: 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.497390 28911 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.215.129:39407
I20240502 01:56:11.500260 29142 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.501763 29142 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.502604 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.502805 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.503022 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.509039 29142 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.510396 29142 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.511335 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.511536 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.511716 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.517017 29338 log.cc:824] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8: Log is configured to *not* fsync() on all Append() calls
I20240502 01:56:11.529084 29142 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.530498 29142 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.531270 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.531464 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.531666 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.535244 29142 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.537698 29142 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.538589 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.538750 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.538944 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.547868 29142 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.549777 29142 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.550577 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.550760 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.551007 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.557015 29142 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.561005 29142 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.561830 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.561990 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.562197 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.566733 29142 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.567888 29142 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.568619 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.568795 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.568969 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.572917 29142 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.574132 29142 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.574819 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.574978 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.575171 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.578960 29142 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.580192 29142 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.580899 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.581063 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.581244 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.583667 29142 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.584777 29142 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.585489 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.585644 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.585851 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.601332 29142 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.606465 29142 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.607440 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.607667 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.607878 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.612313 29142 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.613543 29142 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.614360 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.614538 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.614727 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.651254 29142 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.652604 29142 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.653388 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.653586 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.653769 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.655390 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.662027 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.662914 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.663087 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.663287 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.677989 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.679287 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.680099 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.680321 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.680570 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.701761 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.702924 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.703755 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.703935 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.704141 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.712741 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.714609 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.715255 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.715456 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.715656 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.722101 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.730603 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.731393 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.731640 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.731866 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.736361 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.738201 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.738930 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.739128 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.739369 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.748065 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.749444 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.750398 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.750603 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.750803 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.754226 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.758208 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.759056 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.759248 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.759428 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.764621 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.772035 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.772428 29129 heartbeater.cc:503] Master 127.27.215.190:44137 was elected leader, sending a full tablet report...
I20240502 01:56:11.772984 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.773175 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.773432 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.779361 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.780743 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.781666 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.781857 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.782044 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.784773 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.786870 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.787760 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.787941 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.788141 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.797909 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.799171 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.799969 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.800205 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.800400 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.806418 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.807741 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.808724 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.808889 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.809074 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.817203 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.818507 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.819422 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.819635 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.819880 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.822093 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.825716 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.826632 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.826812 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.827034 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.836498 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.838271 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.838977 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.839190 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.839418 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.842092 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.843320 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.844033 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.844190 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.844378 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.848435 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.849648 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.850324 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.850484 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.850664 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.852733 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.854002 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.854811 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.854966 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.855118 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.857565 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.858808 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.859489 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.859668 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.859817 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.862762 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.864126 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.864918 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.865084 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.865272 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.869797 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.871124 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.871870 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.872056 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.872256 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.879127 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.880461 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.881321 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.881551 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.881752 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.889490 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.890856 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.891764 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.891973 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.892248 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.896620 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.897936 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.898734 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.898890 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.899091 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.915611 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.916811 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.917711 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.917901 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.918067 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.923827 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.925068 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.926049 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.926260 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.926482 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.932947 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.934336 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.935114 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.935324 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.935501 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.941761 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.943120 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.943862 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.944012 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.944218 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.948540 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.949824 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.950567 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.950750 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.950928 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.966338 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.967701 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.968576 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.968755 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.968948 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.971522 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.972810 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.973629 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.973827 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.974045 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:11.994537 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:11.996491 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:11.997332 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:11.997640 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:11.997877 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:12.003266 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:12.004447 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:12.005117 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:12.005307 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:12.005524 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:12.007501 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:12.009717 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:12.010473 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:12.010636 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:12.010835 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:12.028961 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:12.030308 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:12.031248 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:12.031487 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:12.031704 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:12.034200 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:12.035648 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:12.036530 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:12.036690 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:12.036922 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:12.039345 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:12.046061 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:12.046886 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:12.047098 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:12.047327 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:12.059676 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:12.061018 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:12.061939 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:12.062134 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:12.062350 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:12.065716 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:12.071825 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:12.072867 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:12.073104 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:12.073309 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:12.078475 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:12.079762 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:12.080639 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:12.080819 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:12.081007 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:12.084741 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:12.086000 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:12.086845 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:12.087055 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:12.087275 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:12.091801 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:12.097100 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:12.098320 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:12.098565 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:12.098788 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:12.107628 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:12.109308 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:12.110268 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:12.110494 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:12.110688 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:12.122367 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:12.127095 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:12.127965 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:12.128168 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:12.128418 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:12.134184 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:12.135581 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:12.136539 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:12.136760 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:12.136976 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:12.150967 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:12.152384 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:12.153276 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:12.153507 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:12.153750 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:12.170143 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:12.171563 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:12.172495 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:12.172710 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:12.172909 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:12.175426 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:12.183106 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:12.184152 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:12.184361 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:12.184666 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:12.186193 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:12.187551 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:12.188220 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:12.188400 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:12.188589 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:12.203121 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:12.204170 29338 tablet_bootstrap.cc:492] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=220 overwritten=0 applied=220 ignored=0} inserts{seen=10950 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:56:12.204505 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:12.204810 29338 tablet_bootstrap.cc:492] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8: Bootstrap complete.
I20240502 01:56:12.205260 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:12.205462 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:12.205672 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:12.206249 29338 ts_tablet_manager.cc:1367] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8: Time spent bootstrapping tablet: real 0.814s user 0.736s sys 0.071s
I20240502 01:56:12.215354 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:12.213842 29338 raft_consensus.cc:348] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a4e2f766b1f420684cafd0aa798e0e8" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 35033 } }
I20240502 01:56:12.216353 29338 raft_consensus.cc:729] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a4e2f766b1f420684cafd0aa798e0e8, State: Initialized, Role: FOLLOWER
I20240502 01:56:12.217109 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:12.217342 29338 consensus_queue.cc:260] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 220, Last appended: 1.220, Last appended by leader: 220, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a4e2f766b1f420684cafd0aa798e0e8" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 35033 } }
I20240502 01:56:12.217666 29338 raft_consensus.cc:388] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:12.217808 29338 raft_consensus.cc:482] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:12.218022 29338 raft_consensus.cc:3037] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:56:12.218048 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:12.218245 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:12.218449 29440 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:46365: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:12.222749 29338 raft_consensus.cc:504] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a4e2f766b1f420684cafd0aa798e0e8" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 35033 } }
I20240502 01:56:12.223306 29338 leader_election.cc:302] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a4e2f766b1f420684cafd0aa798e0e8; no voters:
I20240502 01:56:12.223979 29338 leader_election.cc:288] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 01:56:12.224134 29741 raft_consensus.cc:2781] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:56:12.224819 29741 raft_consensus.cc:686] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [term 2 LEADER]: Becoming Leader. State: Replica: 5a4e2f766b1f420684cafd0aa798e0e8, State: Running, Role: LEADER
I20240502 01:56:12.225402 29469 heartbeater.cc:503] Master 127.27.215.190:44137 was elected leader, sending a full tablet report...
I20240502 01:56:12.225530 29741 consensus_queue.cc:237] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 220, Committed index: 220, Last appended: 1.220, Last appended by leader: 220, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a4e2f766b1f420684cafd0aa798e0e8" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 35033 } }
I20240502 01:56:12.226065 29338 ts_tablet_manager.cc:1398] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8: Time spent starting tablet: real 0.020s user 0.016s sys 0.004s
I20240502 01:56:12.227133 29144 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:12.229059 29144 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:12.229571 28911 catalog_manager.cc:5484] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "5a4e2f766b1f420684cafd0aa798e0e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a4e2f766b1f420684cafd0aa798e0e8" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 35033 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:12.230621 29440 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:46365)
I20240502 01:56:12.230774 29440 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:46365: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
I20240502 01:56:12.233984 29440 tablet_copy_source_session.cc:205] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:56:12.239385 29144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed28938f86c44ee38b42d4c8108d35fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:12.250929 29144 tablet_copy_client.cc:783] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Starting download of 0 data blocks...
I20240502 01:56:12.251336 29144 tablet_copy_client.cc:647] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Starting download of 1 WAL segments...
I20240502 01:56:12.256096 29144 tablet_copy_client.cc:523] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:56:12.260282 29144 tablet_bootstrap.cc:492] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Bootstrap starting.
I20240502 01:56:12.332926 29144 log.cc:824] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Log is configured to *not* fsync() on all Append() calls
I20240502 01:56:12.972059 29144 tablet_bootstrap.cc:492] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Bootstrap replayed 1/1 log segments. Stats: ops{read=221 overwritten=0 applied=221 ignored=0} inserts{seen=10950 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:56:12.972676 29144 tablet_bootstrap.cc:492] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Bootstrap complete.
I20240502 01:56:12.973271 29144 ts_tablet_manager.cc:1367] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Time spent bootstrapping tablet: real 0.713s user 0.640s sys 0.071s
I20240502 01:56:12.978945 29144 raft_consensus.cc:348] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a4e2f766b1f420684cafd0aa798e0e8" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 35033 } }
I20240502 01:56:12.979341 29144 raft_consensus.cc:729] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: f991532a36db458dac9ef9190ed6e16f, State: Initialized, Role: NON_PARTICIPANT
I20240502 01:56:12.979835 29144 consensus_queue.cc:260] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 221, Last appended: 2.221, Last appended by leader: 221, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a4e2f766b1f420684cafd0aa798e0e8" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 35033 } }
I20240502 01:56:12.981335 29144 ts_tablet_manager.cc:1398] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Time spent starting tablet: real 0.008s user 0.002s sys 0.005s
I20240502 01:56:12.982297 29440 tablet_copy_service.cc:342] P 5a4e2f766b1f420684cafd0aa798e0e8: Request end of tablet copy session f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa received from {username='slave'} at 127.27.215.130:46365
I20240502 01:56:12.982462 29440 tablet_copy_service.cc:433] P 5a4e2f766b1f420684cafd0aa798e0e8: ending tablet copy session f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa on tablet ed28938f86c44ee38b42d4c8108d35fa with peer f991532a36db458dac9ef9190ed6e16f
W20240502 01:56:12.984426 29144 ts_tablet_manager.cc:701] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Tablet Copy: Invalid argument: Leader has replica of tablet ed28938f86c44ee38b42d4c8108d35fa with term 0, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20240502 01:56:12.986224 29144 ts_tablet_manager.cc:701] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Tablet Copy: Invalid argument: Leader has replica of tablet ed28938f86c44ee38b42d4c8108d35fa with term 0, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20240502 01:56:13.023998 29144 ts_tablet_manager.cc:701] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Tablet Copy: Invalid argument: Leader has replica of tablet ed28938f86c44ee38b42d4c8108d35fa with term 0, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
I20240502 01:56:13.027705 29064 tablet_service.cc:1514] Processing DeleteTablet for tablet ed28938f86c44ee38b42d4c8108d35fa with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:32812
I20240502 01:56:13.028522 29758 tablet_replica.cc:330] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: stopping tablet replica
I20240502 01:56:13.028964 29758 raft_consensus.cc:2229] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f [term 2 NON_PARTICIPANT]: Raft consensus shutting down.
I20240502 01:56:13.029314 29758 raft_consensus.cc:2258] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f [term 2 NON_PARTICIPANT]: Raft consensus is shut down!
I20240502 01:56:13.030583 29758 ts_tablet_manager.cc:1875] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20240502 01:56:13.035465 29758 ts_tablet_manager.cc:1888] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.221
I20240502 01:56:13.035625 29758 log.cc:1196] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Deleting WAL directory at /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/wal/wals/ed28938f86c44ee38b42d4c8108d35fa
I20240502 01:56:13.036134 29758 ts_tablet_manager.cc:1909] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Deleting consensus metadata
I20240502 01:56:13.038254 28510 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task7ga2ld/build/asan/bin/kudu pid 29001
I20240502 01:56:13.039569 29124 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 01:56:13.147209 28510 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ga2ld/build/asan/bin/kudu with pid 29001
I20240502 01:56:13.168663 28510 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ga2ld/build/asan/bin/kudu
/tmp/dist-test-task7ga2ld/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.215.130:39541
--local_ip_for_outbound_sockets=127.27.215.130
--tserver_master_addrs=127.27.215.190:44137
--webserver_port=37647
--webserver_interface=127.27.215.130
--builtin_ntp_servers=127.27.215.148:42231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240502 01:56:13.526362 29760 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:56:13.526690 29760 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:56:13.526831 29760 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:56:13.534979 29760 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:56:13.535228 29760 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.215.130
I20240502 01:56:13.544768 29760 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.215.148:42231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.215.130:39541
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.215.130
--webserver_port=37647
--tserver_master_addrs=127.27.215.190:44137
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.215.130
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 02 May 2024 01:43:22 UTC on efd1337a2aa3
build id 83
ASAN enabled
I20240502 01:56:13.546259 29760 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:56:13.548077 29760 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:56:13.560654 29768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:13.560726 29765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:13.560923 29766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:56:13.561566 29760 server_base.cc:1034] running on GCE node
I20240502 01:56:13.562276 29760 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:56:13.563319 29760 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:56:13.564594 29760 hybrid_clock.cc:648] HybridClock initialized: now 1714614973564504 us; error 68 us; skew 500 ppm
I20240502 01:56:13.564949 29760 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:56:13.572686 29760 webserver.cc:460] Webserver started at http://127.27.215.130:37647/ using document root <none> and password file <none>
I20240502 01:56:13.573629 29760 fs_manager.cc:359] Metadata directory not provided
I20240502 01:56:13.573796 29760 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:56:13.579532 29760 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.001s
I20240502 01:56:13.582597 29774 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:13.584018 29760 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20240502 01:56:13.584232 29760 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/wal
uuid: "f991532a36db458dac9ef9190ed6e16f"
format_stamp: "Formatted at 2024-05-02 01:56:07 on dist-test-slave-v8sz"
I20240502 01:56:13.585155 29760 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:56:13.614318 29760 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:56:13.615278 29760 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:56:13.615608 29760 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:56:13.616680 29760 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:56:13.618425 29760 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:56:13.618535 29760 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:13.618659 29760 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:56:13.618736 29760 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:13.654000 29760 rpc_server.cc:307] RPC server started. Bound to: 127.27.215.130:39541
I20240502 01:56:13.654079 29887 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.215.130:39541 every 8 connection(s)
I20240502 01:56:13.655663 29760 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data/info.pb
I20240502 01:56:13.660445 28510 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ga2ld/build/asan/bin/kudu as pid 29760
I20240502 01:56:13.660778 28510 tablet_copy_client_session-itest.cc:139] Starting loop 1
I20240502 01:56:13.660890 28510 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task7ga2ld/build/asan/bin/kudu pid 29140
I20240502 01:56:13.672905 29464 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 01:56:13.674803 29888 heartbeater.cc:347] Connected to a master server at 127.27.215.190:44137
I20240502 01:56:13.675153 29888 heartbeater.cc:464] Registering TS with master...
I20240502 01:56:13.676081 29888 heartbeater.cc:511] Master 127.27.215.190:44137 requested a full tablet report, sending...
I20240502 01:56:13.677908 28911 ts_manager.cc:194] Re-registered known tserver with Master: f991532a36db458dac9ef9190ed6e16f (127.27.215.130:39541)
I20240502 01:56:13.679222 28911 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.215.130:36055
I20240502 01:56:13.780023 28510 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ga2ld/build/asan/bin/kudu with pid 29140
I20240502 01:56:13.802876 28510 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ga2ld/build/asan/bin/kudu
/tmp/dist-test-task7ga2ld/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.215.129:35033
--local_ip_for_outbound_sockets=127.27.215.129
--tserver_master_addrs=127.27.215.190:44137
--webserver_port=33843
--webserver_interface=127.27.215.129
--builtin_ntp_servers=127.27.215.148:42231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240502 01:56:13.827847 29902 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:13.833866 29902 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:13.840992 29902 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:13.854082 29902 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:13.867445 29902 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:13.868903 29902 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:13.875927 29902 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:13.877306 29902 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:13.884565 29902 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:13.885943 29902 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:13.892550 29902 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:13.894399 29902 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:13.901782 29902 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:13.903162 29902 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:13.906225 29902 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:13.907461 29902 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:13.915293 29902 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:13.916857 29902 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:13.925726 29902 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:13.927122 29902 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:13.941015 29902 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:13.942349 29902 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:13.948923 29902 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:13.951251 29902 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:13.958989 29902 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:13.960479 29902 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:13.963474 29902 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:13.964735 29902 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:13.968302 29902 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:13.969584 29902 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:13.976173 29902 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:13.977844 29902 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:13.991643 29902 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:13.993063 29902 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:13.996268 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.001427 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.013551 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.015174 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.033547 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.035009 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.050479 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.051931 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.088222 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.089717 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.096849 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.098264 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.104507 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.110028 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.113848 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.115136 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.123704 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.125175 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.140198 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.141697 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.146550 29902 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.150116 29902 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.156168 29902 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.158337 29902 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.167668 29902 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.168988 29902 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.177146 29902 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.178608 29902 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.193226 29902 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.194707 29902 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.202406 29902 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.203722 29902 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.208000 29902 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.209316 29902 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.218369 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.219784 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.226440 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.227751 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
W20240502 01:56:14.229238 29900 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:56:14.229717 29900 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:56:14.229882 29900 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:56:14.238729 29900 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:56:14.238970 29900 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.215.129
I20240502 01:56:14.243330 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.244717 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.250331 29900 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.215.148:42231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.215.129:35033
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.215.129
--webserver_port=33843
--tserver_master_addrs=127.27.215.190:44137
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.215.129
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 02 May 2024 01:43:22 UTC on efd1337a2aa3
build id 83
ASAN enabled
I20240502 01:56:14.251977 29900 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:56:14.254045 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.254135 29900 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20240502 01:56:14.255359 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
W20240502 01:56:14.268927 30064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:14.268906 30062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:56:14.269487 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.273950 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
W20240502 01:56:14.274538 30061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:56:14.275768 29900 server_base.cc:1034] running on GCE node
I20240502 01:56:14.276801 29900 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:56:14.278066 29900 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:56:14.278342 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.279362 29900 hybrid_clock.cc:648] HybridClock initialized: now 1714614974279285 us; error 62 us; skew 500 ppm
I20240502 01:56:14.279609 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.279757 29900 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:56:14.283028 29900 webserver.cc:460] Webserver started at http://127.27.215.129:33843/ using document root <none> and password file <none>
I20240502 01:56:14.283849 29900 fs_manager.cc:359] Metadata directory not provided
I20240502 01:56:14.283994 29900 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:56:14.289892 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.291217 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.291661 29900 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20240502 01:56:14.294993 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.296857 30083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:14.298696 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.299453 29900 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.000s
I20240502 01:56:14.299650 29900 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/wal
uuid: "5a4e2f766b1f420684cafd0aa798e0e8"
format_stamp: "Formatted at 2024-05-02 01:56:07 on dist-test-slave-v8sz"
I20240502 01:56:14.301054 29900 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:56:14.306866 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.308248 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.315447 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.316612 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.331041 29900 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:56:14.332016 29900 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:56:14.332331 29900 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:56:14.333480 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.333844 29900 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:56:14.337106 30103 ts_tablet_manager.cc:522] Loading tablet metadata (0/1 complete)
I20240502 01:56:14.343420 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.343899 29900 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240502 01:56:14.344046 29900 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.008s user 0.002s sys 0.000s
I20240502 01:56:14.344188 29900 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240502 01:56:14.348152 29900 ts_tablet_manager.cc:590] Registered 1 tablets
I20240502 01:56:14.348284 29900 ts_tablet_manager.cc:569] Time spent register tablets: real 0.004s user 0.002s sys 0.000s
I20240502 01:56:14.348522 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.348698 30103 tablet_bootstrap.cc:492] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8: Bootstrap starting.
I20240502 01:56:14.354485 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.364696 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.366624 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.376847 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.391178 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.400496 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.413756 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.429013 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.439918 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.446313 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.448758 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.457640 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.462849 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.467902 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.469385 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.474363 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.479234 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.483032 29900 rpc_server.cc:307] RPC server started. Bound to: 127.27.215.129:35033
I20240502 01:56:14.483072 30248 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.215.129:35033 every 8 connection(s)
I20240502 01:56:14.484912 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.484937 29900 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/data/info.pb
I20240502 01:56:14.491964 28510 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ga2ld/build/asan/bin/kudu as pid 29900
I20240502 01:56:14.492235 30103 log.cc:824] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8: Log is configured to *not* fsync() on all Append() calls
I20240502 01:56:14.505792 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.531585 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.531982 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.533689 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:14.538729 30250 heartbeater.cc:347] Connected to a master server at 127.27.215.190:44137
I20240502 01:56:14.539083 30250 heartbeater.cc:464] Registering TS with master...
I20240502 01:56:14.540269 30250 heartbeater.cc:511] Master 127.27.215.190:44137 requested a full tablet report, sending...
I20240502 01:56:14.543118 28911 ts_manager.cc:194] Re-registered known tserver with Master: 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.544719 28911 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.215.129:44073
I20240502 01:56:14.557782 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.559321 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.560073 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.560317 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.560587 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:14.573745 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.575074 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.576017 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.576243 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.576463 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:14.579211 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.580456 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.581279 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.581534 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.581740 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:14.588876 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.590227 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.590978 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.591159 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.591388 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:14.601339 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.602792 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.603610 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.603814 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.604036 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:14.608146 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.609440 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.610227 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.610421 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.610669 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:14.613991 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.615247 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.616092 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.616299 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.616497 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:14.622699 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.626057 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.626979 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.627168 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.627401 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:14.631628 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.633699 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.634572 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.634809 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.635023 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:14.650619 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.651998 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.652935 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.653126 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.653410 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:14.663596 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.674226 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.675215 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.675451 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.675639 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:14.682315 29888 heartbeater.cc:503] Master 127.27.215.190:44137 was elected leader, sending a full tablet report...
I20240502 01:56:14.683815 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.685220 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.686095 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.686292 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.686511 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:14.695920 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.697449 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.698298 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.698529 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.698725 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:14.713771 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.715085 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.715905 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.716060 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.716281 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:14.728315 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.729665 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.730515 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.730731 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.730947 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:14.736793 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.740420 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.741397 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.741611 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.741859 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:14.745611 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.750201 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.751042 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.751261 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.751456 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:14.755167 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.762462 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.763315 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.763526 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.763737 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:14.767408 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.768749 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.769516 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.769726 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.769942 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:14.786968 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.788331 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.789196 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.789409 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.789646 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:14.797075 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.800022 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.801154 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.801385 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.801592 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:14.816097 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.817384 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.818323 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.818528 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.818739 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:14.842571 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.850184 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.851095 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.851306 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.851527 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:14.854745 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.858187 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.859131 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.859321 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.859560 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:14.874601 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.876159 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.876986 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.877195 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.877429 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:14.893623 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.894973 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.895951 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.896167 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.896597 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:14.898937 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.900777 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.901540 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.901738 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.901940 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:14.904485 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.905814 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.906612 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.906788 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.907001 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:14.916504 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.917950 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.918780 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.919001 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.919200 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:14.921515 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.926038 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.926873 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.927067 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.927287 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:14.929848 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.933702 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.934583 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.934785 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.934984 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:14.943331 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.944998 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.945832 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.946024 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.946265 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:14.960163 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.961402 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.962215 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.962427 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.962657 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:14.966976 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.971760 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.972539 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.972728 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.972947 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:14.992364 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:14.994035 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:14.994917 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:14.995127 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:14.995330 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:15.001967 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:15.003288 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:15.004117 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:15.004284 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:15.004477 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:15.009819 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:15.017242 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:15.018013 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:15.018222 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:15.018419 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:15.023994 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:15.029239 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:15.030295 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:15.030498 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:15.030747 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:15.035626 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:15.043038 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:15.043963 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:15.044198 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:15.044418 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:15.051936 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:15.053316 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:15.054113 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:15.054286 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:15.054474 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:15.059834 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:15.061110 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:15.061889 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:15.062067 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:15.062286 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:15.064471 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:15.065698 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:15.066606 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:15.066792 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:15.067004 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:15.070174 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:15.071615 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:15.072335 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:15.072513 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:15.072695 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:15.076782 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:15.078637 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:15.079459 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:15.079632 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:15.079815 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:15.085995 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:15.087276 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:15.088070 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:15.088253 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:15.088459 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:15.090436 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:15.092041 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:15.092754 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:15.092932 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:15.093140 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:15.101593 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:15.102986 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:15.103852 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:15.104064 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:15.104266 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:15.111917 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:15.119395 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:15.120302 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:15.120493 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:15.120707 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:15.134927 30165 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:15.136241 30165 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:15.137049 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:15.137285 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:15.137504 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:15.139498 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:15.140686 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:15.141402 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:15.141569 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:15.141721 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:15.151811 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:15.153169 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:15.154011 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:15.154184 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:15.154402 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:15.161196 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:15.166301 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:15.167207 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:15.167430 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:15.167654 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:15.170076 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:15.171201 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:15.171870 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:15.172017 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:15.172151 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:15.181937 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:15.183267 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:15.184017 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:15.184165 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:15.184370 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:15.192534 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:15.193790 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:15.194602 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:15.194840 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:15.195039 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:15.205847 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:15.207273 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:15.208122 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:15.208333 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:15.208557 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:15.221294 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:15.222460 30103 tablet_bootstrap.cc:492] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=221 overwritten=0 applied=221 ignored=0} inserts{seen=10950 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:56:15.222617 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:15.223059 30103 tablet_bootstrap.cc:492] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8: Bootstrap complete.
I20240502 01:56:15.223485 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:15.223660 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:15.223875 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:15.224551 30103 ts_tablet_manager.cc:1367] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8: Time spent bootstrapping tablet: real 0.876s user 0.775s sys 0.088s
I20240502 01:56:15.227891 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:15.229108 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:15.229882 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:15.230031 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:15.230266 30212 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:49641: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:15.230113 30103 raft_consensus.cc:348] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a4e2f766b1f420684cafd0aa798e0e8" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 35033 } }
I20240502 01:56:15.231210 30103 raft_consensus.cc:729] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a4e2f766b1f420684cafd0aa798e0e8, State: Initialized, Role: FOLLOWER
I20240502 01:56:15.232012 30103 consensus_queue.cc:260] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 221, Last appended: 2.221, Last appended by leader: 221, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a4e2f766b1f420684cafd0aa798e0e8" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 35033 } }
I20240502 01:56:15.232308 30103 raft_consensus.cc:388] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:15.232456 30103 raft_consensus.cc:482] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:15.232682 30103 raft_consensus.cc:3037] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:56:15.236984 30103 raft_consensus.cc:504] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a4e2f766b1f420684cafd0aa798e0e8" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 35033 } }
I20240502 01:56:15.237609 30103 leader_election.cc:302] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a4e2f766b1f420684cafd0aa798e0e8; no voters:
I20240502 01:56:15.238215 30103 leader_election.cc:288] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [CANDIDATE]: Term 3 election: Requested vote from peers
I20240502 01:56:15.238433 30491 raft_consensus.cc:2781] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [term 3 FOLLOWER]: Leader election won for term 3
I20240502 01:56:15.239470 30250 heartbeater.cc:503] Master 127.27.215.190:44137 was elected leader, sending a full tablet report...
I20240502 01:56:15.239567 30491 raft_consensus.cc:686] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [term 3 LEADER]: Becoming Leader. State: Replica: 5a4e2f766b1f420684cafd0aa798e0e8, State: Running, Role: LEADER
I20240502 01:56:15.240011 29901 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:15.240114 30103 ts_tablet_manager.cc:1398] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8: Time spent starting tablet: real 0.015s user 0.017s sys 0.000s
I20240502 01:56:15.240326 30491 consensus_queue.cc:237] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 221, Committed index: 221, Last appended: 2.221, Last appended by leader: 221, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a4e2f766b1f420684cafd0aa798e0e8" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 35033 } }
I20240502 01:56:15.244521 28911 catalog_manager.cc:5484] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 reported cstate change: term changed from 2 to 3. New cstate: current_term: 3 leader_uuid: "5a4e2f766b1f420684cafd0aa798e0e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a4e2f766b1f420684cafd0aa798e0e8" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 35033 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:15.247279 29901 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:15.248065 30212 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:49641)
I20240502 01:56:15.248294 30212 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:49641: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
I20240502 01:56:15.251302 30212 tablet_copy_source_session.cc:205] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:56:15.256232 29901 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed28938f86c44ee38b42d4c8108d35fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:15.267928 29901 tablet_copy_client.cc:783] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Starting download of 0 data blocks...
I20240502 01:56:15.268308 29901 tablet_copy_client.cc:647] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Starting download of 1 WAL segments...
I20240502 01:56:15.273078 29901 tablet_copy_client.cc:523] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:56:15.276989 29901 tablet_bootstrap.cc:492] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Bootstrap starting.
I20240502 01:56:15.349545 29901 log.cc:824] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Log is configured to *not* fsync() on all Append() calls
I20240502 01:56:15.986697 29901 tablet_bootstrap.cc:492] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Bootstrap replayed 1/1 log segments. Stats: ops{read=222 overwritten=0 applied=222 ignored=0} inserts{seen=10950 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:56:15.987293 29901 tablet_bootstrap.cc:492] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Bootstrap complete.
I20240502 01:56:15.987896 29901 ts_tablet_manager.cc:1367] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Time spent bootstrapping tablet: real 0.711s user 0.642s sys 0.069s
I20240502 01:56:15.993264 29901 raft_consensus.cc:348] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f [term 3 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a4e2f766b1f420684cafd0aa798e0e8" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 35033 } }
I20240502 01:56:15.993664 29901 raft_consensus.cc:729] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f [term 3 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: f991532a36db458dac9ef9190ed6e16f, State: Initialized, Role: NON_PARTICIPANT
I20240502 01:56:15.994278 29901 consensus_queue.cc:260] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 222, Last appended: 3.222, Last appended by leader: 222, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a4e2f766b1f420684cafd0aa798e0e8" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 35033 } }
I20240502 01:56:15.996145 29901 ts_tablet_manager.cc:1398] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Time spent starting tablet: real 0.008s user 0.009s sys 0.000s
I20240502 01:56:15.997152 30212 tablet_copy_service.cc:342] P 5a4e2f766b1f420684cafd0aa798e0e8: Request end of tablet copy session f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa received from {username='slave'} at 127.27.215.130:49641
I20240502 01:56:15.997337 30212 tablet_copy_service.cc:433] P 5a4e2f766b1f420684cafd0aa798e0e8: ending tablet copy session f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa on tablet ed28938f86c44ee38b42d4c8108d35fa with peer f991532a36db458dac9ef9190ed6e16f
W20240502 01:56:16.006492 29901 ts_tablet_manager.cc:701] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Tablet Copy: Invalid argument: Leader has replica of tablet ed28938f86c44ee38b42d4c8108d35fa with term 0, which is lower than last-logged term 3 on local replica. Rejecting tablet copy request
W20240502 01:56:16.042102 29901 ts_tablet_manager.cc:701] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Tablet Copy: Invalid argument: Leader has replica of tablet ed28938f86c44ee38b42d4c8108d35fa with term 0, which is lower than last-logged term 3 on local replica. Rejecting tablet copy request
I20240502 01:56:16.045075 29822 tablet_service.cc:1514] Processing DeleteTablet for tablet ed28938f86c44ee38b42d4c8108d35fa with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:32816
I20240502 01:56:16.045869 30507 tablet_replica.cc:330] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: stopping tablet replica
I20240502 01:56:16.046315 30507 raft_consensus.cc:2229] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f [term 3 NON_PARTICIPANT]: Raft consensus shutting down.
I20240502 01:56:16.046643 30507 raft_consensus.cc:2258] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f [term 3 NON_PARTICIPANT]: Raft consensus is shut down!
I20240502 01:56:16.047911 30507 ts_tablet_manager.cc:1875] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20240502 01:56:16.052670 30507 ts_tablet_manager.cc:1888] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 3.222
I20240502 01:56:16.052840 30507 log.cc:1196] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Deleting WAL directory at /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/wal/wals/ed28938f86c44ee38b42d4c8108d35fa
I20240502 01:56:16.053433 30507 ts_tablet_manager.cc:1909] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Deleting consensus metadata
I20240502 01:56:16.055330 28510 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task7ga2ld/build/asan/bin/kudu pid 29760
I20240502 01:56:16.056514 29882 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 01:56:16.163211 28510 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ga2ld/build/asan/bin/kudu with pid 29760
I20240502 01:56:16.185925 28510 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ga2ld/build/asan/bin/kudu
/tmp/dist-test-task7ga2ld/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.215.130:39541
--local_ip_for_outbound_sockets=127.27.215.130
--tserver_master_addrs=127.27.215.190:44137
--webserver_port=37647
--webserver_interface=127.27.215.130
--builtin_ntp_servers=127.27.215.148:42231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240502 01:56:16.532850 30509 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:56:16.533241 30509 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:56:16.533414 30509 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:56:16.541173 30509 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:56:16.541460 30509 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.215.130
I20240502 01:56:16.550809 30509 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.215.148:42231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.215.130:39541
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.215.130
--webserver_port=37647
--tserver_master_addrs=127.27.215.190:44137
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.215.130
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 02 May 2024 01:43:22 UTC on efd1337a2aa3
build id 83
ASAN enabled
I20240502 01:56:16.552250 30509 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:56:16.554131 30509 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:56:16.566674 30515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:16.566710 30514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:16.566921 30517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:56:16.567287 30509 server_base.cc:1034] running on GCE node
I20240502 01:56:16.568164 30509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:56:16.569165 30509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:56:16.570473 30509 hybrid_clock.cc:648] HybridClock initialized: now 1714614976570375 us; error 58 us; skew 500 ppm
I20240502 01:56:16.570822 30509 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:56:16.573287 30509 webserver.cc:460] Webserver started at http://127.27.215.130:37647/ using document root <none> and password file <none>
I20240502 01:56:16.574083 30509 fs_manager.cc:359] Metadata directory not provided
I20240502 01:56:16.574230 30509 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:56:16.579905 30509 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20240502 01:56:16.583087 30523 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:16.584875 30509 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20240502 01:56:16.585070 30509 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/wal
uuid: "f991532a36db458dac9ef9190ed6e16f"
format_stamp: "Formatted at 2024-05-02 01:56:07 on dist-test-slave-v8sz"
I20240502 01:56:16.586061 30509 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:56:16.612653 30509 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:56:16.613649 30509 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:56:16.613946 30509 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:56:16.615000 30509 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:56:16.616631 30509 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:56:16.616739 30509 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:16.616864 30509 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:56:16.616942 30509 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:16.654732 30509 rpc_server.cc:307] RPC server started. Bound to: 127.27.215.130:39541
I20240502 01:56:16.654791 30635 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.215.130:39541 every 8 connection(s)
I20240502 01:56:16.656327 30509 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data/info.pb
I20240502 01:56:16.666635 28510 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ga2ld/build/asan/bin/kudu as pid 30509
I20240502 01:56:16.666894 28510 tablet_copy_client_session-itest.cc:139] Starting loop 2
I20240502 01:56:16.667012 28510 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task7ga2ld/build/asan/bin/kudu pid 29900
I20240502 01:56:16.673343 30636 heartbeater.cc:347] Connected to a master server at 127.27.215.190:44137
I20240502 01:56:16.673738 30636 heartbeater.cc:464] Registering TS with master...
I20240502 01:56:16.674886 30636 heartbeater.cc:511] Master 127.27.215.190:44137 requested a full tablet report, sending...
I20240502 01:56:16.676882 28911 ts_manager.cc:194] Re-registered known tserver with Master: f991532a36db458dac9ef9190ed6e16f (127.27.215.130:39541)
I20240502 01:56:16.677982 28911 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.215.130:39989
I20240502 01:56:16.678138 30243 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 01:56:16.789703 28510 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ga2ld/build/asan/bin/kudu with pid 29900
I20240502 01:56:16.812750 28510 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ga2ld/build/asan/bin/kudu
/tmp/dist-test-task7ga2ld/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.215.129:35033
--local_ip_for_outbound_sockets=127.27.215.129
--tserver_master_addrs=127.27.215.190:44137
--webserver_port=33843
--webserver_interface=127.27.215.129
--builtin_ntp_servers=127.27.215.148:42231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240502 01:56:16.837195 30651 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:16.843734 30651 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:16.864912 30651 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:16.866343 30651 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:16.868992 30650 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:16.870817 30650 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:16.875586 30650 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:16.876794 30650 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:16.886085 30650 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:16.887557 30650 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:16.898049 30650 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:16.899556 30650 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:16.903136 30650 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:16.907969 30650 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:16.914765 30650 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:16.917157 30650 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:16.920154 30650 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:16.921401 30650 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:16.934861 30650 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:16.936205 30650 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:16.947305 30650 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:16.948593 30650 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:16.958324 30650 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:16.959669 30650 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:16.962402 30650 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:16.963739 30650 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:16.965948 30650 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:16.967103 30650 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:16.979969 30650 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:16.981379 30650 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:16.988602 30650 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:16.989965 30650 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:16.998298 30650 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.005198 30650 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.010847 30650 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.012187 30650 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.019464 30650 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.021752 30650 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.038739 30650 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.040114 30650 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.047084 30650 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.048352 30650 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.064288 30650 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.065693 30650 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.068153 30650 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.069449 30650 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.077142 30650 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.078610 30650 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.083570 30650 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.086103 30650 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.096733 30650 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.098038 30650 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.114841 30650 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.116253 30650 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.122143 30650 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.129835 30650 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.144959 30650 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.146301 30650 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.153518 30650 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.155078 30650 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.164858 30650 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.169371 30650 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.180961 30650 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.182238 30650 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.186992 30650 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.188220 30650 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.190068 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.198163 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.204501 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
W20240502 01:56:17.208302 30648 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:56:17.208658 30648 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:56:17.208810 30648 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20240502 01:56:17.212102 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
W20240502 01:56:17.217891 30648 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:56:17.218122 30648 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.215.129
I20240502 01:56:17.220278 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.225899 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.229265 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.229233 30648 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.215.148:42231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.215.129:35033
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.215.129
--webserver_port=33843
--tserver_master_addrs=127.27.215.190:44137
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.215.129
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 02 May 2024 01:43:22 UTC on efd1337a2aa3
build id 83
ASAN enabled
I20240502 01:56:17.230432 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.231104 30648 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:56:17.232755 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.233501 30648 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20240502 01:56:17.240367 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
W20240502 01:56:17.249703 30810 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:17.249811 30812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:17.249815 30809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:56:17.250823 30648 server_base.cc:1034] running on GCE node
I20240502 01:56:17.251204 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.251624 30648 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:56:17.252439 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.252858 30648 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:56:17.254351 30648 hybrid_clock.cc:648] HybridClock initialized: now 1714614977254224 us; error 109 us; skew 500 ppm
I20240502 01:56:17.254693 30648 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:56:17.257470 30648 webserver.cc:460] Webserver started at http://127.27.215.129:33843/ using document root <none> and password file <none>
I20240502 01:56:17.258340 30648 fs_manager.cc:359] Metadata directory not provided
I20240502 01:56:17.258495 30648 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:56:17.259629 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.260809 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.265170 30648 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20240502 01:56:17.268656 30826 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:17.270309 30648 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240502 01:56:17.270476 30648 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/wal
uuid: "5a4e2f766b1f420684cafd0aa798e0e8"
format_stamp: "Formatted at 2024-05-02 01:56:07 on dist-test-slave-v8sz"
I20240502 01:56:17.271415 30648 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:56:17.275732 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.277002 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.280408 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.282717 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.310325 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.311564 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.314385 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.315491 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.316630 30648 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:56:17.317863 30648 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:56:17.318194 30648 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:56:17.319312 30648 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:56:17.319931 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.325860 30851 ts_tablet_manager.cc:522] Loading tablet metadata (0/1 complete)
I20240502 01:56:17.326962 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.332742 30648 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240502 01:56:17.332890 30648 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.012s user 0.002s sys 0.003s
I20240502 01:56:17.333027 30648 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240502 01:56:17.335436 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.336445 30648 ts_tablet_manager.cc:590] Registered 1 tablets
I20240502 01:56:17.336570 30648 ts_tablet_manager.cc:569] Time spent register tablets: real 0.004s user 0.001s sys 0.000s
I20240502 01:56:17.336957 30851 tablet_bootstrap.cc:492] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8: Bootstrap starting.
I20240502 01:56:17.336957 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.354617 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.358515 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.369879 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.372807 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.385030 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.388259 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.399581 30648 rpc_server.cc:307] RPC server started. Bound to: 127.27.215.129:35033
I20240502 01:56:17.399595 30975 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.215.129:35033 every 8 connection(s)
I20240502 01:56:17.401834 30648 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-0/data/info.pb
I20240502 01:56:17.402259 28510 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ga2ld/build/asan/bin/kudu as pid 30648
I20240502 01:56:17.403190 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.425832 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.440176 30976 heartbeater.cc:347] Connected to a master server at 127.27.215.190:44137
I20240502 01:56:17.440562 30976 heartbeater.cc:464] Registering TS with master...
I20240502 01:56:17.441605 30976 heartbeater.cc:511] Master 127.27.215.190:44137 requested a full tablet report, sending...
I20240502 01:56:17.444166 28911 ts_manager.cc:194] Re-registered known tserver with Master: 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.445585 28911 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.215.129:43665
I20240502 01:56:17.452191 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.452595 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.454351 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.471175 30851 log.cc:824] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8: Log is configured to *not* fsync() on all Append() calls
I20240502 01:56:17.472544 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.474426 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.475198 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.475384 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.475593 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.492422 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.493757 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.494590 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.494776 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.495010 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.503304 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.504575 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.505342 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.505565 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.505743 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.525051 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.526427 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.527328 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.527545 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.527757 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.546911 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.548311 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.549005 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.549197 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.549456 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.565122 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.566426 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.567152 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.567327 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.567565 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.569578 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.570955 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.571570 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.571727 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.571897 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.574398 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.577649 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.578403 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.578604 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.578824 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.581830 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.582974 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.583724 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.583909 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.584108 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.592370 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.593585 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.594410 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.594600 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.594823 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.597292 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.604655 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.605523 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.605746 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.605967 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.611948 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.618189 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.619194 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.619385 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.619632 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.622031 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.623258 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.623971 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.624161 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.624362 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.630864 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.638345 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.639211 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.639415 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.639652 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.643267 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.644536 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.645256 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.645480 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.645745 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.652218 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.656407 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.657261 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.657491 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.657707 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.672775 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.674311 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.675114 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.675354 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.675570 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.681718 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.682099 30636 heartbeater.cc:503] Master 127.27.215.190:44137 was elected leader, sending a full tablet report...
I20240502 01:56:17.684271 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.685065 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.685294 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.685550 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.690996 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.692369 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.693673 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.693898 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.694159 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.696786 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.698463 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.699440 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.699610 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.699836 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.704805 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.706051 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.706861 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.707037 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.707218 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.709106 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.710245 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.711171 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.711341 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.711580 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.716423 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.717655 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.718557 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.718758 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.718950 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.734953 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.736142 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.737023 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.737241 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.737488 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.751546 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.752781 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.753726 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.753927 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.754102 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.767601 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.769330 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.770119 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.770305 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.770545 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.781961 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.783288 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.784124 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.784335 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.784559 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.798810 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.800236 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.801118 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.801306 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.801587 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.803169 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.804430 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.805205 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.805420 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.805639 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.815447 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.816671 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.817541 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.817716 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.817929 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.831141 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.832332 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.833120 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.833314 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.833549 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.839900 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.841269 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.842051 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.842216 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.842406 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.844221 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.851522 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.852428 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.852634 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.852826 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.861850 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.863221 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.864117 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.864334 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.864557 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.866771 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.874526 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.875396 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.875586 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.875778 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.889962 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.891495 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.892382 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.892541 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.892750 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.898826 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.901432 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.902292 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.902467 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.902667 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.910801 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.914016 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.914779 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.914952 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.915148 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.928048 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.929386 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.930167 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.930356 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.930550 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.946485 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.948251 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.948969 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.949149 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.949380 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.956532 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.958020 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.958959 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.959182 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.959376 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.965759 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.967057 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.967886 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.968045 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.968243 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.971771 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.973089 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.973901 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.974134 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.974359 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:17.996631 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:17.998302 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:17.999135 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:17.999339 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:17.999544 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:18.004202 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:18.005653 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:18.006420 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:18.006628 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:18.006834 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:18.017441 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:18.018976 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:18.019771 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:18.019966 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:18.020295 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:18.023519 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:18.024761 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:18.025461 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:18.025627 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:18.025825 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:18.027866 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:18.028970 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:18.029753 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:18.029925 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:18.030138 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:18.046717 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:18.048053 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:18.048893 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:18.049113 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:18.049329 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:18.058032 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:18.062244 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:18.063158 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:18.063362 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:18.063585 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:18.068507 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:18.074170 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:18.075029 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:18.075256 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:18.075469 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:18.084897 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:18.086248 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:18.087021 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:18.087205 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:18.087405 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:18.091748 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:18.098228 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:18.099170 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:18.099426 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:18.099648 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:18.103199 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:18.106174 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:18.107010 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:18.107192 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:18.107400 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:18.114377 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:18.118656 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:18.119518 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:18.119750 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:18.119956 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:18.127900 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:18.132831 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:18.133755 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:18.133982 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:18.134196 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:18.143743 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:18.145040 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:18.145836 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:18.146046 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:18.146263 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:18.148303 31187 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:18.166426 31187 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:18.167309 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:18.167506 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:18.167722 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:18.170902 31187 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:18.174127 31187 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:18.174932 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:18.175129 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:18.175328 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:18.191952 31187 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:18.197101 31187 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:18.198102 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:18.198292 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:18.198511 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:18.207801 31187 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:18.209159 31187 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:18.210003 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:18.210232 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:18.210426 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:18.216548 31187 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:18.230886 31187 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:18.231762 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:18.231946 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:18.232241 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:18.239032 31187 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:18.240397 31187 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:18.241154 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:18.241477 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:18.241695 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:18.246556 30851 tablet_bootstrap.cc:492] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=222 overwritten=0 applied=222 ignored=0} inserts{seen=10950 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:56:18.247381 30851 tablet_bootstrap.cc:492] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8: Bootstrap complete.
I20240502 01:56:18.248562 31187 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:18.249274 30851 ts_tablet_manager.cc:1367] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8: Time spent bootstrapping tablet: real 0.913s user 0.828s sys 0.068s
I20240502 01:56:18.258365 31187 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:18.259258 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:18.259469 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
I20240502 01:56:18.258229 30851 raft_consensus.cc:348] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a4e2f766b1f420684cafd0aa798e0e8" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 35033 } }
W20240502 01:56:18.259763 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:18.259837 30851 raft_consensus.cc:729] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a4e2f766b1f420684cafd0aa798e0e8, State: Initialized, Role: FOLLOWER
I20240502 01:56:18.260771 30851 consensus_queue.cc:260] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 222, Last appended: 3.222, Last appended by leader: 222, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a4e2f766b1f420684cafd0aa798e0e8" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 35033 } }
I20240502 01:56:18.261121 30851 raft_consensus.cc:388] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [term 3 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:18.261267 30851 raft_consensus.cc:482] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [term 3 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:18.261531 30851 raft_consensus.cc:3037] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [term 3 FOLLOWER]: Advancing to term 4
I20240502 01:56:18.262960 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:18.268406 30851 raft_consensus.cc:504] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a4e2f766b1f420684cafd0aa798e0e8" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 35033 } }
I20240502 01:56:18.269218 30851 leader_election.cc:302] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a4e2f766b1f420684cafd0aa798e0e8; no voters:
I20240502 01:56:18.269922 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:18.270092 30851 leader_election.cc:288] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [CANDIDATE]: Term 4 election: Requested vote from peers
I20240502 01:56:18.270473 31248 raft_consensus.cc:2781] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [term 4 FOLLOWER]: Leader election won for term 4
I20240502 01:56:18.271005 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:18.271286 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
W20240502 01:56:18.271569 30946 tablet_copy_service.cc:478] P 5a4e2f766b1f420684cafd0aa798e0e8: Error handling TabletCopyService RPC request from {username='slave'} at 127.27.215.130:35297: Error beginning tablet copy session for tablet ed28938f86c44ee38b42d4c8108d35fa: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 01:56:18.281610 30976 heartbeater.cc:503] Master 127.27.215.190:44137 was elected leader, sending a full tablet report...
I20240502 01:56:18.281692 31248 raft_consensus.cc:686] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [term 4 LEADER]: Becoming Leader. State: Replica: 5a4e2f766b1f420684cafd0aa798e0e8, State: Running, Role: LEADER
I20240502 01:56:18.282896 30649 ts_tablet_manager.cc:902] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Initiating tablet copy from peer 5a4e2f766b1f420684cafd0aa798e0e8 (127.27.215.129:35033)
I20240502 01:56:18.287050 30851 ts_tablet_manager.cc:1398] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8: Time spent starting tablet: real 0.038s user 0.028s sys 0.008s
I20240502 01:56:18.282557 31248 consensus_queue.cc:237] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 222, Committed index: 222, Last appended: 3.222, Last appended by leader: 222, Current term: 4, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a4e2f766b1f420684cafd0aa798e0e8" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 35033 } }
I20240502 01:56:18.298666 28911 catalog_manager.cc:5484] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8 reported cstate change: term changed from 3 to 4. New cstate: current_term: 4 leader_uuid: "5a4e2f766b1f420684cafd0aa798e0e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a4e2f766b1f420684cafd0aa798e0e8" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 35033 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:18.302273 30649 tablet_copy_client.cc:308] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:35033
I20240502 01:56:18.304220 30946 tablet_copy_service.cc:140] P 5a4e2f766b1f420684cafd0aa798e0e8: Received BeginTabletCopySession request for tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f ({username='slave'} at 127.27.215.130:35297)
I20240502 01:56:18.304451 30946 tablet_copy_service.cc:161] P 5a4e2f766b1f420684cafd0aa798e0e8: Beginning new tablet copy session on tablet ed28938f86c44ee38b42d4c8108d35fa from peer f991532a36db458dac9ef9190ed6e16f at {username='slave'} at 127.27.215.130:35297: session id = f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa
I20240502 01:56:18.308079 30946 tablet_copy_source_session.cc:205] T ed28938f86c44ee38b42d4c8108d35fa P 5a4e2f766b1f420684cafd0aa798e0e8: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:56:18.314886 30649 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed28938f86c44ee38b42d4c8108d35fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:18.332803 30649 tablet_copy_client.cc:783] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Starting download of 0 data blocks...
I20240502 01:56:18.333225 30649 tablet_copy_client.cc:647] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Starting download of 1 WAL segments...
I20240502 01:56:18.338402 30649 tablet_copy_client.cc:523] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:56:18.342710 30649 tablet_bootstrap.cc:492] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Bootstrap starting.
I20240502 01:56:18.415243 30649 log.cc:824] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Log is configured to *not* fsync() on all Append() calls
I20240502 01:56:19.026753 30649 tablet_bootstrap.cc:492] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Bootstrap replayed 1/1 log segments. Stats: ops{read=223 overwritten=0 applied=223 ignored=0} inserts{seen=10950 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:56:19.027299 30649 tablet_bootstrap.cc:492] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Bootstrap complete.
I20240502 01:56:19.027848 30649 ts_tablet_manager.cc:1367] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Time spent bootstrapping tablet: real 0.685s user 0.615s sys 0.068s
I20240502 01:56:19.033712 30649 raft_consensus.cc:348] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f [term 4 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a4e2f766b1f420684cafd0aa798e0e8" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 35033 } }
I20240502 01:56:19.034197 30649 raft_consensus.cc:729] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f [term 4 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: f991532a36db458dac9ef9190ed6e16f, State: Initialized, Role: NON_PARTICIPANT
I20240502 01:56:19.034732 30649 consensus_queue.cc:260] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 223, Last appended: 4.223, Last appended by leader: 223, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a4e2f766b1f420684cafd0aa798e0e8" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 35033 } }
I20240502 01:56:19.036451 30649 ts_tablet_manager.cc:1398] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Time spent starting tablet: real 0.008s user 0.010s sys 0.000s
I20240502 01:56:19.037423 30946 tablet_copy_service.cc:342] P 5a4e2f766b1f420684cafd0aa798e0e8: Request end of tablet copy session f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa received from {username='slave'} at 127.27.215.130:35297
I20240502 01:56:19.037586 30946 tablet_copy_service.cc:433] P 5a4e2f766b1f420684cafd0aa798e0e8: ending tablet copy session f991532a36db458dac9ef9190ed6e16f-ed28938f86c44ee38b42d4c8108d35fa on tablet ed28938f86c44ee38b42d4c8108d35fa with peer f991532a36db458dac9ef9190ed6e16f
W20240502 01:56:19.056499 30649 ts_tablet_manager.cc:701] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Tablet Copy: Invalid argument: Leader has replica of tablet ed28938f86c44ee38b42d4c8108d35fa with term 0, which is lower than last-logged term 4 on local replica. Rejecting tablet copy request
W20240502 01:56:19.073006 30649 ts_tablet_manager.cc:701] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Tablet Copy: Invalid argument: Leader has replica of tablet ed28938f86c44ee38b42d4c8108d35fa with term 0, which is lower than last-logged term 4 on local replica. Rejecting tablet copy request
W20240502 01:56:19.082475 30649 ts_tablet_manager.cc:701] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Tablet Copy: Invalid argument: Leader has replica of tablet ed28938f86c44ee38b42d4c8108d35fa with term 0, which is lower than last-logged term 4 on local replica. Rejecting tablet copy request
I20240502 01:56:19.085829 30571 tablet_service.cc:1514] Processing DeleteTablet for tablet ed28938f86c44ee38b42d4c8108d35fa with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:60436
I20240502 01:56:19.086673 31263 tablet_replica.cc:330] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: stopping tablet replica
I20240502 01:56:19.087080 31263 raft_consensus.cc:2229] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f [term 4 NON_PARTICIPANT]: Raft consensus shutting down.
I20240502 01:56:19.087390 31263 raft_consensus.cc:2258] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f [term 4 NON_PARTICIPANT]: Raft consensus is shut down!
I20240502 01:56:19.088635 31263 ts_tablet_manager.cc:1875] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20240502 01:56:19.093658 31263 ts_tablet_manager.cc:1888] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 4.223
I20240502 01:56:19.093818 31263 log.cc:1196] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Deleting WAL directory at /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/wal/wals/ed28938f86c44ee38b42d4c8108d35fa
I20240502 01:56:19.094310 31263 ts_tablet_manager.cc:1909] T ed28938f86c44ee38b42d4c8108d35fa P f991532a36db458dac9ef9190ed6e16f: Deleting consensus metadata
I20240502 01:56:19.096143 28510 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task7ga2ld/build/asan/bin/kudu pid 30509
I20240502 01:56:19.097213 30631 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 01:56:19.205104 28510 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ga2ld/build/asan/bin/kudu with pid 30509
I20240502 01:56:19.227874 28510 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ga2ld/build/asan/bin/kudu
/tmp/dist-test-task7ga2ld/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.215.130:39541
--local_ip_for_outbound_sockets=127.27.215.130
--tserver_master_addrs=127.27.215.190:44137
--webserver_port=37647
--webserver_interface=127.27.215.130
--builtin_ntp_servers=127.27.215.148:42231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240502 01:56:19.577939 31265 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:56:19.578282 31265 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:56:19.578435 31265 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:56:19.586261 31265 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:56:19.586515 31265 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.215.130
I20240502 01:56:19.596103 31265 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.215.148:42231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.215.130:39541
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.215.130
--webserver_port=37647
--tserver_master_addrs=127.27.215.190:44137
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.215.130
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 02 May 2024 01:43:22 UTC on efd1337a2aa3
build id 83
ASAN enabled
I20240502 01:56:19.597615 31265 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:56:19.599438 31265 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:56:19.611899 31273 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:19.611968 31271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:19.611941 31270 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:56:19.613040 31265 server_base.cc:1034] running on GCE node
I20240502 01:56:19.613767 31265 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:56:19.614866 31265 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:56:19.616138 31265 hybrid_clock.cc:648] HybridClock initialized: now 1714614979616025 us; error 79 us; skew 500 ppm
I20240502 01:56:19.616523 31265 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:56:19.625061 31265 webserver.cc:460] Webserver started at http://127.27.215.130:37647/ using document root <none> and password file <none>
I20240502 01:56:19.625998 31265 fs_manager.cc:359] Metadata directory not provided
I20240502 01:56:19.626135 31265 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:56:19.632172 31265 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20240502 01:56:19.635501 31279 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:19.637053 31265 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20240502 01:56:19.637224 31265 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/wal
uuid: "f991532a36db458dac9ef9190ed6e16f"
format_stamp: "Formatted at 2024-05-02 01:56:07 on dist-test-slave-v8sz"
I20240502 01:56:19.638198 31265 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:56:19.664664 31265 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:56:19.665688 31265 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:56:19.666002 31265 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:56:19.667083 31265 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:56:19.668922 31265 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:56:19.669021 31265 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:19.669147 31265 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:56:19.669220 31265 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:19.706236 31265 rpc_server.cc:307] RPC server started. Bound to: 127.27.215.130:39541
I20240502 01:56:19.706312 31391 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.215.130:39541 every 8 connection(s)
I20240502 01:56:19.707860 31265 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714614966221093-28510-0/minicluster-data/ts-1/data/info.pb
I20240502 01:56:19.709872 28510 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ga2ld/build/asan/bin/kudu as pid 31265
I20240502 01:56:19.710389 28510 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task7ga2ld/build/asan/bin/kudu pid 30648
I20240502 01:56:19.719460 30971 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 01:56:19.723989 31392 heartbeater.cc:347] Connected to a master server at 127.27.215.190:44137
I20240502 01:56:19.724332 31392 heartbeater.cc:464] Registering TS with master...
I20240502 01:56:19.725266 31392 heartbeater.cc:511] Master 127.27.215.190:44137 requested a full tablet report, sending...
I20240502 01:56:19.726982 28911 ts_manager.cc:194] Re-registered known tserver with Master: f991532a36db458dac9ef9190ed6e16f (127.27.215.130:39541)
I20240502 01:56:19.728150 28911 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.215.130:34057
I20240502 01:56:19.822306 28510 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ga2ld/build/asan/bin/kudu with pid 30648
I20240502 01:56:19.843559 28510 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task7ga2ld/build/asan/bin/kudu pid 31265
I20240502 01:56:19.852550 31387 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 01:56:19.935473 28510 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ga2ld/build/asan/bin/kudu with pid 31265
I20240502 01:56:19.953440 28510 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task7ga2ld/build/asan/bin/kudu pid 28881
I20240502 01:56:19.954749 28943 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 01:56:20.061082 28510 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ga2ld/build/asan/bin/kudu with pid 28881
2024-05-02T01:56:20Z chronyd exiting
[ OK ] TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping (13807 ms)
[ RUN ] TabletCopyClientSessionITest.TestStartTabletCopy
2024-05-02T01:56:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-02T01:56:20Z Disabled control of system clock
I20240502 01:56:20.134827 28510 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ga2ld/build/asan/bin/kudu
/tmp/dist-test-task7ga2ld/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.215.190:39475
--webserver_interface=127.27.215.190
--webserver_port=0
--builtin_ntp_servers=127.27.215.148:45729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.215.190:39475
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240502 01:56:20.480867 31406 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:56:20.481213 31406 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:56:20.481328 31406 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:56:20.489203 31406 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 01:56:20.489337 31406 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:56:20.489436 31406 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 01:56:20.489526 31406 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 01:56:20.499146 31406 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.215.148:45729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.27.215.190:39475
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.215.190:39475
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.215.190
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 02 May 2024 01:43:22 UTC on efd1337a2aa3
build id 83
ASAN enabled
I20240502 01:56:20.500579 31406 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:56:20.502439 31406 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:56:20.513408 31414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:20.513479 31412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:20.513509 31411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:56:20.514554 31406 server_base.cc:1034] running on GCE node
I20240502 01:56:20.515452 31406 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:56:20.517026 31406 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:56:20.518299 31406 hybrid_clock.cc:648] HybridClock initialized: now 1714614980518213 us; error 55 us; skew 500 ppm
I20240502 01:56:20.518643 31406 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:56:20.521000 31406 webserver.cc:460] Webserver started at http://127.27.215.190:43331/ using document root <none> and password file <none>
I20240502 01:56:20.521781 31406 fs_manager.cc:359] Metadata directory not provided
I20240502 01:56:20.521924 31406 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:56:20.522254 31406 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:56:20.525007 31406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/master-0/data/instance:
uuid: "7400a60d31b6493bb6502b44632fcfcf"
format_stamp: "Formatted at 2024-05-02 01:56:20 on dist-test-slave-v8sz"
I20240502 01:56:20.525849 31406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/master-0/wal/instance:
uuid: "7400a60d31b6493bb6502b44632fcfcf"
format_stamp: "Formatted at 2024-05-02 01:56:20 on dist-test-slave-v8sz"
I20240502 01:56:20.531359 31406 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20240502 01:56:20.535085 31420 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:20.536566 31406 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20240502 01:56:20.536763 31406 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/master-0/data,/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/master-0/wal
uuid: "7400a60d31b6493bb6502b44632fcfcf"
format_stamp: "Formatted at 2024-05-02 01:56:20 on dist-test-slave-v8sz"
I20240502 01:56:20.536962 31406 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:56:20.562834 31406 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:56:20.563767 31406 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:56:20.564087 31406 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:56:20.583257 31406 rpc_server.cc:307] RPC server started. Bound to: 127.27.215.190:39475
I20240502 01:56:20.583276 31471 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.215.190:39475 every 8 connection(s)
I20240502 01:56:20.584743 31406 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/master-0/data/info.pb
I20240502 01:56:20.586081 28510 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ga2ld/build/asan/bin/kudu as pid 31406
I20240502 01:56:20.586373 28510 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/master-0/wal/instance
I20240502 01:56:20.590031 31472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:20.602504 31472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf: Bootstrap starting.
I20240502 01:56:20.605799 31472 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf: Neither blocks nor log segments found. Creating new log.
I20240502 01:56:20.606985 31472 log.cc:824] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf: Log is configured to *not* fsync() on all Append() calls
I20240502 01:56:20.609845 31472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf: No bootstrap required, opened a new log
I20240502 01:56:20.616526 31472 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7400a60d31b6493bb6502b44632fcfcf" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 39475 } }
I20240502 01:56:20.616945 31472 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:56:20.617056 31472 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7400a60d31b6493bb6502b44632fcfcf, State: Initialized, Role: FOLLOWER
I20240502 01:56:20.617790 31472 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7400a60d31b6493bb6502b44632fcfcf" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 39475 } }
I20240502 01:56:20.618032 31472 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:20.618166 31472 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:20.618431 31472 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:56:20.620791 31472 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7400a60d31b6493bb6502b44632fcfcf" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 39475 } }
I20240502 01:56:20.621425 31472 leader_election.cc:302] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7400a60d31b6493bb6502b44632fcfcf; no voters:
I20240502 01:56:20.622084 31472 leader_election.cc:288] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:56:20.622233 31477 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:56:20.623107 31477 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf [term 1 LEADER]: Becoming Leader. State: Replica: 7400a60d31b6493bb6502b44632fcfcf, State: Running, Role: LEADER
I20240502 01:56:20.623718 31477 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7400a60d31b6493bb6502b44632fcfcf" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 39475 } }
I20240502 01:56:20.624457 31472 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf [sys.catalog]: configured and running, proceeding with master startup.
I20240502 01:56:20.626888 31478 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7400a60d31b6493bb6502b44632fcfcf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7400a60d31b6493bb6502b44632fcfcf" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 39475 } } }
I20240502 01:56:20.626837 31479 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7400a60d31b6493bb6502b44632fcfcf. Latest consensus state: current_term: 1 leader_uuid: "7400a60d31b6493bb6502b44632fcfcf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7400a60d31b6493bb6502b44632fcfcf" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 39475 } } }
I20240502 01:56:20.627369 31478 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf [sys.catalog]: This master's current role is: LEADER
I20240502 01:56:20.627524 31479 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf [sys.catalog]: This master's current role is: LEADER
I20240502 01:56:20.629237 31485 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 01:56:20.634330 31485 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 01:56:20.644668 31485 catalog_manager.cc:1347] Generated new cluster ID: b16638c2f4024afb87f1b12586c74824
I20240502 01:56:20.644815 31485 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 01:56:20.692826 31485 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 01:56:20.694175 31485 catalog_manager.cc:1504] Loading token signing keys...
I20240502 01:56:20.709164 31485 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf: Generated new TSK 0
I20240502 01:56:20.710091 31485 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 01:56:20.723058 28510 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ga2ld/build/asan/bin/kudu
/tmp/dist-test-task7ga2ld/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.215.129:0
--local_ip_for_outbound_sockets=127.27.215.129
--webserver_interface=127.27.215.129
--webserver_port=0
--tserver_master_addrs=127.27.215.190:39475
--builtin_ntp_servers=127.27.215.148:45729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240502 01:56:21.072801 31496 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:56:21.073127 31496 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:56:21.073225 31496 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:56:21.080883 31496 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:56:21.081090 31496 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.215.129
I20240502 01:56:21.090432 31496 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.215.148:45729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.215.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.215.129
--webserver_port=0
--tserver_master_addrs=127.27.215.190:39475
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.215.129
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 02 May 2024 01:43:22 UTC on efd1337a2aa3
build id 83
ASAN enabled
I20240502 01:56:21.091825 31496 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:56:21.093739 31496 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:56:21.106395 31502 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:21.106509 31501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:21.106359 31504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:56:21.107779 31496 server_base.cc:1034] running on GCE node
I20240502 01:56:21.108482 31496 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:56:21.109618 31496 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:56:21.110906 31496 hybrid_clock.cc:648] HybridClock initialized: now 1714614981110820 us; error 70 us; skew 500 ppm
I20240502 01:56:21.111258 31496 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:56:21.113967 31496 webserver.cc:460] Webserver started at http://127.27.215.129:44125/ using document root <none> and password file <none>
I20240502 01:56:21.114799 31496 fs_manager.cc:359] Metadata directory not provided
I20240502 01:56:21.114930 31496 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:56:21.115269 31496 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:56:21.118359 31496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-0/data/instance:
uuid: "29ab036dcfee4271b1831c55b6e0c910"
format_stamp: "Formatted at 2024-05-02 01:56:21 on dist-test-slave-v8sz"
I20240502 01:56:21.119227 31496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-0/wal/instance:
uuid: "29ab036dcfee4271b1831c55b6e0c910"
format_stamp: "Formatted at 2024-05-02 01:56:21 on dist-test-slave-v8sz"
I20240502 01:56:21.125528 31496 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20240502 01:56:21.129920 31510 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:21.131563 31496 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20240502 01:56:21.131762 31496 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-0/wal
uuid: "29ab036dcfee4271b1831c55b6e0c910"
format_stamp: "Formatted at 2024-05-02 01:56:21 on dist-test-slave-v8sz"
I20240502 01:56:21.131964 31496 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:56:21.153406 31496 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:56:21.154346 31496 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:56:21.154664 31496 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:56:21.155853 31496 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:56:21.157555 31496 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:56:21.157634 31496 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:21.157771 31496 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:56:21.157828 31496 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:21.192114 31496 rpc_server.cc:307] RPC server started. Bound to: 127.27.215.129:46783
I20240502 01:56:21.192181 31623 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.215.129:46783 every 8 connection(s)
I20240502 01:56:21.193512 31496 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-0/data/info.pb
I20240502 01:56:21.194720 28510 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ga2ld/build/asan/bin/kudu as pid 31496
I20240502 01:56:21.194958 28510 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-0/wal/instance
I20240502 01:56:21.198956 28510 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ga2ld/build/asan/bin/kudu
/tmp/dist-test-task7ga2ld/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.215.130:0
--local_ip_for_outbound_sockets=127.27.215.130
--webserver_interface=127.27.215.130
--webserver_port=0
--tserver_master_addrs=127.27.215.190:39475
--builtin_ntp_servers=127.27.215.148:45729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240502 01:56:21.208148 31624 heartbeater.cc:347] Connected to a master server at 127.27.215.190:39475
I20240502 01:56:21.208601 31624 heartbeater.cc:464] Registering TS with master...
I20240502 01:56:21.209764 31624 heartbeater.cc:511] Master 127.27.215.190:39475 requested a full tablet report, sending...
I20240502 01:56:21.212265 31437 ts_manager.cc:194] Registered new tserver with Master: 29ab036dcfee4271b1831c55b6e0c910 (127.27.215.129:46783)
I20240502 01:56:21.213927 31437 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.215.129:48567
W20240502 01:56:21.548827 31628 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:56:21.549266 31628 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:56:21.549453 31628 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:56:21.557159 31628 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:56:21.557397 31628 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.215.130
I20240502 01:56:21.566794 31628 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.215.148:45729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.215.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.215.130
--webserver_port=0
--tserver_master_addrs=127.27.215.190:39475
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.215.130
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 02 May 2024 01:43:22 UTC on efd1337a2aa3
build id 83
ASAN enabled
I20240502 01:56:21.568181 31628 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:56:21.570168 31628 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:56:21.582376 31634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:21.582420 31633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:21.582607 31636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:56:21.583818 31628 server_base.cc:1034] running on GCE node
I20240502 01:56:21.584497 31628 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:56:21.585590 31628 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:56:21.586848 31628 hybrid_clock.cc:648] HybridClock initialized: now 1714614981586781 us; error 40 us; skew 500 ppm
I20240502 01:56:21.587193 31628 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:56:21.589854 31628 webserver.cc:460] Webserver started at http://127.27.215.130:32881/ using document root <none> and password file <none>
I20240502 01:56:21.590613 31628 fs_manager.cc:359] Metadata directory not provided
I20240502 01:56:21.590735 31628 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:56:21.591053 31628 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:56:21.593863 31628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-1/data/instance:
uuid: "4ce6ffed32c141fdb868e9d2bcf415de"
format_stamp: "Formatted at 2024-05-02 01:56:21 on dist-test-slave-v8sz"
I20240502 01:56:21.594664 31628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-1/wal/instance:
uuid: "4ce6ffed32c141fdb868e9d2bcf415de"
format_stamp: "Formatted at 2024-05-02 01:56:21 on dist-test-slave-v8sz"
I20240502 01:56:21.600385 31628 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20240502 01:56:21.604310 31642 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:21.605985 31628 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240502 01:56:21.606184 31628 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-1/wal
uuid: "4ce6ffed32c141fdb868e9d2bcf415de"
format_stamp: "Formatted at 2024-05-02 01:56:21 on dist-test-slave-v8sz"
I20240502 01:56:21.606395 31628 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:56:21.648181 31628 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:56:21.649099 31628 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:56:21.649443 31628 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:56:21.650549 31628 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:56:21.652199 31628 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:56:21.652294 31628 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:21.652438 31628 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:56:21.652503 31628 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:21.687005 31628 rpc_server.cc:307] RPC server started. Bound to: 127.27.215.130:43095
I20240502 01:56:21.687068 31754 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.215.130:43095 every 8 connection(s)
I20240502 01:56:21.688401 31628 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-1/data/info.pb
I20240502 01:56:21.691363 28510 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ga2ld/build/asan/bin/kudu as pid 31628
I20240502 01:56:21.691597 28510 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-1/wal/instance
I20240502 01:56:21.705555 31755 heartbeater.cc:347] Connected to a master server at 127.27.215.190:39475
I20240502 01:56:21.705941 31755 heartbeater.cc:464] Registering TS with master...
I20240502 01:56:21.707134 31755 heartbeater.cc:511] Master 127.27.215.190:39475 requested a full tablet report, sending...
I20240502 01:56:21.708611 31437 ts_manager.cc:194] Registered new tserver with Master: 4ce6ffed32c141fdb868e9d2bcf415de (127.27.215.130:43095)
I20240502 01:56:21.709576 31437 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.215.130:37715
I20240502 01:56:21.721050 28510 external_mini_cluster.cc:930] 2 TS(s) registered with all masters
I20240502 01:56:21.737676 28510 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task7ga2ld/build/asan/bin/kudu pid 31628
I20240502 01:56:21.748972 31750 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 01:56:21.830526 28510 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ga2ld/build/asan/bin/kudu with pid 31628
I20240502 01:56:21.847548 28510 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task7ga2ld/build/asan/bin/kudu pid 31406
I20240502 01:56:21.848731 31467 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 01:56:21.950651 28510 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ga2ld/build/asan/bin/kudu with pid 31406
I20240502 01:56:21.971758 28510 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ga2ld/build/asan/bin/kudu
/tmp/dist-test-task7ga2ld/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.215.190:39475
--webserver_interface=127.27.215.190
--webserver_port=43331
--builtin_ntp_servers=127.27.215.148:45729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.215.190:39475
--master_tombstone_evicted_tablet_replicas=false with env {}
I20240502 01:56:22.217479 31624 heartbeater.cc:503] Master 127.27.215.190:39475 was elected leader, sending a full tablet report...
W20240502 01:56:22.219419 31624 heartbeater.cc:644] Failed to heartbeat to 127.27.215.190:39475 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.27.215.190:39475: connect: Connection refused (error 111)
W20240502 01:56:22.324355 31767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:56:22.324713 31767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:56:22.324816 31767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:56:22.332720 31767 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 01:56:22.332851 31767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:56:22.332898 31767 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 01:56:22.332957 31767 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 01:56:22.342649 31767 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.215.148:45729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.27.215.190:39475
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.215.190:39475
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.215.190
--webserver_port=43331
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 02 May 2024 01:43:22 UTC on efd1337a2aa3
build id 83
ASAN enabled
I20240502 01:56:22.344077 31767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:56:22.345942 31767 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:56:22.357806 31773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:22.357873 31776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:22.357842 31774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:56:22.358557 31767 server_base.cc:1034] running on GCE node
I20240502 01:56:22.359648 31767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:56:22.361389 31767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:56:22.362685 31767 hybrid_clock.cc:648] HybridClock initialized: now 1714614982362588 us; error 74 us; skew 500 ppm
I20240502 01:56:22.363073 31767 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:56:22.365820 31767 webserver.cc:460] Webserver started at http://127.27.215.190:43331/ using document root <none> and password file <none>
I20240502 01:56:22.366673 31767 fs_manager.cc:359] Metadata directory not provided
I20240502 01:56:22.366847 31767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:56:22.373164 31767 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.004s
I20240502 01:56:22.376730 31782 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:22.378499 31767 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20240502 01:56:22.378727 31767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/master-0/data,/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/master-0/wal
uuid: "7400a60d31b6493bb6502b44632fcfcf"
format_stamp: "Formatted at 2024-05-02 01:56:20 on dist-test-slave-v8sz"
I20240502 01:56:22.379681 31767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:56:22.426837 31767 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:56:22.427796 31767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:56:22.428078 31767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:56:22.445959 31767 rpc_server.cc:307] RPC server started. Bound to: 127.27.215.190:39475
I20240502 01:56:22.445981 31834 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.215.190:39475 every 8 connection(s)
I20240502 01:56:22.447561 31767 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/master-0/data/info.pb
I20240502 01:56:22.454058 28510 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ga2ld/build/asan/bin/kudu as pid 31767
I20240502 01:56:22.454293 31835 sys_catalog.cc:263] Verifying existing consensus state
I20240502 01:56:22.459335 31835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf: Bootstrap starting.
I20240502 01:56:22.478526 31835 log.cc:824] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf: Log is configured to *not* fsync() on all Append() calls
I20240502 01:56:22.487705 31835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:56:22.488286 31835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf: Bootstrap complete.
I20240502 01:56:22.496471 31835 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7400a60d31b6493bb6502b44632fcfcf" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 39475 } }
I20240502 01:56:22.497409 31835 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7400a60d31b6493bb6502b44632fcfcf, State: Initialized, Role: FOLLOWER
I20240502 01:56:22.498054 31835 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7400a60d31b6493bb6502b44632fcfcf" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 39475 } }
I20240502 01:56:22.498282 31835 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:22.498370 31835 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:22.498513 31835 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:56:22.502445 31835 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7400a60d31b6493bb6502b44632fcfcf" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 39475 } }
I20240502 01:56:22.502985 31835 leader_election.cc:302] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7400a60d31b6493bb6502b44632fcfcf; no voters:
I20240502 01:56:22.503602 31835 leader_election.cc:288] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 01:56:22.503798 31840 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:56:22.504791 31840 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf [term 2 LEADER]: Becoming Leader. State: Replica: 7400a60d31b6493bb6502b44632fcfcf, State: Running, Role: LEADER
I20240502 01:56:22.505414 31840 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7400a60d31b6493bb6502b44632fcfcf" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 39475 } }
I20240502 01:56:22.505929 31835 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf [sys.catalog]: configured and running, proceeding with master startup.
I20240502 01:56:22.508116 31842 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7400a60d31b6493bb6502b44632fcfcf. Latest consensus state: current_term: 2 leader_uuid: "7400a60d31b6493bb6502b44632fcfcf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7400a60d31b6493bb6502b44632fcfcf" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 39475 } } }
I20240502 01:56:22.508482 31842 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf [sys.catalog]: This master's current role is: LEADER
I20240502 01:56:22.512305 31841 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "7400a60d31b6493bb6502b44632fcfcf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7400a60d31b6493bb6502b44632fcfcf" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 39475 } } }
I20240502 01:56:22.512702 31841 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf [sys.catalog]: This master's current role is: LEADER
I20240502 01:56:22.514045 31846 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 01:56:22.520205 31846 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 01:56:22.521785 31846 catalog_manager.cc:1259] Loaded cluster ID: b16638c2f4024afb87f1b12586c74824
I20240502 01:56:22.521905 31846 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 01:56:22.526187 31846 catalog_manager.cc:1504] Loading token signing keys...
I20240502 01:56:22.527861 31846 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7400a60d31b6493bb6502b44632fcfcf: Loaded TSK: 0
I20240502 01:56:22.529636 31846 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 01:56:23.226658 31624 heartbeater.cc:347] Connected to a master server at 127.27.215.190:39475
I20240502 01:56:23.226883 31624 heartbeater.cc:503] Master 127.27.215.190:39475 was elected leader, sending a full tablet report...
I20240502 01:56:23.229071 31799 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "29ab036dcfee4271b1831c55b6e0c910" instance_seqno: 1714614981183968) as {username='slave'} at 127.27.215.129:46733; Asking this server to re-register.
I20240502 01:56:23.229935 31624 heartbeater.cc:464] Registering TS with master...
I20240502 01:56:23.230223 31624 heartbeater.cc:511] Master 127.27.215.190:39475 requested a full tablet report, sending...
I20240502 01:56:23.231506 31799 ts_manager.cc:194] Registered new tserver with Master: 29ab036dcfee4271b1831c55b6e0c910 (127.27.215.129:46783)
I20240502 01:56:23.243211 28510 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20240502 01:56:23.243415 28510 test_util.cc:268] Using random seed: -385829242
I20240502 01:56:23.265956 31799 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39528:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20240502 01:56:23.292327 31558 tablet_service.cc:1467] Processing CreateTablet for tablet a8aacbd6f2084adfbae569511bab28b1 (DEFAULT_TABLE table=test-workload [id=0a31cffd33ed4179a8b59abc391add07]), partition=RANGE (key) PARTITION UNBOUNDED
I20240502 01:56:23.293823 31558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8aacbd6f2084adfbae569511bab28b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:23.304984 31870 tablet_bootstrap.cc:492] T a8aacbd6f2084adfbae569511bab28b1 P 29ab036dcfee4271b1831c55b6e0c910: Bootstrap starting.
I20240502 01:56:23.308652 31870 tablet_bootstrap.cc:654] T a8aacbd6f2084adfbae569511bab28b1 P 29ab036dcfee4271b1831c55b6e0c910: Neither blocks nor log segments found. Creating new log.
I20240502 01:56:23.309861 31870 log.cc:824] T a8aacbd6f2084adfbae569511bab28b1 P 29ab036dcfee4271b1831c55b6e0c910: Log is configured to *not* fsync() on all Append() calls
I20240502 01:56:23.312589 31870 tablet_bootstrap.cc:492] T a8aacbd6f2084adfbae569511bab28b1 P 29ab036dcfee4271b1831c55b6e0c910: No bootstrap required, opened a new log
I20240502 01:56:23.312881 31870 ts_tablet_manager.cc:1367] T a8aacbd6f2084adfbae569511bab28b1 P 29ab036dcfee4271b1831c55b6e0c910: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20240502 01:56:23.319870 31870 raft_consensus.cc:348] T a8aacbd6f2084adfbae569511bab28b1 P 29ab036dcfee4271b1831c55b6e0c910 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29ab036dcfee4271b1831c55b6e0c910" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 46783 } }
I20240502 01:56:23.320327 31870 raft_consensus.cc:374] T a8aacbd6f2084adfbae569511bab28b1 P 29ab036dcfee4271b1831c55b6e0c910 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:56:23.320446 31870 raft_consensus.cc:729] T a8aacbd6f2084adfbae569511bab28b1 P 29ab036dcfee4271b1831c55b6e0c910 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ab036dcfee4271b1831c55b6e0c910, State: Initialized, Role: FOLLOWER
I20240502 01:56:23.321254 31870 consensus_queue.cc:260] T a8aacbd6f2084adfbae569511bab28b1 P 29ab036dcfee4271b1831c55b6e0c910 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29ab036dcfee4271b1831c55b6e0c910" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 46783 } }
I20240502 01:56:23.321542 31870 raft_consensus.cc:388] T a8aacbd6f2084adfbae569511bab28b1 P 29ab036dcfee4271b1831c55b6e0c910 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:23.321681 31870 raft_consensus.cc:482] T a8aacbd6f2084adfbae569511bab28b1 P 29ab036dcfee4271b1831c55b6e0c910 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:23.321861 31870 raft_consensus.cc:3037] T a8aacbd6f2084adfbae569511bab28b1 P 29ab036dcfee4271b1831c55b6e0c910 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:56:23.324360 31870 raft_consensus.cc:504] T a8aacbd6f2084adfbae569511bab28b1 P 29ab036dcfee4271b1831c55b6e0c910 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29ab036dcfee4271b1831c55b6e0c910" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 46783 } }
I20240502 01:56:23.324955 31870 leader_election.cc:302] T a8aacbd6f2084adfbae569511bab28b1 P 29ab036dcfee4271b1831c55b6e0c910 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 29ab036dcfee4271b1831c55b6e0c910; no voters:
I20240502 01:56:23.325709 31870 leader_election.cc:288] T a8aacbd6f2084adfbae569511bab28b1 P 29ab036dcfee4271b1831c55b6e0c910 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:56:23.325862 31872 raft_consensus.cc:2781] T a8aacbd6f2084adfbae569511bab28b1 P 29ab036dcfee4271b1831c55b6e0c910 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:56:23.326555 31872 raft_consensus.cc:686] T a8aacbd6f2084adfbae569511bab28b1 P 29ab036dcfee4271b1831c55b6e0c910 [term 1 LEADER]: Becoming Leader. State: Replica: 29ab036dcfee4271b1831c55b6e0c910, State: Running, Role: LEADER
I20240502 01:56:23.327126 31872 consensus_queue.cc:237] T a8aacbd6f2084adfbae569511bab28b1 P 29ab036dcfee4271b1831c55b6e0c910 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29ab036dcfee4271b1831c55b6e0c910" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 46783 } }
I20240502 01:56:23.327698 31870 ts_tablet_manager.cc:1398] T a8aacbd6f2084adfbae569511bab28b1 P 29ab036dcfee4271b1831c55b6e0c910: Time spent starting tablet: real 0.015s user 0.010s sys 0.005s
I20240502 01:56:23.332868 31799 catalog_manager.cc:5484] T a8aacbd6f2084adfbae569511bab28b1 P 29ab036dcfee4271b1831c55b6e0c910 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29ab036dcfee4271b1831c55b6e0c910 (127.27.215.129). New cstate: current_term: 1 leader_uuid: "29ab036dcfee4271b1831c55b6e0c910" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29ab036dcfee4271b1831c55b6e0c910" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 46783 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:24.022517 28510 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ga2ld/build/asan/bin/kudu
/tmp/dist-test-task7ga2ld/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.215.130:43095
--local_ip_for_outbound_sockets=127.27.215.130
--tserver_master_addrs=127.27.215.190:39475
--webserver_port=32881
--webserver_interface=127.27.215.130
--builtin_ntp_servers=127.27.215.148:45729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240502 01:56:24.381870 31888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:56:24.382198 31888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:56:24.382325 31888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:56:24.390343 31888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:56:24.390554 31888 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.215.130
I20240502 01:56:24.400108 31888 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.215.148:45729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.215.130:43095
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.215.130
--webserver_port=32881
--tserver_master_addrs=127.27.215.190:39475
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.215.130
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 02 May 2024 01:43:22 UTC on efd1337a2aa3
build id 83
ASAN enabled
I20240502 01:56:24.401563 31888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:56:24.403385 31888 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:56:24.416623 31893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:24.416690 31896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:24.417246 31894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:56:24.417809 31888 server_base.cc:1034] running on GCE node
I20240502 01:56:24.418494 31888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:56:24.419551 31888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:56:24.420786 31888 hybrid_clock.cc:648] HybridClock initialized: now 1714614984420713 us; error 46 us; skew 500 ppm
I20240502 01:56:24.421121 31888 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:56:24.423835 31888 webserver.cc:460] Webserver started at http://127.27.215.130:32881/ using document root <none> and password file <none>
I20240502 01:56:24.424749 31888 fs_manager.cc:359] Metadata directory not provided
I20240502 01:56:24.424921 31888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:56:24.431021 31888 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.003s
I20240502 01:56:24.434643 31902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:24.436403 31888 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20240502 01:56:24.436635 31888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-1/wal
uuid: "4ce6ffed32c141fdb868e9d2bcf415de"
format_stamp: "Formatted at 2024-05-02 01:56:21 on dist-test-slave-v8sz"
I20240502 01:56:24.437697 31888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:56:24.460445 31888 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:56:24.461445 31888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:56:24.461745 31888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:56:24.462790 31888 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:56:24.464558 31888 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:56:24.464672 31888 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:24.464802 31888 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:56:24.464879 31888 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:24.500048 31888 rpc_server.cc:307] RPC server started. Bound to: 127.27.215.130:43095
I20240502 01:56:24.500109 32014 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.215.130:43095 every 8 connection(s)
I20240502 01:56:24.501935 31888 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-1/data/info.pb
I20240502 01:56:24.506352 28510 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ga2ld/build/asan/bin/kudu as pid 31888
I20240502 01:56:24.519115 32015 heartbeater.cc:347] Connected to a master server at 127.27.215.190:39475
I20240502 01:56:24.519529 32015 heartbeater.cc:464] Registering TS with master...
I20240502 01:56:24.520725 32015 heartbeater.cc:511] Master 127.27.215.190:39475 requested a full tablet report, sending...
I20240502 01:56:24.522152 32022 ts_tablet_manager.cc:902] T a8aacbd6f2084adfbae569511bab28b1 P 4ce6ffed32c141fdb868e9d2bcf415de: Initiating tablet copy from peer 29ab036dcfee4271b1831c55b6e0c910 (127.27.215.129:46783)
I20240502 01:56:24.522548 31799 ts_manager.cc:194] Registered new tserver with Master: 4ce6ffed32c141fdb868e9d2bcf415de (127.27.215.130:43095)
I20240502 01:56:24.524299 32022 tablet_copy_client.cc:308] T a8aacbd6f2084adfbae569511bab28b1 P 4ce6ffed32c141fdb868e9d2bcf415de: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:46783
I20240502 01:56:24.524499 31799 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.215.130:57363
I20240502 01:56:24.531145 31598 tablet_copy_service.cc:140] P 29ab036dcfee4271b1831c55b6e0c910: Received BeginTabletCopySession request for tablet a8aacbd6f2084adfbae569511bab28b1 from peer 4ce6ffed32c141fdb868e9d2bcf415de ({username='slave'} at 127.27.215.130:44625)
I20240502 01:56:24.531422 31598 tablet_copy_service.cc:161] P 29ab036dcfee4271b1831c55b6e0c910: Beginning new tablet copy session on tablet a8aacbd6f2084adfbae569511bab28b1 from peer 4ce6ffed32c141fdb868e9d2bcf415de at {username='slave'} at 127.27.215.130:44625: session id = 4ce6ffed32c141fdb868e9d2bcf415de-a8aacbd6f2084adfbae569511bab28b1
I20240502 01:56:24.534235 31598 tablet_copy_source_session.cc:205] T a8aacbd6f2084adfbae569511bab28b1 P 29ab036dcfee4271b1831c55b6e0c910: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:56:24.539213 32022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8aacbd6f2084adfbae569511bab28b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:24.550695 32022 tablet_copy_client.cc:783] T a8aacbd6f2084adfbae569511bab28b1 P 4ce6ffed32c141fdb868e9d2bcf415de: tablet copy: Starting download of 0 data blocks...
I20240502 01:56:24.551046 32022 tablet_copy_client.cc:647] T a8aacbd6f2084adfbae569511bab28b1 P 4ce6ffed32c141fdb868e9d2bcf415de: tablet copy: Starting download of 1 WAL segments...
I20240502 01:56:24.556303 32022 tablet_copy_client.cc:523] T a8aacbd6f2084adfbae569511bab28b1 P 4ce6ffed32c141fdb868e9d2bcf415de: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:56:24.559725 32022 tablet_bootstrap.cc:492] T a8aacbd6f2084adfbae569511bab28b1 P 4ce6ffed32c141fdb868e9d2bcf415de: Bootstrap starting.
I20240502 01:56:24.622787 32022 log.cc:824] T a8aacbd6f2084adfbae569511bab28b1 P 4ce6ffed32c141fdb868e9d2bcf415de: Log is configured to *not* fsync() on all Append() calls
I20240502 01:56:25.209781 32022 tablet_bootstrap.cc:492] T a8aacbd6f2084adfbae569511bab28b1 P 4ce6ffed32c141fdb868e9d2bcf415de: Bootstrap replayed 1/1 log segments. Stats: ops{read=212 overwritten=0 applied=212 ignored=0} inserts{seen=10550 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:56:25.210417 32022 tablet_bootstrap.cc:492] T a8aacbd6f2084adfbae569511bab28b1 P 4ce6ffed32c141fdb868e9d2bcf415de: Bootstrap complete.
I20240502 01:56:25.210994 32022 ts_tablet_manager.cc:1367] T a8aacbd6f2084adfbae569511bab28b1 P 4ce6ffed32c141fdb868e9d2bcf415de: Time spent bootstrapping tablet: real 0.651s user 0.600s sys 0.052s
I20240502 01:56:25.216212 32022 raft_consensus.cc:348] T a8aacbd6f2084adfbae569511bab28b1 P 4ce6ffed32c141fdb868e9d2bcf415de [term 1 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29ab036dcfee4271b1831c55b6e0c910" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 46783 } }
I20240502 01:56:25.216655 32022 raft_consensus.cc:729] T a8aacbd6f2084adfbae569511bab28b1 P 4ce6ffed32c141fdb868e9d2bcf415de [term 1 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 4ce6ffed32c141fdb868e9d2bcf415de, State: Initialized, Role: NON_PARTICIPANT
I20240502 01:56:25.217229 32022 consensus_queue.cc:260] T a8aacbd6f2084adfbae569511bab28b1 P 4ce6ffed32c141fdb868e9d2bcf415de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 212, Last appended: 1.212, Last appended by leader: 212, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29ab036dcfee4271b1831c55b6e0c910" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 46783 } }
I20240502 01:56:25.218413 32015 heartbeater.cc:503] Master 127.27.215.190:39475 was elected leader, sending a full tablet report...
I20240502 01:56:25.218974 32022 ts_tablet_manager.cc:1398] T a8aacbd6f2084adfbae569511bab28b1 P 4ce6ffed32c141fdb868e9d2bcf415de: Time spent starting tablet: real 0.008s user 0.004s sys 0.004s
I20240502 01:56:25.220165 31598 tablet_copy_service.cc:342] P 29ab036dcfee4271b1831c55b6e0c910: Request end of tablet copy session 4ce6ffed32c141fdb868e9d2bcf415de-a8aacbd6f2084adfbae569511bab28b1 received from {username='slave'} at 127.27.215.130:44625
I20240502 01:56:25.220386 31598 tablet_copy_service.cc:433] P 29ab036dcfee4271b1831c55b6e0c910: ending tablet copy session 4ce6ffed32c141fdb868e9d2bcf415de-a8aacbd6f2084adfbae569511bab28b1 on tablet a8aacbd6f2084adfbae569511bab28b1 with peer 4ce6ffed32c141fdb868e9d2bcf415de
I20240502 01:56:25.224716 31950 tablet_service.cc:1514] Processing DeleteTablet for tablet a8aacbd6f2084adfbae569511bab28b1 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:55068
I20240502 01:56:25.225766 32030 tablet_replica.cc:330] T a8aacbd6f2084adfbae569511bab28b1 P 4ce6ffed32c141fdb868e9d2bcf415de: stopping tablet replica
I20240502 01:56:25.226167 32030 raft_consensus.cc:2229] T a8aacbd6f2084adfbae569511bab28b1 P 4ce6ffed32c141fdb868e9d2bcf415de [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20240502 01:56:25.226480 32030 raft_consensus.cc:2258] T a8aacbd6f2084adfbae569511bab28b1 P 4ce6ffed32c141fdb868e9d2bcf415de [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20240502 01:56:25.227738 32030 ts_tablet_manager.cc:1875] T a8aacbd6f2084adfbae569511bab28b1 P 4ce6ffed32c141fdb868e9d2bcf415de: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:56:25.232439 32030 ts_tablet_manager.cc:1888] T a8aacbd6f2084adfbae569511bab28b1 P 4ce6ffed32c141fdb868e9d2bcf415de: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.212
I20240502 01:56:25.232601 32030 log.cc:1196] T a8aacbd6f2084adfbae569511bab28b1 P 4ce6ffed32c141fdb868e9d2bcf415de: Deleting WAL directory at /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714614966221093-28510-0/minicluster-data/ts-1/wal/wals/a8aacbd6f2084adfbae569511bab28b1
I20240502 01:56:25.234869 32022 ts_tablet_manager.cc:902] T a8aacbd6f2084adfbae569511bab28b1 P 4ce6ffed32c141fdb868e9d2bcf415de: Initiating tablet copy from peer 29ab036dcfee4271b1831c55b6e0c910 (127.27.215.129:46783)
I20240502 01:56:25.236083 32022 tablet_copy_client.cc:308] T a8aacbd6f2084adfbae569511bab28b1 P 4ce6ffed32c141fdb868e9d2bcf415de: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:46783
I20240502 01:56:25.236900 31598 tablet_copy_service.cc:140] P 29ab036dcfee4271b1831c55b6e0c910: Received BeginTabletCopySession request for tablet a8aacbd6f2084adfbae569511bab28b1 from peer 4ce6ffed32c141fdb868e9d2bcf415de ({username='slave'} at 127.27.215.130:44625)
I20240502 01:56:25.237082 31598 tablet_copy_service.cc:161] P 29ab036dcfee4271b1831c55b6e0c910: Beginning new tablet copy session on tablet a8aacbd6f2084adfbae569511bab28b1 from peer 4ce6ffed32c141fdb868e9d2bcf415de at {username='slave'} at 127.27.215.130:44625: session id = 4ce6ffed32c141fdb868e9d2bcf415de-a8aacbd6f2084adfbae569511bab28b1
I20240502 01:56:25.239132 31598 tablet_copy_source_session.cc:205] T a8aacbd6f2084adfbae569511bab28b1 P 29ab036dcfee4271b1831c55b6e0c910: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:56:25.240101 32022 ts_tablet_manager.cc:1875] T a8aacbd6f2084adfbae569511bab28b1 P 4ce6ffed32c141fdb868e9d2bcf415de: Deleting tablet data with delete state TABLET_DATA_COPYING
I20240502 01:56:25.245028 32022 ts_tablet_manager.cc:1888] T a8aacbd6f2084adfbae569511bab28b1 P 4ce6ffed32c141fdb868e9d2bcf415de: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.212
I20240502 01:56:25.245347 32022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8aacbd6f2084adfbae569511bab28b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:25.247669 32022 tablet_copy_client.cc:783] T a8aacbd6f2084adfbae569511bab28b1 P 4ce6ffed32c141fdb868e9d2bcf415de: tablet copy: Starting download of 0 data blocks...
I20240502 01:56:25.247915 32022 tablet_copy_client.cc:647] T a8aacbd6f2084adfbae569511bab28b1 P 4ce6ffed32c141fdb868e9d2bcf415de: tablet copy: Starting download of 1 WAL segments...
I20240502 01:56:25.251947 32022 tablet_copy_client.cc:523] T a8aacbd6f2084adfbae569511bab28b1 P 4ce6ffed32c141fdb868e9d2bcf415de: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:56:25.254691 32022 tablet_bootstrap.cc:492] T a8aacbd6f2084adfbae569511bab28b1 P 4ce6ffed32c141fdb868e9d2bcf415de: Bootstrap starting.
I20240502 01:56:25.861799 32022 tablet_bootstrap.cc:492] T a8aacbd6f2084adfbae569511bab28b1 P 4ce6ffed32c141fdb868e9d2bcf415de: Bootstrap replayed 1/1 log segments. Stats: ops{read=212 overwritten=0 applied=212 ignored=0} inserts{seen=10550 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:56:25.862234 32022 tablet_bootstrap.cc:492] T a8aacbd6f2084adfbae569511bab28b1 P 4ce6ffed32c141fdb868e9d2bcf415de: Bootstrap complete.
I20240502 01:56:25.862588 32022 ts_tablet_manager.cc:1367] T a8aacbd6f2084adfbae569511bab28b1 P 4ce6ffed32c141fdb868e9d2bcf415de: Time spent bootstrapping tablet: real 0.608s user 0.564s sys 0.044s
I20240502 01:56:25.863449 32022 raft_consensus.cc:348] T a8aacbd6f2084adfbae569511bab28b1 P 4ce6ffed32c141fdb868e9d2bcf415de [term 1 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29ab036dcfee4271b1831c55b6e0c910" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 46783 } }
I20240502 01:56:25.863643 32022 raft_consensus.cc:729] T a8aacbd6f2084adfbae569511bab28b1 P 4ce6ffed32c141fdb868e9d2bcf415de [term 1 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 4ce6ffed32c141fdb868e9d2bcf415de, State: Initialized, Role: NON_PARTICIPANT
I20240502 01:56:25.863847 32022 consensus_queue.cc:260] T a8aacbd6f2084adfbae569511bab28b1 P 4ce6ffed32c141fdb868e9d2bcf415de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 212, Last appended: 1.212, Last appended by leader: 212, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29ab036dcfee4271b1831c55b6e0c910" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 46783 } }
I20240502 01:56:25.864555 32022 ts_tablet_manager.cc:1398] T a8aacbd6f2084adfbae569511bab28b1 P 4ce6ffed32c141fdb868e9d2bcf415de: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240502 01:56:25.865556 31598 tablet_copy_service.cc:342] P 29ab036dcfee4271b1831c55b6e0c910: Request end of tablet copy session 4ce6ffed32c141fdb868e9d2bcf415de-a8aacbd6f2084adfbae569511bab28b1 received from {username='slave'} at 127.27.215.130:44625
I20240502 01:56:25.865674 31598 tablet_copy_service.cc:433] P 29ab036dcfee4271b1831c55b6e0c910: ending tablet copy session 4ce6ffed32c141fdb868e9d2bcf415de-a8aacbd6f2084adfbae569511bab28b1 on tablet a8aacbd6f2084adfbae569511bab28b1 with peer 4ce6ffed32c141fdb868e9d2bcf415de
I20240502 01:56:25.868315 28510 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task7ga2ld/build/asan/bin/kudu pid 31496
I20240502 01:56:25.869346 31619 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 01:56:25.967098 28510 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ga2ld/build/asan/bin/kudu with pid 31496
I20240502 01:56:25.988324 28510 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task7ga2ld/build/asan/bin/kudu pid 31888
I20240502 01:56:25.989542 32010 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 01:56:26.104557 28510 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ga2ld/build/asan/bin/kudu with pid 31888
I20240502 01:56:26.126971 28510 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task7ga2ld/build/asan/bin/kudu pid 31767
I20240502 01:56:26.128196 31830 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 01:56:26.234947 28510 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ga2ld/build/asan/bin/kudu with pid 31767
2024-05-02T01:56:26Z chronyd exiting
[ OK ] TabletCopyClientSessionITest.TestStartTabletCopy (6170 ms)
[ RUN ] TabletCopyClientSessionITest.TestCopyFromCrashedSource
2024-05-02T01:56:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-02T01:56:26Z Disabled control of system clock
I20240502 01:56:26.307219 28510 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ga2ld/build/asan/bin/kudu
/tmp/dist-test-task7ga2ld/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.215.190:38521
--webserver_interface=127.27.215.190
--webserver_port=0
--builtin_ntp_servers=127.27.215.148:41171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.215.190:38521
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240502 01:56:26.651754 32043 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:56:26.652076 32043 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:56:26.652160 32043 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:56:26.659899 32043 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 01:56:26.660035 32043 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:56:26.660082 32043 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 01:56:26.660144 32043 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 01:56:26.669719 32043 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.215.148:41171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.27.215.190:38521
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.215.190:38521
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.215.190
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 02 May 2024 01:43:22 UTC on efd1337a2aa3
build id 83
ASAN enabled
I20240502 01:56:26.671068 32043 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:56:26.672874 32043 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:56:26.684317 32051 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:26.684252 32048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:26.684285 32049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:56:26.685331 32043 server_base.cc:1034] running on GCE node
I20240502 01:56:26.686278 32043 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:56:26.687829 32043 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:56:26.689088 32043 hybrid_clock.cc:648] HybridClock initialized: now 1714614986689008 us; error 54 us; skew 500 ppm
I20240502 01:56:26.689527 32043 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:56:26.692121 32043 webserver.cc:460] Webserver started at http://127.27.215.190:40533/ using document root <none> and password file <none>
I20240502 01:56:26.692958 32043 fs_manager.cc:359] Metadata directory not provided
I20240502 01:56:26.693109 32043 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:56:26.693482 32043 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:56:26.696389 32043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/master-0/data/instance:
uuid: "d588d919e93d41ec8f717b370428928c"
format_stamp: "Formatted at 2024-05-02 01:56:26 on dist-test-slave-v8sz"
I20240502 01:56:26.697268 32043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/master-0/wal/instance:
uuid: "d588d919e93d41ec8f717b370428928c"
format_stamp: "Formatted at 2024-05-02 01:56:26 on dist-test-slave-v8sz"
I20240502 01:56:26.703287 32043 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20240502 01:56:26.707237 32057 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:26.708757 32043 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20240502 01:56:26.708959 32043 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/master-0/data,/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/master-0/wal
uuid: "d588d919e93d41ec8f717b370428928c"
format_stamp: "Formatted at 2024-05-02 01:56:26 on dist-test-slave-v8sz"
I20240502 01:56:26.709161 32043 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:56:26.745595 32043 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:56:26.746482 32043 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:56:26.746789 32043 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:56:26.768184 32043 rpc_server.cc:307] RPC server started. Bound to: 127.27.215.190:38521
I20240502 01:56:26.768215 32108 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.215.190:38521 every 8 connection(s)
I20240502 01:56:26.769827 32043 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/master-0/data/info.pb
I20240502 01:56:26.773890 32109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:26.780007 28510 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ga2ld/build/asan/bin/kudu as pid 32043
I20240502 01:56:26.780273 28510 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/master-0/wal/instance
I20240502 01:56:26.784907 32109 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c: Bootstrap starting.
I20240502 01:56:26.788375 32109 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c: Neither blocks nor log segments found. Creating new log.
I20240502 01:56:26.789600 32109 log.cc:824] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c: Log is configured to *not* fsync() on all Append() calls
I20240502 01:56:26.792608 32109 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c: No bootstrap required, opened a new log
I20240502 01:56:26.800185 32109 raft_consensus.cc:348] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d588d919e93d41ec8f717b370428928c" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 38521 } }
I20240502 01:56:26.800633 32109 raft_consensus.cc:374] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:56:26.800750 32109 raft_consensus.cc:729] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d588d919e93d41ec8f717b370428928c, State: Initialized, Role: FOLLOWER
I20240502 01:56:26.801499 32109 consensus_queue.cc:260] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d588d919e93d41ec8f717b370428928c" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 38521 } }
I20240502 01:56:26.801734 32109 raft_consensus.cc:388] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:26.801865 32109 raft_consensus.cc:482] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:26.802035 32109 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:56:26.804248 32109 raft_consensus.cc:504] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d588d919e93d41ec8f717b370428928c" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 38521 } }
I20240502 01:56:26.804876 32109 leader_election.cc:302] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d588d919e93d41ec8f717b370428928c; no voters:
I20240502 01:56:26.805639 32109 leader_election.cc:288] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:56:26.805809 32114 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:56:26.806535 32114 raft_consensus.cc:686] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c [term 1 LEADER]: Becoming Leader. State: Replica: d588d919e93d41ec8f717b370428928c, State: Running, Role: LEADER
I20240502 01:56:26.807153 32114 consensus_queue.cc:237] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d588d919e93d41ec8f717b370428928c" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 38521 } }
I20240502 01:56:26.807858 32109 sys_catalog.cc:564] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c [sys.catalog]: configured and running, proceeding with master startup.
I20240502 01:56:26.810204 32115 sys_catalog.cc:455] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d588d919e93d41ec8f717b370428928c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d588d919e93d41ec8f717b370428928c" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 38521 } } }
I20240502 01:56:26.810585 32115 sys_catalog.cc:458] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c [sys.catalog]: This master's current role is: LEADER
I20240502 01:56:26.812510 32116 sys_catalog.cc:455] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c [sys.catalog]: SysCatalogTable state changed. Reason: New leader d588d919e93d41ec8f717b370428928c. Latest consensus state: current_term: 1 leader_uuid: "d588d919e93d41ec8f717b370428928c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d588d919e93d41ec8f717b370428928c" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 38521 } } }
I20240502 01:56:26.812891 32116 sys_catalog.cc:458] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c [sys.catalog]: This master's current role is: LEADER
I20240502 01:56:26.813623 32120 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 01:56:26.819526 32120 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 01:56:26.830855 32120 catalog_manager.cc:1347] Generated new cluster ID: 6efb3d572c6c4e7eaab3b430873f62c6
I20240502 01:56:26.830996 32120 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 01:56:26.864092 32120 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 01:56:26.866053 32120 catalog_manager.cc:1504] Loading token signing keys...
I20240502 01:56:26.879161 32120 catalog_manager.cc:5857] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c: Generated new TSK 0
I20240502 01:56:26.880115 32120 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 01:56:26.894037 28510 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ga2ld/build/asan/bin/kudu
/tmp/dist-test-task7ga2ld/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.215.129:0
--local_ip_for_outbound_sockets=127.27.215.129
--webserver_interface=127.27.215.129
--webserver_port=0
--tserver_master_addrs=127.27.215.190:38521
--builtin_ntp_servers=127.27.215.148:41171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240502 01:56:27.252527 32133 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:56:27.252866 32133 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:56:27.252991 32133 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:56:27.260985 32133 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:56:27.261194 32133 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.215.129
I20240502 01:56:27.271210 32133 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.215.148:41171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.215.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.215.129
--webserver_port=0
--tserver_master_addrs=127.27.215.190:38521
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.215.129
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 02 May 2024 01:43:22 UTC on efd1337a2aa3
build id 83
ASAN enabled
I20240502 01:56:27.272698 32133 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:56:27.274621 32133 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:56:27.287492 32139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:27.287695 32141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:27.287849 32138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:56:27.288455 32133 server_base.cc:1034] running on GCE node
I20240502 01:56:27.289295 32133 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:56:27.290517 32133 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:56:27.291760 32133 hybrid_clock.cc:648] HybridClock initialized: now 1714614987291684 us; error 62 us; skew 500 ppm
I20240502 01:56:27.292114 32133 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:56:27.294972 32133 webserver.cc:460] Webserver started at http://127.27.215.129:45591/ using document root <none> and password file <none>
I20240502 01:56:27.295797 32133 fs_manager.cc:359] Metadata directory not provided
I20240502 01:56:27.295933 32133 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:56:27.296253 32133 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:56:27.299201 32133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-0/data/instance:
uuid: "5a57b600a3564373a7424d7dccfe4f18"
format_stamp: "Formatted at 2024-05-02 01:56:27 on dist-test-slave-v8sz"
I20240502 01:56:27.300053 32133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-0/wal/instance:
uuid: "5a57b600a3564373a7424d7dccfe4f18"
format_stamp: "Formatted at 2024-05-02 01:56:27 on dist-test-slave-v8sz"
I20240502 01:56:27.305837 32133 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20240502 01:56:27.309924 32147 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:27.311442 32133 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20240502 01:56:27.311663 32133 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-0/wal
uuid: "5a57b600a3564373a7424d7dccfe4f18"
format_stamp: "Formatted at 2024-05-02 01:56:27 on dist-test-slave-v8sz"
I20240502 01:56:27.311869 32133 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:56:27.330981 32133 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:56:27.331924 32133 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:56:27.332237 32133 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:56:27.333268 32133 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:56:27.335327 32133 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:56:27.335422 32133 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:27.335624 32133 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:56:27.335705 32133 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:27.370307 32133 rpc_server.cc:307] RPC server started. Bound to: 127.27.215.129:38469
I20240502 01:56:27.370354 32259 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.215.129:38469 every 8 connection(s)
I20240502 01:56:27.371703 32133 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-0/data/info.pb
I20240502 01:56:27.379109 28510 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ga2ld/build/asan/bin/kudu as pid 32133
I20240502 01:56:27.379357 28510 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-0/wal/instance
I20240502 01:56:27.383402 28510 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ga2ld/build/asan/bin/kudu
/tmp/dist-test-task7ga2ld/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.215.130:0
--local_ip_for_outbound_sockets=127.27.215.130
--webserver_interface=127.27.215.130
--webserver_port=0
--tserver_master_addrs=127.27.215.190:38521
--builtin_ntp_servers=127.27.215.148:41171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240502 01:56:27.386407 32260 heartbeater.cc:347] Connected to a master server at 127.27.215.190:38521
I20240502 01:56:27.386817 32260 heartbeater.cc:464] Registering TS with master...
I20240502 01:56:27.388005 32260 heartbeater.cc:511] Master 127.27.215.190:38521 requested a full tablet report, sending...
I20240502 01:56:27.390889 32074 ts_manager.cc:194] Registered new tserver with Master: 5a57b600a3564373a7424d7dccfe4f18 (127.27.215.129:38469)
I20240502 01:56:27.392611 32074 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.215.129:56185
W20240502 01:56:27.736897 32264 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:56:27.737246 32264 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:56:27.737422 32264 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:56:27.745059 32264 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:56:27.745317 32264 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.215.130
I20240502 01:56:27.754700 32264 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.215.148:41171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.215.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.215.130
--webserver_port=0
--tserver_master_addrs=127.27.215.190:38521
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.215.130
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 02 May 2024 01:43:22 UTC on efd1337a2aa3
build id 83
ASAN enabled
I20240502 01:56:27.756172 32264 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:56:27.758082 32264 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:56:27.771325 32270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:27.771278 32269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:27.774787 32272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:56:27.776536 32264 server_base.cc:1034] running on GCE node
I20240502 01:56:27.777328 32264 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:56:27.778484 32264 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:56:27.779735 32264 hybrid_clock.cc:648] HybridClock initialized: now 1714614987779653 us; error 65 us; skew 500 ppm
I20240502 01:56:27.780072 32264 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:56:27.782670 32264 webserver.cc:460] Webserver started at http://127.27.215.130:39445/ using document root <none> and password file <none>
I20240502 01:56:27.783481 32264 fs_manager.cc:359] Metadata directory not provided
I20240502 01:56:27.783636 32264 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:56:27.783951 32264 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:56:27.787271 32264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-1/data/instance:
uuid: "4175dc9969ec4693813498c1451e5eff"
format_stamp: "Formatted at 2024-05-02 01:56:27 on dist-test-slave-v8sz"
I20240502 01:56:27.788100 32264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-1/wal/instance:
uuid: "4175dc9969ec4693813498c1451e5eff"
format_stamp: "Formatted at 2024-05-02 01:56:27 on dist-test-slave-v8sz"
I20240502 01:56:27.794124 32264 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.006s
I20240502 01:56:27.798245 32278 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:27.799808 32264 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20240502 01:56:27.800010 32264 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-1/wal
uuid: "4175dc9969ec4693813498c1451e5eff"
format_stamp: "Formatted at 2024-05-02 01:56:27 on dist-test-slave-v8sz"
I20240502 01:56:27.800215 32264 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:56:27.822865 32264 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:56:27.823853 32264 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:56:27.824163 32264 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:56:27.825443 32264 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:56:27.827122 32264 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:56:27.827215 32264 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:27.827363 32264 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:56:27.827422 32264 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:27.861276 32264 rpc_server.cc:307] RPC server started. Bound to: 127.27.215.130:43129
I20240502 01:56:27.861313 32390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.215.130:43129 every 8 connection(s)
I20240502 01:56:27.862702 32264 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-1/data/info.pb
I20240502 01:56:27.868705 28510 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ga2ld/build/asan/bin/kudu as pid 32264
I20240502 01:56:27.868925 28510 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-1/wal/instance
I20240502 01:56:27.877247 32391 heartbeater.cc:347] Connected to a master server at 127.27.215.190:38521
I20240502 01:56:27.877640 32391 heartbeater.cc:464] Registering TS with master...
I20240502 01:56:27.878600 32391 heartbeater.cc:511] Master 127.27.215.190:38521 requested a full tablet report, sending...
I20240502 01:56:27.880168 32074 ts_manager.cc:194] Registered new tserver with Master: 4175dc9969ec4693813498c1451e5eff (127.27.215.130:43129)
I20240502 01:56:27.881004 32074 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.215.130:39753
I20240502 01:56:27.885516 28510 external_mini_cluster.cc:930] 2 TS(s) registered with all masters
I20240502 01:56:27.900625 28510 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task7ga2ld/build/asan/bin/kudu pid 32264
I20240502 01:56:27.910017 32386 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 01:56:27.991919 28510 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ga2ld/build/asan/bin/kudu with pid 32264
I20240502 01:56:28.009003 28510 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task7ga2ld/build/asan/bin/kudu pid 32043
I20240502 01:56:28.010367 32104 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 01:56:28.112283 28510 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ga2ld/build/asan/bin/kudu with pid 32043
I20240502 01:56:28.133335 28510 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ga2ld/build/asan/bin/kudu
/tmp/dist-test-task7ga2ld/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.215.190:38521
--webserver_interface=127.27.215.190
--webserver_port=40533
--builtin_ntp_servers=127.27.215.148:41171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.215.190:38521
--master_tombstone_evicted_tablet_replicas=false with env {}
I20240502 01:56:28.396817 32260 heartbeater.cc:503] Master 127.27.215.190:38521 was elected leader, sending a full tablet report...
W20240502 01:56:28.398721 32260 heartbeater.cc:644] Failed to heartbeat to 127.27.215.190:38521 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.27.215.190:38521: connect: Connection refused (error 111)
W20240502 01:56:28.478868 32403 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:56:28.479218 32403 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:56:28.479341 32403 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:56:28.487183 32403 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 01:56:28.487316 32403 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:56:28.487375 32403 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 01:56:28.487434 32403 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 01:56:28.497045 32403 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.215.148:41171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.27.215.190:38521
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.215.190:38521
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.215.190
--webserver_port=40533
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 02 May 2024 01:43:22 UTC on efd1337a2aa3
build id 83
ASAN enabled
I20240502 01:56:28.498481 32403 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:56:28.500311 32403 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:56:28.511384 32410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:28.511397 32412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:28.511312 32409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:56:28.512642 32403 server_base.cc:1034] running on GCE node
I20240502 01:56:28.513569 32403 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:56:28.515166 32403 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:56:28.516407 32403 hybrid_clock.cc:648] HybridClock initialized: now 1714614988516340 us; error 42 us; skew 500 ppm
I20240502 01:56:28.516769 32403 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:56:28.519356 32403 webserver.cc:460] Webserver started at http://127.27.215.190:40533/ using document root <none> and password file <none>
I20240502 01:56:28.520128 32403 fs_manager.cc:359] Metadata directory not provided
I20240502 01:56:28.520294 32403 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:56:28.526490 32403 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20240502 01:56:28.529876 32418 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:28.531644 32403 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20240502 01:56:28.531872 32403 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/master-0/data,/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/master-0/wal
uuid: "d588d919e93d41ec8f717b370428928c"
format_stamp: "Formatted at 2024-05-02 01:56:26 on dist-test-slave-v8sz"
I20240502 01:56:28.532850 32403 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:56:28.555933 32403 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:56:28.556891 32403 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:56:28.557199 32403 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:56:28.576139 32403 rpc_server.cc:307] RPC server started. Bound to: 127.27.215.190:38521
I20240502 01:56:28.576161 32469 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.215.190:38521 every 8 connection(s)
I20240502 01:56:28.577736 32403 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/master-0/data/info.pb
I20240502 01:56:28.584412 32470 sys_catalog.cc:263] Verifying existing consensus state
I20240502 01:56:28.585795 28510 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ga2ld/build/asan/bin/kudu as pid 32403
I20240502 01:56:28.588080 32470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c: Bootstrap starting.
I20240502 01:56:28.606434 32470 log.cc:824] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c: Log is configured to *not* fsync() on all Append() calls
I20240502 01:56:28.615762 32470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:56:28.616428 32470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c: Bootstrap complete.
I20240502 01:56:28.624202 32470 raft_consensus.cc:348] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d588d919e93d41ec8f717b370428928c" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 38521 } }
I20240502 01:56:28.625093 32470 raft_consensus.cc:729] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d588d919e93d41ec8f717b370428928c, State: Initialized, Role: FOLLOWER
I20240502 01:56:28.625820 32470 consensus_queue.cc:260] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d588d919e93d41ec8f717b370428928c" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 38521 } }
I20240502 01:56:28.626081 32470 raft_consensus.cc:388] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:28.626204 32470 raft_consensus.cc:482] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:28.626421 32470 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:56:28.630728 32470 raft_consensus.cc:504] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d588d919e93d41ec8f717b370428928c" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 38521 } }
I20240502 01:56:28.631382 32470 leader_election.cc:302] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d588d919e93d41ec8f717b370428928c; no voters:
I20240502 01:56:28.632017 32470 leader_election.cc:288] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 01:56:28.632185 32475 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:56:28.632930 32475 raft_consensus.cc:686] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c [term 2 LEADER]: Becoming Leader. State: Replica: d588d919e93d41ec8f717b370428928c, State: Running, Role: LEADER
I20240502 01:56:28.633540 32475 consensus_queue.cc:237] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d588d919e93d41ec8f717b370428928c" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 38521 } }
I20240502 01:56:28.634169 32470 sys_catalog.cc:564] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c [sys.catalog]: configured and running, proceeding with master startup.
I20240502 01:56:28.636555 32476 sys_catalog.cc:455] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "d588d919e93d41ec8f717b370428928c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d588d919e93d41ec8f717b370428928c" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 38521 } } }
I20240502 01:56:28.637086 32476 sys_catalog.cc:458] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c [sys.catalog]: This master's current role is: LEADER
I20240502 01:56:28.636519 32477 sys_catalog.cc:455] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c [sys.catalog]: SysCatalogTable state changed. Reason: New leader d588d919e93d41ec8f717b370428928c. Latest consensus state: current_term: 2 leader_uuid: "d588d919e93d41ec8f717b370428928c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d588d919e93d41ec8f717b370428928c" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 38521 } } }
I20240502 01:56:28.637684 32477 sys_catalog.cc:458] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c [sys.catalog]: This master's current role is: LEADER
I20240502 01:56:28.639344 32481 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 01:56:28.646996 32481 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 01:56:28.648588 32481 catalog_manager.cc:1259] Loaded cluster ID: 6efb3d572c6c4e7eaab3b430873f62c6
I20240502 01:56:28.648687 32481 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 01:56:28.652076 32481 catalog_manager.cc:1504] Loading token signing keys...
I20240502 01:56:28.653705 32481 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d588d919e93d41ec8f717b370428928c: Loaded TSK: 0
I20240502 01:56:28.655083 32481 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 01:56:29.406550 32260 heartbeater.cc:347] Connected to a master server at 127.27.215.190:38521
I20240502 01:56:29.406793 32260 heartbeater.cc:503] Master 127.27.215.190:38521 was elected leader, sending a full tablet report...
I20240502 01:56:29.408774 32435 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "5a57b600a3564373a7424d7dccfe4f18" instance_seqno: 1714614987362026) as {username='slave'} at 127.27.215.129:47783; Asking this server to re-register.
I20240502 01:56:29.409658 32260 heartbeater.cc:464] Registering TS with master...
I20240502 01:56:29.409946 32260 heartbeater.cc:511] Master 127.27.215.190:38521 requested a full tablet report, sending...
I20240502 01:56:29.411281 32435 ts_manager.cc:194] Registered new tserver with Master: 5a57b600a3564373a7424d7dccfe4f18 (127.27.215.129:38469)
I20240502 01:56:29.416682 28510 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20240502 01:56:29.416890 28510 test_util.cc:268] Using random seed: -379655766
I20240502 01:56:29.438477 32435 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39996:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20240502 01:56:29.463770 32195 tablet_service.cc:1467] Processing CreateTablet for tablet dbcb6ed7253c46d097c5a9f149c7ea0a (DEFAULT_TABLE table=test-workload [id=605598abfcef4473a281e384b830b1d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20240502 01:56:29.465209 32195 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dbcb6ed7253c46d097c5a9f149c7ea0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:29.476917 32506 tablet_bootstrap.cc:492] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18: Bootstrap starting.
I20240502 01:56:29.480566 32506 tablet_bootstrap.cc:654] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18: Neither blocks nor log segments found. Creating new log.
I20240502 01:56:29.481783 32506 log.cc:824] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18: Log is configured to *not* fsync() on all Append() calls
I20240502 01:56:29.484531 32506 tablet_bootstrap.cc:492] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18: No bootstrap required, opened a new log
I20240502 01:56:29.484808 32506 ts_tablet_manager.cc:1367] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20240502 01:56:29.491917 32506 raft_consensus.cc:348] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a57b600a3564373a7424d7dccfe4f18" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38469 } }
I20240502 01:56:29.492305 32506 raft_consensus.cc:374] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:56:29.492394 32506 raft_consensus.cc:729] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a57b600a3564373a7424d7dccfe4f18, State: Initialized, Role: FOLLOWER
I20240502 01:56:29.493039 32506 consensus_queue.cc:260] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a57b600a3564373a7424d7dccfe4f18" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38469 } }
I20240502 01:56:29.493257 32506 raft_consensus.cc:388] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:29.493417 32506 raft_consensus.cc:482] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:29.493580 32506 raft_consensus.cc:3037] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:56:29.496081 32506 raft_consensus.cc:504] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a57b600a3564373a7424d7dccfe4f18" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38469 } }
I20240502 01:56:29.496655 32506 leader_election.cc:302] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a57b600a3564373a7424d7dccfe4f18; no voters:
I20240502 01:56:29.497280 32506 leader_election.cc:288] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:56:29.497504 32508 raft_consensus.cc:2781] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:56:29.498153 32508 raft_consensus.cc:686] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18 [term 1 LEADER]: Becoming Leader. State: Replica: 5a57b600a3564373a7424d7dccfe4f18, State: Running, Role: LEADER
I20240502 01:56:29.498765 32508 consensus_queue.cc:237] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a57b600a3564373a7424d7dccfe4f18" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38469 } }
I20240502 01:56:29.499260 32506 ts_tablet_manager.cc:1398] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18: Time spent starting tablet: real 0.014s user 0.010s sys 0.005s
I20240502 01:56:29.504592 32435 catalog_manager.cc:5484] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a57b600a3564373a7424d7dccfe4f18 (127.27.215.129). New cstate: current_term: 1 leader_uuid: "5a57b600a3564373a7424d7dccfe4f18" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a57b600a3564373a7424d7dccfe4f18" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38469 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:30.192158 28510 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ga2ld/build/asan/bin/kudu
/tmp/dist-test-task7ga2ld/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.215.130:43129
--local_ip_for_outbound_sockets=127.27.215.130
--tserver_master_addrs=127.27.215.190:38521
--webserver_port=39445
--webserver_interface=127.27.215.130
--builtin_ntp_servers=127.27.215.148:41171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240502 01:56:30.556427 32523 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:56:30.556775 32523 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:56:30.556910 32523 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:56:30.564672 32523 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:56:30.564925 32523 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.215.130
I20240502 01:56:30.574457 32523 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.215.148:41171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.215.130:43129
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.215.130
--webserver_port=39445
--tserver_master_addrs=127.27.215.190:38521
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.215.130
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 02 May 2024 01:43:22 UTC on efd1337a2aa3
build id 83
ASAN enabled
I20240502 01:56:30.575970 32523 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:56:30.577937 32523 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:56:30.591370 32531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:30.591444 32529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:30.591470 32528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:56:30.592437 32523 server_base.cc:1034] running on GCE node
I20240502 01:56:30.593101 32523 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:56:30.594204 32523 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:56:30.595466 32523 hybrid_clock.cc:648] HybridClock initialized: now 1714614990595378 us; error 62 us; skew 500 ppm
I20240502 01:56:30.595801 32523 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:56:30.598593 32523 webserver.cc:460] Webserver started at http://127.27.215.130:39445/ using document root <none> and password file <none>
I20240502 01:56:30.599403 32523 fs_manager.cc:359] Metadata directory not provided
I20240502 01:56:30.599557 32523 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:56:30.605711 32523 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.002s
I20240502 01:56:30.608985 32537 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:30.610760 32523 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20240502 01:56:30.610958 32523 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-1/wal
uuid: "4175dc9969ec4693813498c1451e5eff"
format_stamp: "Formatted at 2024-05-02 01:56:27 on dist-test-slave-v8sz"
I20240502 01:56:30.611903 32523 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:56:30.632890 32523 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:56:30.633903 32523 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:56:30.634207 32523 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:56:30.635388 32523 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:56:30.637169 32523 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:56:30.637277 32523 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:30.637421 32523 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:56:30.637508 32523 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:30.671939 32523 rpc_server.cc:307] RPC server started. Bound to: 127.27.215.130:43129
I20240502 01:56:30.671994 32650 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.215.130:43129 every 8 connection(s)
I20240502 01:56:30.673624 32523 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-1/data/info.pb
I20240502 01:56:30.676182 28510 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ga2ld/build/asan/bin/kudu as pid 32523
W20240502 01:56:30.680824 32255 generic_service.cc:139] {username='slave'} at 127.0.0.1:48948 forcing change of non-runtime-safe flag fault_crash_on_handle_tc_fetch_data
I20240502 01:56:30.681066 32255 generic_service.cc:175] {username='slave'} at 127.0.0.1:48948 changed flags via RPC: fault_crash_on_handle_tc_fetch_data from '0' to '1.0'
I20240502 01:56:30.691069 32651 heartbeater.cc:347] Connected to a master server at 127.27.215.190:38521
I20240502 01:56:30.691474 32651 heartbeater.cc:464] Registering TS with master...
I20240502 01:56:30.692448 32651 heartbeater.cc:511] Master 127.27.215.190:38521 requested a full tablet report, sending...
I20240502 01:56:30.693588 32656 ts_tablet_manager.cc:902] T dbcb6ed7253c46d097c5a9f149c7ea0a P 4175dc9969ec4693813498c1451e5eff: Initiating tablet copy from peer 5a57b600a3564373a7424d7dccfe4f18 (127.27.215.129:38469)
I20240502 01:56:30.694219 32428 ts_manager.cc:194] Registered new tserver with Master: 4175dc9969ec4693813498c1451e5eff (127.27.215.130:43129)
I20240502 01:56:30.695708 32656 tablet_copy_client.cc:308] T dbcb6ed7253c46d097c5a9f149c7ea0a P 4175dc9969ec4693813498c1451e5eff: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:38469
I20240502 01:56:30.696094 32428 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.215.130:55341
I20240502 01:56:30.706962 32235 tablet_copy_service.cc:140] P 5a57b600a3564373a7424d7dccfe4f18: Received BeginTabletCopySession request for tablet dbcb6ed7253c46d097c5a9f149c7ea0a from peer 4175dc9969ec4693813498c1451e5eff ({username='slave'} at 127.27.215.130:59467)
I20240502 01:56:30.707167 32235 tablet_copy_service.cc:161] P 5a57b600a3564373a7424d7dccfe4f18: Beginning new tablet copy session on tablet dbcb6ed7253c46d097c5a9f149c7ea0a from peer 4175dc9969ec4693813498c1451e5eff at {username='slave'} at 127.27.215.130:59467: session id = 4175dc9969ec4693813498c1451e5eff-dbcb6ed7253c46d097c5a9f149c7ea0a
I20240502 01:56:30.709847 32235 tablet_copy_source_session.cc:205] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:56:30.714634 32656 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dbcb6ed7253c46d097c5a9f149c7ea0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:30.726709 32656 tablet_copy_client.cc:783] T dbcb6ed7253c46d097c5a9f149c7ea0a P 4175dc9969ec4693813498c1451e5eff: tablet copy: Starting download of 0 data blocks...
I20240502 01:56:30.727075 32656 tablet_copy_client.cc:647] T dbcb6ed7253c46d097c5a9f149c7ea0a P 4175dc9969ec4693813498c1451e5eff: tablet copy: Starting download of 1 WAL segments...
W20240502 01:56:30.728906 32235 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20240502 01:56:30.729025 32235 fault_injection.cc:44] THIS SERVER MAY CRASH!
E20240502 01:56:30.729100 32235 fault_injection.cc:59] injecting fault for kudu (pid 32133): FLAGS_fault_crash_on_handle_tc_fetch_data (process will exit)
W20240502 01:56:30.750137 32656 ts_tablet_manager.cc:980] T dbcb6ed7253c46d097c5a9f149c7ea0a P 4175dc9969ec4693813498c1451e5eff: Tablet Copy: Unable to fetch data from remote peer 5a57b600a3564373a7424d7dccfe4f18 (127.27.215.129:38469): Network error: Unable to download WAL segment with seq. number 1: unable to fetch data from remote: recv got EOF from 127.27.215.129:38469 (error 108)
I20240502 01:56:30.750346 32656 tablet_replica.cc:330] T dbcb6ed7253c46d097c5a9f149c7ea0a P 4175dc9969ec4693813498c1451e5eff: stopping tablet replica
I20240502 01:56:30.750602 32656 raft_consensus.cc:2229] T dbcb6ed7253c46d097c5a9f149c7ea0a P 4175dc9969ec4693813498c1451e5eff [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20240502 01:56:30.750787 32656 raft_consensus.cc:2258] T dbcb6ed7253c46d097c5a9f149c7ea0a P 4175dc9969ec4693813498c1451e5eff [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
W20240502 01:56:30.752161 32656 tablet_copy_client.cc:1108] T dbcb6ed7253c46d097c5a9f149c7ea0a P 4175dc9969ec4693813498c1451e5eff: tablet copy: Unable to close tablet copy session: Network error: failure ending tablet copy session: Client connection negotiation failed: client connection to 127.27.215.129:38469: connect: Connection refused (error 111)
W20240502 01:56:30.753139 32656 tablet_metadata.cc:476] failed to load DataDirGroup from superblock: Already present: tried to load directory group for tablet dbcb6ed7253c46d097c5a9f149c7ea0a but one is already registered
I20240502 01:56:30.753454 32656 ts_tablet_manager.cc:1875] T dbcb6ed7253c46d097c5a9f149c7ea0a P 4175dc9969ec4693813498c1451e5eff: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:56:30.758460 32656 ts_tablet_manager.cc:1888] T dbcb6ed7253c46d097c5a9f149c7ea0a P 4175dc9969ec4693813498c1451e5eff: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.0
I20240502 01:56:30.758680 32656 log.cc:1196] T dbcb6ed7253c46d097c5a9f149c7ea0a P 4175dc9969ec4693813498c1451e5eff: Deleting WAL directory at /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-1/wal/wals/dbcb6ed7253c46d097c5a9f149c7ea0a
I20240502 01:56:30.761929 28510 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ga2ld/build/asan/bin/kudu
/tmp/dist-test-task7ga2ld/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.215.129:38469
--local_ip_for_outbound_sockets=127.27.215.129
--tserver_master_addrs=127.27.215.190:38521
--webserver_port=45591
--webserver_interface=127.27.215.129
--builtin_ntp_servers=127.27.215.148:41171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240502 01:56:31.115100 32662 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:56:31.115445 32662 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:56:31.115590 32662 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:56:31.123555 32662 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:56:31.123816 32662 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.215.129
I20240502 01:56:31.133266 32662 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.215.148:41171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.215.129:38469
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.215.129
--webserver_port=45591
--tserver_master_addrs=127.27.215.190:38521
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.215.129
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 02 May 2024 01:43:22 UTC on efd1337a2aa3
build id 83
ASAN enabled
I20240502 01:56:31.134768 32662 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:56:31.136737 32662 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:56:31.149894 32667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:31.149839 32668 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:31.149853 32670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:56:31.150935 32662 server_base.cc:1034] running on GCE node
I20240502 01:56:31.151640 32662 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:56:31.152675 32662 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:56:31.153923 32662 hybrid_clock.cc:648] HybridClock initialized: now 1714614991153854 us; error 44 us; skew 500 ppm
I20240502 01:56:31.154266 32662 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:56:31.156749 32662 webserver.cc:460] Webserver started at http://127.27.215.129:45591/ using document root <none> and password file <none>
I20240502 01:56:31.157603 32662 fs_manager.cc:359] Metadata directory not provided
I20240502 01:56:31.157770 32662 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:56:31.164218 32662 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20240502 01:56:31.167563 32676 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:31.169226 32662 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20240502 01:56:31.169472 32662 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-0/wal
uuid: "5a57b600a3564373a7424d7dccfe4f18"
format_stamp: "Formatted at 2024-05-02 01:56:27 on dist-test-slave-v8sz"
I20240502 01:56:31.170476 32662 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:56:31.197811 32662 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:56:31.198755 32662 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:56:31.199049 32662 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:56:31.200099 32662 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:56:31.202312 32683 ts_tablet_manager.cc:522] Loading tablet metadata (0/1 complete)
I20240502 01:56:31.208119 32662 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240502 01:56:31.208287 32662 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.001s
I20240502 01:56:31.208438 32662 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240502 01:56:31.211575 32662 ts_tablet_manager.cc:590] Registered 1 tablets
I20240502 01:56:31.211676 32662 ts_tablet_manager.cc:569] Time spent register tablets: real 0.003s user 0.000s sys 0.001s
I20240502 01:56:31.212069 32683 tablet_bootstrap.cc:492] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18: Bootstrap starting.
I20240502 01:56:31.260133 32662 rpc_server.cc:307] RPC server started. Bound to: 127.27.215.129:38469
I20240502 01:56:31.260156 322 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.215.129:38469 every 8 connection(s)
I20240502 01:56:31.262034 32662 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714614966221093-28510-0/minicluster-data/ts-0/data/info.pb
I20240502 01:56:31.266929 28510 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ga2ld/build/asan/bin/kudu as pid 32662
I20240502 01:56:31.279050 323 heartbeater.cc:347] Connected to a master server at 127.27.215.190:38521
I20240502 01:56:31.279455 323 heartbeater.cc:464] Registering TS with master...
I20240502 01:56:31.280769 323 heartbeater.cc:511] Master 127.27.215.190:38521 requested a full tablet report, sending...
I20240502 01:56:31.283851 32428 ts_manager.cc:194] Re-registered known tserver with Master: 5a57b600a3564373a7424d7dccfe4f18 (127.27.215.129:38469)
I20240502 01:56:31.285046 32428 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.215.129:54235
I20240502 01:56:31.311403 32683 log.cc:824] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18: Log is configured to *not* fsync() on all Append() calls
I20240502 01:56:31.699451 32651 heartbeater.cc:503] Master 127.27.215.190:38521 was elected leader, sending a full tablet report...
W20240502 01:56:31.702268 32428 catalog_manager.cc:5397] Tablet dbcb6ed7253c46d097c5a9f149c7ea0a (table test-workload [id=605598abfcef4473a281e384b830b1d5]) has failed on TS 4175dc9969ec4693813498c1451e5eff (127.27.215.130:43129): Network error: Unable to download WAL segment with seq. number 1: unable to fetch data from remote: recv got EOF from 127.27.215.129:38469 (error 108)
I20240502 01:56:31.861977 32683 tablet_bootstrap.cc:492] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18: Bootstrap replayed 1/1 log segments. Stats: ops{read=212 overwritten=0 applied=212 ignored=0} inserts{seen=10550 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:56:31.862624 32683 tablet_bootstrap.cc:492] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18: Bootstrap complete.
I20240502 01:56:31.863857 32683 ts_tablet_manager.cc:1367] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18: Time spent bootstrapping tablet: real 0.652s user 0.588s sys 0.060s
I20240502 01:56:31.868460 32683 raft_consensus.cc:348] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a57b600a3564373a7424d7dccfe4f18" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38469 } }
I20240502 01:56:31.869266 32683 raft_consensus.cc:729] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a57b600a3564373a7424d7dccfe4f18, State: Initialized, Role: FOLLOWER
I20240502 01:56:31.869921 32683 consensus_queue.cc:260] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 212, Last appended: 1.212, Last appended by leader: 212, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a57b600a3564373a7424d7dccfe4f18" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38469 } }
I20240502 01:56:31.870134 32683 raft_consensus.cc:388] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:31.870227 32683 raft_consensus.cc:482] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:31.870379 32683 raft_consensus.cc:3037] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:56:31.874325 32683 raft_consensus.cc:504] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a57b600a3564373a7424d7dccfe4f18" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38469 } }
I20240502 01:56:31.874841 32683 leader_election.cc:302] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a57b600a3564373a7424d7dccfe4f18; no voters:
I20240502 01:56:31.875399 32683 leader_election.cc:288] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 01:56:31.875584 330 raft_consensus.cc:2781] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:56:31.876240 330 raft_consensus.cc:686] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18 [term 2 LEADER]: Becoming Leader. State: Replica: 5a57b600a3564373a7424d7dccfe4f18, State: Running, Role: LEADER
I20240502 01:56:31.876569 323 heartbeater.cc:503] Master 127.27.215.190:38521 was elected leader, sending a full tablet report...
I20240502 01:56:31.876911 330 consensus_queue.cc:237] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 212, Committed index: 212, Last appended: 1.212, Last appended by leader: 212, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a57b600a3564373a7424d7dccfe4f18" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38469 } }
I20240502 01:56:31.877204 32683 ts_tablet_manager.cc:1398] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18: Time spent starting tablet: real 0.013s user 0.006s sys 0.008s
I20240502 01:56:31.880649 32428 catalog_manager.cc:5484] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "5a57b600a3564373a7424d7dccfe4f18" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a57b600a3564373a7424d7dccfe4f18" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38469 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:31.887645 339 ts_tablet_manager.cc:902] T dbcb6ed7253c46d097c5a9f149c7ea0a P 4175dc9969ec4693813498c1451e5eff: Initiating tablet copy from peer 5a57b600a3564373a7424d7dccfe4f18 (127.27.215.129:38469)
I20240502 01:56:31.889060 339 tablet_copy_client.cc:308] T dbcb6ed7253c46d097c5a9f149c7ea0a P 4175dc9969ec4693813498c1451e5eff: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:38469
I20240502 01:56:31.895709 32766 tablet_copy_service.cc:140] P 5a57b600a3564373a7424d7dccfe4f18: Received BeginTabletCopySession request for tablet dbcb6ed7253c46d097c5a9f149c7ea0a from peer 4175dc9969ec4693813498c1451e5eff ({username='slave'} at 127.27.215.130:50897)
I20240502 01:56:31.895983 32766 tablet_copy_service.cc:161] P 5a57b600a3564373a7424d7dccfe4f18: Beginning new tablet copy session on tablet dbcb6ed7253c46d097c5a9f149c7ea0a from peer 4175dc9969ec4693813498c1451e5eff at {username='slave'} at 127.27.215.130:50897: session id = 4175dc9969ec4693813498c1451e5eff-dbcb6ed7253c46d097c5a9f149c7ea0a
I20240502 01:56:31.898586 32766 tablet_copy_source_session.cc:205] T dbcb6ed7253c46d097c5a9f149c7ea0a P 5a57b600a3564373a7424d7dccfe4f18: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:56:31.900252 339 ts_tablet_manager.cc:1875] T dbcb6ed7253c46d097c5a9f149c7ea0a P 4175dc9969ec4693813498c1451e5eff: Deleting tablet data with delete state TABLET_DATA_COPYING
I20240502 01:56:31.905304 339 ts_tablet_manager.cc:1888] T dbcb6ed7253c46d097c5a9f149c7ea0a P 4175dc9969ec4693813498c1451e5eff: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.0
I20240502 01:56:31.905633 339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dbcb6ed7253c46d097c5a9f149c7ea0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:31.907975 339 tablet_copy_client.cc:783] T dbcb6ed7253c46d097c5a9f149c7ea0a P 4175dc9969ec4693813498c1451e5eff: tablet copy: Starting download of 0 data blocks...
I20240502 01:56:31.908215 339 tablet_copy_client.cc:647] T dbcb6ed7253c46d097c5a9f149c7ea0a P 4175dc9969ec4693813498c1451e5eff: tablet copy: Starting download of 1 WAL segments...
I20240502 01:56:31.912520 339 tablet_copy_client.cc:523] T dbcb6ed7253c46d097c5a9f149c7ea0a P 4175dc9969ec4693813498c1451e5eff: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:56:31.915441 339 tablet_bootstrap.cc:492] T dbcb6ed7253c46d097c5a9f149c7ea0a P 4175dc9969ec4693813498c1451e5eff: Bootstrap starting.
I20240502 01:56:31.976670 339 log.cc:824] T dbcb6ed7253c46d097c5a9f149c7ea0a P 4175dc9969ec4693813498c1451e5eff: Log is configured to *not* fsync() on all Append() calls
I20240502 01:56:32.515358 339 tablet_bootstrap.cc:492] T dbcb6ed7253c46d097c5a9f149c7ea0a P 4175dc9969ec4693813498c1451e5eff: Bootstrap replayed 1/1 log segments. Stats: ops{read=213 overwritten=0 applied=213 ignored=0} inserts{seen=10550 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:56:32.515974 339 tablet_bootstrap.cc:492] T dbcb6ed7253c46d097c5a9f149c7ea0a P 4175dc9969ec4693813498c1451e5eff: Bootstrap complete.
I20240502 01:56:32.516615 339 ts_tablet_manager.cc:1367] T dbcb6ed7253c46d097c5a9f149c7ea0a P 4175dc9969ec4693813498c1451e5eff: Time spent bootstrapping tablet: real 0.601s user 0.523s sys 0.076s
I20240502 01:56:32.521302 339 raft_consensus.cc:348] T dbcb6ed7253c46d097c5a9f149c7ea0a P 4175dc9969ec4693813498c1451e5eff [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a57b600a3564373a7424d7dccfe4f18" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38469 } }
I20240502 01:56:32.521737 339 raft_consensus.cc:729] T dbcb6ed7253c46d097c5a9f149c7ea0a P 4175dc9969ec4693813498c1451e5eff [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 4175dc9969ec4693813498c1451e5eff, State: Initialized, Role: NON_PARTICIPANT
I20240502 01:56:32.522382 339 consensus_queue.cc:260] T dbcb6ed7253c46d097c5a9f149c7ea0a P 4175dc9969ec4693813498c1451e5eff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 213, Last appended: 2.213, Last appended by leader: 213, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a57b600a3564373a7424d7dccfe4f18" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38469 } }
I20240502 01:56:32.524194 339 ts_tablet_manager.cc:1398] T dbcb6ed7253c46d097c5a9f149c7ea0a P 4175dc9969ec4693813498c1451e5eff: Time spent starting tablet: real 0.007s user 0.009s sys 0.000s
I20240502 01:56:32.525206 32766 tablet_copy_service.cc:342] P 5a57b600a3564373a7424d7dccfe4f18: Request end of tablet copy session 4175dc9969ec4693813498c1451e5eff-dbcb6ed7253c46d097c5a9f149c7ea0a received from {username='slave'} at 127.27.215.130:50897
I20240502 01:56:32.525381 32766 tablet_copy_service.cc:433] P 5a57b600a3564373a7424d7dccfe4f18: ending tablet copy session 4175dc9969ec4693813498c1451e5eff-dbcb6ed7253c46d097c5a9f149c7ea0a on tablet dbcb6ed7253c46d097c5a9f149c7ea0a with peer 4175dc9969ec4693813498c1451e5eff
I20240502 01:56:32.535863 28510 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task7ga2ld/build/asan/bin/kudu pid 32662
I20240502 01:56:32.536911 318 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 01:56:32.638485 28510 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ga2ld/build/asan/bin/kudu with pid 32662
I20240502 01:56:32.659982 28510 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task7ga2ld/build/asan/bin/kudu pid 32523
I20240502 01:56:32.661309 32646 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 01:56:32.764546 28510 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ga2ld/build/asan/bin/kudu with pid 32523
I20240502 01:56:32.784509 28510 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task7ga2ld/build/asan/bin/kudu pid 32403
I20240502 01:56:32.785732 32465 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 01:56:32.891238 28510 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ga2ld/build/asan/bin/kudu with pid 32403
2024-05-02T01:56:32Z chronyd exiting
[ OK ] TabletCopyClientSessionITest.TestCopyFromCrashedSource (6656 ms)
[ RUN ] TabletCopyClientSessionITest.TestTabletCopyWithBusySource
2024-05-02T01:56:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-02T01:56:32Z Disabled control of system clock
I20240502 01:56:32.965801 28510 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ga2ld/build/asan/bin/kudu
/tmp/dist-test-task7ga2ld/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.215.190:34609
--webserver_interface=127.27.215.190
--webserver_port=0
--builtin_ntp_servers=127.27.215.148:44951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.215.190:34609
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240502 01:56:33.306350 354 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:56:33.306671 354 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:56:33.306757 354 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:56:33.314541 354 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 01:56:33.314677 354 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:56:33.314721 354 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 01:56:33.314772 354 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 01:56:33.324193 354 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.215.148:44951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.27.215.190:34609
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.215.190:34609
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.215.190
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 02 May 2024 01:43:22 UTC on efd1337a2aa3
build id 83
ASAN enabled
I20240502 01:56:33.325572 354 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:56:33.327337 354 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:56:33.338891 359 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:33.338843 360 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:33.338915 362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:56:33.339520 354 server_base.cc:1034] running on GCE node
I20240502 01:56:33.340569 354 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:56:33.342203 354 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:56:33.343458 354 hybrid_clock.cc:648] HybridClock initialized: now 1714614993343389 us; error 48 us; skew 500 ppm
I20240502 01:56:33.343814 354 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:56:33.346364 354 webserver.cc:460] Webserver started at http://127.27.215.190:38857/ using document root <none> and password file <none>
I20240502 01:56:33.347213 354 fs_manager.cc:359] Metadata directory not provided
I20240502 01:56:33.347373 354 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:56:33.347702 354 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:56:33.350697 354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/master-0/data/instance:
uuid: "7e16d951567441c494dc380efafb276b"
format_stamp: "Formatted at 2024-05-02 01:56:33 on dist-test-slave-v8sz"
I20240502 01:56:33.351603 354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/master-0/wal/instance:
uuid: "7e16d951567441c494dc380efafb276b"
format_stamp: "Formatted at 2024-05-02 01:56:33 on dist-test-slave-v8sz"
I20240502 01:56:33.358008 354 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20240502 01:56:33.362484 368 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:33.364339 354 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20240502 01:56:33.364552 354 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/master-0/data,/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/master-0/wal
uuid: "7e16d951567441c494dc380efafb276b"
format_stamp: "Formatted at 2024-05-02 01:56:33 on dist-test-slave-v8sz"
I20240502 01:56:33.364768 354 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:56:33.382719 354 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:56:33.383599 354 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:56:33.383885 354 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:56:33.403045 354 rpc_server.cc:307] RPC server started. Bound to: 127.27.215.190:34609
I20240502 01:56:33.403077 420 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.215.190:34609 every 8 connection(s)
I20240502 01:56:33.404945 354 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/master-0/data/info.pb
I20240502 01:56:33.408725 28510 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ga2ld/build/asan/bin/kudu as pid 354
I20240502 01:56:33.408959 28510 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/master-0/wal/instance
I20240502 01:56:33.409263 421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:33.423976 421 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b: Bootstrap starting.
I20240502 01:56:33.427695 421 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b: Neither blocks nor log segments found. Creating new log.
I20240502 01:56:33.428792 421 log.cc:824] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b: Log is configured to *not* fsync() on all Append() calls
I20240502 01:56:33.431775 421 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b: No bootstrap required, opened a new log
I20240502 01:56:33.439167 421 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e16d951567441c494dc380efafb276b" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 34609 } }
I20240502 01:56:33.439591 421 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:56:33.439687 421 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e16d951567441c494dc380efafb276b, State: Initialized, Role: FOLLOWER
I20240502 01:56:33.440339 421 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e16d951567441c494dc380efafb276b" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 34609 } }
I20240502 01:56:33.440580 421 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:33.440690 421 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:33.440829 421 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:56:33.443334 421 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e16d951567441c494dc380efafb276b" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 34609 } }
I20240502 01:56:33.443998 421 leader_election.cc:302] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7e16d951567441c494dc380efafb276b; no voters:
I20240502 01:56:33.444715 421 leader_election.cc:288] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:56:33.444849 426 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:56:33.445576 426 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b [term 1 LEADER]: Becoming Leader. State: Replica: 7e16d951567441c494dc380efafb276b, State: Running, Role: LEADER
I20240502 01:56:33.446213 426 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e16d951567441c494dc380efafb276b" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 34609 } }
I20240502 01:56:33.447005 421 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b [sys.catalog]: configured and running, proceeding with master startup.
I20240502 01:56:33.449523 428 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7e16d951567441c494dc380efafb276b. Latest consensus state: current_term: 1 leader_uuid: "7e16d951567441c494dc380efafb276b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e16d951567441c494dc380efafb276b" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 34609 } } }
I20240502 01:56:33.449975 428 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b [sys.catalog]: This master's current role is: LEADER
I20240502 01:56:33.449474 427 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7e16d951567441c494dc380efafb276b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e16d951567441c494dc380efafb276b" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 34609 } } }
I20240502 01:56:33.450575 427 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b [sys.catalog]: This master's current role is: LEADER
I20240502 01:56:33.451668 432 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 01:56:33.457599 432 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 01:56:33.467769 432 catalog_manager.cc:1347] Generated new cluster ID: 6e604f3253264a46a5f25601ca7670fa
I20240502 01:56:33.467909 432 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 01:56:33.503229 432 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 01:56:33.505501 432 catalog_manager.cc:1504] Loading token signing keys...
I20240502 01:56:33.517112 432 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b: Generated new TSK 0
I20240502 01:56:33.518193 432 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 01:56:33.537962 28510 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ga2ld/build/asan/bin/kudu
/tmp/dist-test-task7ga2ld/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.215.129:0
--local_ip_for_outbound_sockets=127.27.215.129
--webserver_interface=127.27.215.129
--webserver_port=0
--tserver_master_addrs=127.27.215.190:34609
--builtin_ntp_servers=127.27.215.148:44951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=20 with env {}
W20240502 01:56:33.896731 445 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:56:33.897085 445 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:56:33.897246 445 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:56:33.905026 445 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:56:33.905283 445 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.215.129
I20240502 01:56:33.914856 445 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.215.148:44951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.215.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.215.129
--webserver_port=0
--tserver_master_addrs=127.27.215.190:34609
--num_tablets_to_copy_simultaneously=20
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.215.129
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 02 May 2024 01:43:22 UTC on efd1337a2aa3
build id 83
ASAN enabled
I20240502 01:56:33.916302 445 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:56:33.918200 445 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:56:33.930572 450 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:33.930610 451 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:33.930572 453 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:56:33.931331 445 server_base.cc:1034] running on GCE node
I20240502 01:56:33.931998 445 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:56:33.933020 445 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:56:33.934289 445 hybrid_clock.cc:648] HybridClock initialized: now 1714614993934223 us; error 40 us; skew 500 ppm
I20240502 01:56:33.934649 445 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:56:33.937173 445 webserver.cc:460] Webserver started at http://127.27.215.129:46235/ using document root <none> and password file <none>
I20240502 01:56:33.938000 445 fs_manager.cc:359] Metadata directory not provided
I20240502 01:56:33.938145 445 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:56:33.938468 445 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:56:33.941435 445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-0/data/instance:
uuid: "c3d82e05ada14e6c9393bbaae8d88985"
format_stamp: "Formatted at 2024-05-02 01:56:33 on dist-test-slave-v8sz"
I20240502 01:56:33.942272 445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-0/wal/instance:
uuid: "c3d82e05ada14e6c9393bbaae8d88985"
format_stamp: "Formatted at 2024-05-02 01:56:33 on dist-test-slave-v8sz"
I20240502 01:56:33.948333 445 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20240502 01:56:33.952108 459 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:33.953706 445 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20240502 01:56:33.953891 445 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-0/wal
uuid: "c3d82e05ada14e6c9393bbaae8d88985"
format_stamp: "Formatted at 2024-05-02 01:56:33 on dist-test-slave-v8sz"
I20240502 01:56:33.954092 445 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:56:33.980542 445 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:56:33.981508 445 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:56:33.981864 445 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:56:33.982908 445 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:56:33.984544 445 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:56:33.984630 445 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:33.984778 445 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:56:33.984838 445 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:34.016043 445 rpc_server.cc:307] RPC server started. Bound to: 127.27.215.129:38143
I20240502 01:56:34.016050 571 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.215.129:38143 every 8 connection(s)
I20240502 01:56:34.017649 445 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-0/data/info.pb
I20240502 01:56:34.023069 28510 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ga2ld/build/asan/bin/kudu as pid 445
I20240502 01:56:34.023303 28510 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-0/wal/instance
I20240502 01:56:34.027299 28510 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ga2ld/build/asan/bin/kudu
/tmp/dist-test-task7ga2ld/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.215.130:0
--local_ip_for_outbound_sockets=127.27.215.130
--webserver_interface=127.27.215.130
--webserver_port=0
--tserver_master_addrs=127.27.215.190:34609
--builtin_ntp_servers=127.27.215.148:44951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=20 with env {}
I20240502 01:56:34.033830 572 heartbeater.cc:347] Connected to a master server at 127.27.215.190:34609
I20240502 01:56:34.034232 572 heartbeater.cc:464] Registering TS with master...
I20240502 01:56:34.035250 572 heartbeater.cc:511] Master 127.27.215.190:34609 requested a full tablet report, sending...
I20240502 01:56:34.037954 386 ts_manager.cc:194] Registered new tserver with Master: c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129:38143)
I20240502 01:56:34.040426 386 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.215.129:53845
W20240502 01:56:34.378822 576 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:56:34.379151 576 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:56:34.379253 576 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:56:34.387125 576 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:56:34.387334 576 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.215.130
I20240502 01:56:34.396824 576 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.215.148:44951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.215.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.215.130
--webserver_port=0
--tserver_master_addrs=127.27.215.190:34609
--num_tablets_to_copy_simultaneously=20
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.215.130
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 02 May 2024 01:43:22 UTC on efd1337a2aa3
build id 83
ASAN enabled
I20240502 01:56:34.398211 576 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:56:34.399994 576 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:56:34.414340 582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:34.414315 581 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:34.414969 584 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:56:34.415254 576 server_base.cc:1034] running on GCE node
I20240502 01:56:34.415940 576 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:56:34.416954 576 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:56:34.418181 576 hybrid_clock.cc:648] HybridClock initialized: now 1714614994418098 us; error 59 us; skew 500 ppm
I20240502 01:56:34.418517 576 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:56:34.420895 576 webserver.cc:460] Webserver started at http://127.27.215.130:43997/ using document root <none> and password file <none>
I20240502 01:56:34.421694 576 fs_manager.cc:359] Metadata directory not provided
I20240502 01:56:34.421830 576 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:56:34.422137 576 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:56:34.424960 576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-1/data/instance:
uuid: "617b001dc8134c21a5ace2b0b230818e"
format_stamp: "Formatted at 2024-05-02 01:56:34 on dist-test-slave-v8sz"
I20240502 01:56:34.425779 576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-1/wal/instance:
uuid: "617b001dc8134c21a5ace2b0b230818e"
format_stamp: "Formatted at 2024-05-02 01:56:34 on dist-test-slave-v8sz"
I20240502 01:56:34.431475 576 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20240502 01:56:34.435528 590 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:34.437004 576 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20240502 01:56:34.437335 576 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-1/wal
uuid: "617b001dc8134c21a5ace2b0b230818e"
format_stamp: "Formatted at 2024-05-02 01:56:34 on dist-test-slave-v8sz"
I20240502 01:56:34.437630 576 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:56:34.456857 576 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:56:34.457873 576 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:56:34.458191 576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:56:34.459301 576 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:56:34.460988 576 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:56:34.461078 576 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:34.461225 576 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:56:34.461289 576 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:34.495834 576 rpc_server.cc:307] RPC server started. Bound to: 127.27.215.130:36617
I20240502 01:56:34.495913 703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.215.130:36617 every 8 connection(s)
I20240502 01:56:34.497241 576 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-1/data/info.pb
I20240502 01:56:34.504400 28510 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ga2ld/build/asan/bin/kudu as pid 576
I20240502 01:56:34.504647 28510 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-1/wal/instance
I20240502 01:56:34.511781 704 heartbeater.cc:347] Connected to a master server at 127.27.215.190:34609
I20240502 01:56:34.512090 704 heartbeater.cc:464] Registering TS with master...
I20240502 01:56:34.512939 704 heartbeater.cc:511] Master 127.27.215.190:34609 requested a full tablet report, sending...
I20240502 01:56:34.514441 386 ts_manager.cc:194] Registered new tserver with Master: 617b001dc8134c21a5ace2b0b230818e (127.27.215.130:36617)
I20240502 01:56:34.515280 386 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.215.130:33179
I20240502 01:56:34.521107 28510 external_mini_cluster.cc:930] 2 TS(s) registered with all masters
I20240502 01:56:34.535701 28510 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task7ga2ld/build/asan/bin/kudu pid 576
I20240502 01:56:34.544603 699 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 01:56:34.626735 28510 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ga2ld/build/asan/bin/kudu with pid 576
I20240502 01:56:34.645053 28510 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task7ga2ld/build/asan/bin/kudu pid 354
I20240502 01:56:34.646463 416 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 01:56:34.748005 28510 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ga2ld/build/asan/bin/kudu with pid 354
I20240502 01:56:34.769742 28510 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ga2ld/build/asan/bin/kudu
/tmp/dist-test-task7ga2ld/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.215.190:34609
--webserver_interface=127.27.215.190
--webserver_port=38857
--builtin_ntp_servers=127.27.215.148:44951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.215.190:34609
--master_tombstone_evicted_tablet_replicas=false with env {}
I20240502 01:56:35.044170 572 heartbeater.cc:503] Master 127.27.215.190:34609 was elected leader, sending a full tablet report...
W20240502 01:56:35.046041 572 heartbeater.cc:644] Failed to heartbeat to 127.27.215.190:34609 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.27.215.190:34609: connect: Connection refused (error 111)
W20240502 01:56:35.121543 716 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:56:35.121881 716 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:56:35.121968 716 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:56:35.129865 716 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 01:56:35.129987 716 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:56:35.130033 716 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 01:56:35.130084 716 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 01:56:35.139653 716 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.215.148:44951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.27.215.190:34609
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.215.190:34609
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.215.190
--webserver_port=38857
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 02 May 2024 01:43:22 UTC on efd1337a2aa3
build id 83
ASAN enabled
I20240502 01:56:35.140996 716 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:56:35.142800 716 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:56:35.153900 722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:35.153918 725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:35.153926 723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:56:35.154826 716 server_base.cc:1034] running on GCE node
I20240502 01:56:35.155647 716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:56:35.157156 716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:56:35.158398 716 hybrid_clock.cc:648] HybridClock initialized: now 1714614995158334 us; error 48 us; skew 500 ppm
I20240502 01:56:35.158753 716 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:56:35.161196 716 webserver.cc:460] Webserver started at http://127.27.215.190:38857/ using document root <none> and password file <none>
I20240502 01:56:35.162057 716 fs_manager.cc:359] Metadata directory not provided
I20240502 01:56:35.162222 716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:56:35.167819 716 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20240502 01:56:35.170984 731 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:35.172497 716 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20240502 01:56:35.172698 716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/master-0/data,/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/master-0/wal
uuid: "7e16d951567441c494dc380efafb276b"
format_stamp: "Formatted at 2024-05-02 01:56:33 on dist-test-slave-v8sz"
I20240502 01:56:35.173651 716 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:56:35.208562 716 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:56:35.209528 716 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:56:35.209832 716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:56:35.228993 716 rpc_server.cc:307] RPC server started. Bound to: 127.27.215.190:34609
I20240502 01:56:35.229013 783 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.215.190:34609 every 8 connection(s)
I20240502 01:56:35.230667 716 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/master-0/data/info.pb
I20240502 01:56:35.233067 28510 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ga2ld/build/asan/bin/kudu as pid 716
I20240502 01:56:35.237831 784 sys_catalog.cc:263] Verifying existing consensus state
I20240502 01:56:35.241813 784 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b: Bootstrap starting.
I20240502 01:56:35.259881 784 log.cc:824] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b: Log is configured to *not* fsync() on all Append() calls
I20240502 01:56:35.268949 784 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:56:35.269585 784 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b: Bootstrap complete.
I20240502 01:56:35.277566 784 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e16d951567441c494dc380efafb276b" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 34609 } }
I20240502 01:56:35.278414 784 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e16d951567441c494dc380efafb276b, State: Initialized, Role: FOLLOWER
I20240502 01:56:35.279076 784 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e16d951567441c494dc380efafb276b" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 34609 } }
I20240502 01:56:35.279302 784 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:35.279392 784 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:35.279541 784 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:56:35.283423 784 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e16d951567441c494dc380efafb276b" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 34609 } }
I20240502 01:56:35.283941 784 leader_election.cc:302] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7e16d951567441c494dc380efafb276b; no voters:
I20240502 01:56:35.284529 784 leader_election.cc:288] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 01:56:35.284723 789 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:56:35.285724 789 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b [term 2 LEADER]: Becoming Leader. State: Replica: 7e16d951567441c494dc380efafb276b, State: Running, Role: LEADER
I20240502 01:56:35.286293 789 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e16d951567441c494dc380efafb276b" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 34609 } }
I20240502 01:56:35.286968 784 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b [sys.catalog]: configured and running, proceeding with master startup.
I20240502 01:56:35.289285 790 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "7e16d951567441c494dc380efafb276b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e16d951567441c494dc380efafb276b" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 34609 } } }
I20240502 01:56:35.290434 790 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b [sys.catalog]: This master's current role is: LEADER
I20240502 01:56:35.291067 791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7e16d951567441c494dc380efafb276b. Latest consensus state: current_term: 2 leader_uuid: "7e16d951567441c494dc380efafb276b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e16d951567441c494dc380efafb276b" member_type: VOTER last_known_addr { host: "127.27.215.190" port: 34609 } } }
I20240502 01:56:35.291564 791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b [sys.catalog]: This master's current role is: LEADER
I20240502 01:56:35.292306 798 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 01:56:35.298733 798 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 01:56:35.300637 798 catalog_manager.cc:1259] Loaded cluster ID: 6e604f3253264a46a5f25601ca7670fa
I20240502 01:56:35.300776 798 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 01:56:35.303803 798 catalog_manager.cc:1504] Loading token signing keys...
I20240502 01:56:35.304998 798 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7e16d951567441c494dc380efafb276b: Loaded TSK: 0
I20240502 01:56:35.306349 798 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 01:56:36.053122 572 heartbeater.cc:347] Connected to a master server at 127.27.215.190:34609
I20240502 01:56:36.053455 572 heartbeater.cc:503] Master 127.27.215.190:34609 was elected leader, sending a full tablet report...
I20240502 01:56:36.055559 748 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" instance_seqno: 1714614994007911) as {username='slave'} at 127.27.215.129:38647; Asking this server to re-register.
I20240502 01:56:36.056396 572 heartbeater.cc:464] Registering TS with master...
I20240502 01:56:36.056677 572 heartbeater.cc:511] Master 127.27.215.190:34609 requested a full tablet report, sending...
I20240502 01:56:36.058080 748 ts_manager.cc:194] Registered new tserver with Master: c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129:38143)
I20240502 01:56:36.070030 28510 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20240502 01:56:36.070240 28510 test_util.cc:268] Using random seed: -373002415
I20240502 01:56:36.091903 748 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48430:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "<redacted>""\004\001\000fff\006\004\001\000\314\314\314\014\004\001\000233\023\004\001\000\230\231\231\031\004\001\000\376\377\377\037\004\001\000dff&\004\001\000\312\314\314,\004\001\0000333\004\001\000\226\231\2319\004\001\000\374\377\377?\004\001\000bffF\004\001\000\310\314\314L\004\001\000.33S\004\001\000\224\231\231Y\004\001\000\372\377\377_\004\001\000`fff\004\001\000\306\314\314l\004\001\000,33s\004\001\000\222\231\231y"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20240502 01:56:36.128314 497 tablet_service.cc:1467] Processing CreateTablet for tablet 0fcad6d06fdc4cc5865f1f94f9ad15cb (DEFAULT_TABLE table=test-workload [id=6a0a642d81a8444fb5180950ae868ab9]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1181116002
I20240502 01:56:36.130152 504 tablet_service.cc:1467] Processing CreateTablet for tablet f489372a5a044d8e937c22d47fbf012a (DEFAULT_TABLE table=test-workload [id=6a0a642d81a8444fb5180950ae868ab9]), partition=RANGE (key) PARTITION 322122546 <= VALUES < 429496728
I20240502 01:56:36.130965 504 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f489372a5a044d8e937c22d47fbf012a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:36.134471 497 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0fcad6d06fdc4cc5865f1f94f9ad15cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:36.128648 495 tablet_service.cc:1467] Processing CreateTablet for tablet ecdea67458ca42c3a200f3b30b82f071 (DEFAULT_TABLE table=test-workload [id=6a0a642d81a8444fb5180950ae868ab9]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1395864366
I20240502 01:56:36.128125 494 tablet_service.cc:1467] Processing CreateTablet for tablet afc558ecc01b4575ae5e8055f9499d89 (DEFAULT_TABLE table=test-workload [id=6a0a642d81a8444fb5180950ae868ab9]), partition=RANGE (key) PARTITION 1395864366 <= VALUES < 1503238548
I20240502 01:56:36.129235 492 tablet_service.cc:1467] Processing CreateTablet for tablet 24aa0d82fe9f4ca2889bccf2e63ec9c5 (DEFAULT_TABLE table=test-workload [id=6a0a642d81a8444fb5180950ae868ab9]), partition=RANGE (key) PARTITION 1610612730 <= VALUES < 1717986912
I20240502 01:56:36.129678 496 tablet_service.cc:1467] Processing CreateTablet for tablet e024604ddf064f14a75df50c286074c5 (DEFAULT_TABLE table=test-workload [id=6a0a642d81a8444fb5180950ae868ab9]), partition=RANGE (key) PARTITION 1181116002 <= VALUES < 1288490184
I20240502 01:56:36.130002 500 tablet_service.cc:1467] Processing CreateTablet for tablet 543e8b00ccf44f40a995150bdab2c4b6 (DEFAULT_TABLE table=test-workload [id=6a0a642d81a8444fb5180950ae868ab9]), partition=RANGE (key) PARTITION 751619274 <= VALUES < 858993456
I20240502 01:56:36.137385 495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ecdea67458ca42c3a200f3b30b82f071. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:36.137682 492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24aa0d82fe9f4ca2889bccf2e63ec9c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:36.133584 506 tablet_service.cc:1467] Processing CreateTablet for tablet 058c687b8c6744faa2136721a285b24d (DEFAULT_TABLE table=test-workload [id=6a0a642d81a8444fb5180950ae868ab9]), partition=RANGE (key) PARTITION 107374182 <= VALUES < 214748364
I20240502 01:56:36.136440 498 tablet_service.cc:1467] Processing CreateTablet for tablet fc2e63f8b5874c908d5ec98c8bbf6aa3 (DEFAULT_TABLE table=test-workload [id=6a0a642d81a8444fb5180950ae868ab9]), partition=RANGE (key) PARTITION 966367638 <= VALUES < 1073741820
I20240502 01:56:36.133877 507 tablet_service.cc:1467] Processing CreateTablet for tablet ce929e1dde744ca5a1fac80bc6dedd6e (DEFAULT_TABLE table=test-workload [id=6a0a642d81a8444fb5180950ae868ab9]), partition=RANGE (key) PARTITION VALUES < 107374182
I20240502 01:56:36.133656 505 tablet_service.cc:1467] Processing CreateTablet for tablet bbde935d2bc644dd9beb8a3d2e417658 (DEFAULT_TABLE table=test-workload [id=6a0a642d81a8444fb5180950ae868ab9]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 322122546
I20240502 01:56:36.136447 502 tablet_service.cc:1467] Processing CreateTablet for tablet c0eb986300e046a0bc8d76f833028ab8 (DEFAULT_TABLE table=test-workload [id=6a0a642d81a8444fb5180950ae868ab9]), partition=RANGE (key) PARTITION 536870910 <= VALUES < 644245092
I20240502 01:56:36.137015 501 tablet_service.cc:1467] Processing CreateTablet for tablet 061b85c3b39e4ad5a37aee8c2eedebe3 (DEFAULT_TABLE table=test-workload [id=6a0a642d81a8444fb5180950ae868ab9]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 751619274
I20240502 01:56:36.139331 494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afc558ecc01b4575ae5e8055f9499d89. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:36.134393 491 tablet_service.cc:1467] Processing CreateTablet for tablet 4bf45f2db51b49e08fd09bad98bfab7f (DEFAULT_TABLE table=test-workload [id=6a0a642d81a8444fb5180950ae868ab9]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1825361094
I20240502 01:56:36.129958 499 tablet_service.cc:1467] Processing CreateTablet for tablet 973e137d8ede43b98bfe6414e5d45b35 (DEFAULT_TABLE table=test-workload [id=6a0a642d81a8444fb5180950ae868ab9]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 966367638
I20240502 01:56:36.139146 503 tablet_service.cc:1467] Processing CreateTablet for tablet 3907fc0853ff48189e9f32b65742f5b6 (DEFAULT_TABLE table=test-workload [id=6a0a642d81a8444fb5180950ae868ab9]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 536870910
I20240502 01:56:36.140503 490 tablet_service.cc:1467] Processing CreateTablet for tablet 11e6a662c8154187918dd3b26a2a53c3 (DEFAULT_TABLE table=test-workload [id=6a0a642d81a8444fb5180950ae868ab9]), partition=RANGE (key) PARTITION 1825361094 <= VALUES < 1932735276
I20240502 01:56:36.140741 489 tablet_service.cc:1467] Processing CreateTablet for tablet c8c84eae62744f3e99ac4c75fdd796fb (DEFAULT_TABLE table=test-workload [id=6a0a642d81a8444fb5180950ae868ab9]), partition=RANGE (key) PARTITION 1932735276 <= VALUES < 2040109458
I20240502 01:56:36.141535 496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e024604ddf064f14a75df50c286074c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:36.141115 493 tablet_service.cc:1467] Processing CreateTablet for tablet 69cb274b201d46bca78efa7d53c0f7d1 (DEFAULT_TABLE table=test-workload [id=6a0a642d81a8444fb5180950ae868ab9]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1610612730
I20240502 01:56:36.141923 498 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc2e63f8b5874c908d5ec98c8bbf6aa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:36.141439 488 tablet_service.cc:1467] Processing CreateTablet for tablet c69ca6f4204a4d7badf4bf2e9923bdba (DEFAULT_TABLE table=test-workload [id=6a0a642d81a8444fb5180950ae868ab9]), partition=RANGE (key) PARTITION 2040109458 <= VALUES
I20240502 01:56:36.142696 503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3907fc0853ff48189e9f32b65742f5b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:36.142982 506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 058c687b8c6744faa2136721a285b24d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:36.143211 488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c69ca6f4204a4d7badf4bf2e9923bdba. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:36.143579 502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0eb986300e046a0bc8d76f833028ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:36.143887 499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 973e137d8ede43b98bfe6414e5d45b35. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:36.144111 491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bf45f2db51b49e08fd09bad98bfab7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:36.144410 489 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8c84eae62744f3e99ac4c75fdd796fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:36.145012 493 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69cb274b201d46bca78efa7d53c0f7d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:36.145298 505 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbde935d2bc644dd9beb8a3d2e417658. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:36.145717 490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11e6a662c8154187918dd3b26a2a53c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:36.146095 500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 543e8b00ccf44f40a995150bdab2c4b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:36.148326 507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce929e1dde744ca5a1fac80bc6dedd6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:36.152096 501 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 061b85c3b39e4ad5a37aee8c2eedebe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:36.213426 819 tablet_bootstrap.cc:492] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:36.216754 819 tablet_bootstrap.cc:654] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985: Neither blocks nor log segments found. Creating new log.
I20240502 01:56:36.218020 819 log.cc:824] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985: Log is configured to *not* fsync() on all Append() calls
I20240502 01:56:36.220688 819 tablet_bootstrap.cc:492] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985: No bootstrap required, opened a new log
I20240502 01:56:36.220975 819 ts_tablet_manager.cc:1367] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20240502 01:56:36.227756 819 raft_consensus.cc:348] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.228206 819 raft_consensus.cc:374] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:56:36.228327 819 raft_consensus.cc:729] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:36.229049 819 consensus_queue.cc:260] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.229298 819 raft_consensus.cc:388] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:36.229489 819 raft_consensus.cc:482] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:36.229666 819 raft_consensus.cc:3037] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:56:36.231917 819 raft_consensus.cc:504] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.232483 819 leader_election.cc:302] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:36.233148 819 leader_election.cc:288] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:56:36.233326 821 raft_consensus.cc:2781] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:56:36.235020 821 raft_consensus.cc:686] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:36.235246 819 ts_tablet_manager.cc:1398] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.014s user 0.011s sys 0.004s
I20240502 01:56:36.235672 819 tablet_bootstrap.cc:492] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:36.235713 821 consensus_queue.cc:237] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.237591 819 tablet_bootstrap.cc:654] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985: Neither blocks nor log segments found. Creating new log.
I20240502 01:56:36.243415 819 tablet_bootstrap.cc:492] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985: No bootstrap required, opened a new log
I20240502 01:56:36.243644 819 ts_tablet_manager.cc:1367] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.007s
I20240502 01:56:36.244879 819 raft_consensus.cc:348] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.245141 819 raft_consensus.cc:374] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:56:36.245276 819 raft_consensus.cc:729] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:36.245766 819 consensus_queue.cc:260] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.246017 819 raft_consensus.cc:388] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:36.246119 819 raft_consensus.cc:482] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:36.246268 819 raft_consensus.cc:3037] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:56:36.248203 748 catalog_manager.cc:5484] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129). New cstate: current_term: 1 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:36.249404 819 raft_consensus.cc:504] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.249764 819 leader_election.cc:302] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:36.250111 823 raft_consensus.cc:2781] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:56:36.250289 823 raft_consensus.cc:686] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985 [term 1 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:36.250644 823 consensus_queue.cc:237] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.251160 819 leader_election.cc:288] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:56:36.251832 819 ts_tablet_manager.cc:1398] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.008s user 0.004s sys 0.004s
I20240502 01:56:36.252178 819 tablet_bootstrap.cc:492] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:36.254284 819 tablet_bootstrap.cc:654] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985: Neither blocks nor log segments found. Creating new log.
I20240502 01:56:36.261108 819 tablet_bootstrap.cc:492] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985: No bootstrap required, opened a new log
I20240502 01:56:36.261317 819 ts_tablet_manager.cc:1367] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.007s
I20240502 01:56:36.261482 748 catalog_manager.cc:5484] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129). New cstate: current_term: 1 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:36.262074 819 raft_consensus.cc:348] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.262239 819 raft_consensus.cc:374] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:56:36.262318 819 raft_consensus.cc:729] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:36.262743 819 consensus_queue.cc:260] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.262950 819 raft_consensus.cc:388] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:36.263058 819 raft_consensus.cc:482] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:36.263166 819 raft_consensus.cc:3037] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:56:36.265329 819 raft_consensus.cc:504] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.265630 819 leader_election.cc:302] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:36.265825 819 leader_election.cc:288] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:56:36.265895 823 raft_consensus.cc:2781] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:56:36.266145 823 raft_consensus.cc:686] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985 [term 1 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:36.266333 819 ts_tablet_manager.cc:1398] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.005s user 0.001s sys 0.003s
I20240502 01:56:36.266395 823 consensus_queue.cc:237] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.266629 819 tablet_bootstrap.cc:492] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:36.268404 819 tablet_bootstrap.cc:654] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985: Neither blocks nor log segments found. Creating new log.
I20240502 01:56:36.269137 747 catalog_manager.cc:5484] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129). New cstate: current_term: 1 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:36.270447 819 tablet_bootstrap.cc:492] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985: No bootstrap required, opened a new log
I20240502 01:56:36.270587 819 ts_tablet_manager.cc:1367] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240502 01:56:36.271423 819 raft_consensus.cc:348] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.271615 819 raft_consensus.cc:374] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:56:36.271725 819 raft_consensus.cc:729] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:36.271989 819 consensus_queue.cc:260] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.272218 819 raft_consensus.cc:388] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:36.272305 819 raft_consensus.cc:482] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:36.272426 819 raft_consensus.cc:3037] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:56:36.274546 819 raft_consensus.cc:504] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.274801 819 leader_election.cc:302] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:36.274994 819 leader_election.cc:288] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:56:36.275081 823 raft_consensus.cc:2781] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:56:36.275223 823 raft_consensus.cc:686] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:36.275525 819 ts_tablet_manager.cc:1398] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20240502 01:56:36.275498 823 consensus_queue.cc:237] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.275786 819 tablet_bootstrap.cc:492] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:36.277483 819 tablet_bootstrap.cc:654] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985: Neither blocks nor log segments found. Creating new log.
I20240502 01:56:36.277933 747 catalog_manager.cc:5484] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129). New cstate: current_term: 1 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:36.279549 819 tablet_bootstrap.cc:492] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985: No bootstrap required, opened a new log
I20240502 01:56:36.279731 819 ts_tablet_manager.cc:1367] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240502 01:56:36.280467 819 raft_consensus.cc:348] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.280630 819 raft_consensus.cc:374] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:56:36.280704 819 raft_consensus.cc:729] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:36.280983 819 consensus_queue.cc:260] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.281178 819 raft_consensus.cc:388] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:36.281302 819 raft_consensus.cc:482] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:36.281436 819 raft_consensus.cc:3037] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:56:36.283890 819 raft_consensus.cc:504] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.284122 819 leader_election.cc:302] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:36.284344 819 leader_election.cc:288] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:56:36.284399 823 raft_consensus.cc:2781] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:56:36.284622 823 raft_consensus.cc:686] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:36.284854 819 ts_tablet_manager.cc:1398] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20240502 01:56:36.284878 823 consensus_queue.cc:237] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.285203 819 tablet_bootstrap.cc:492] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:36.286865 819 tablet_bootstrap.cc:654] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985: Neither blocks nor log segments found. Creating new log.
I20240502 01:56:36.287520 747 catalog_manager.cc:5484] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129). New cstate: current_term: 1 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:36.288751 819 tablet_bootstrap.cc:492] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985: No bootstrap required, opened a new log
I20240502 01:56:36.288901 819 ts_tablet_manager.cc:1367] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240502 01:56:36.289834 819 raft_consensus.cc:348] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.289989 819 raft_consensus.cc:374] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:56:36.290073 819 raft_consensus.cc:729] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:36.290313 819 consensus_queue.cc:260] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.290480 819 raft_consensus.cc:388] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:36.290546 819 raft_consensus.cc:482] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:36.290629 819 raft_consensus.cc:3037] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:56:36.292829 819 raft_consensus.cc:504] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.293077 819 leader_election.cc:302] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:36.293321 819 leader_election.cc:288] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:56:36.293458 823 raft_consensus.cc:2781] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:56:36.293607 823 raft_consensus.cc:686] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:36.293923 819 ts_tablet_manager.cc:1398] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20240502 01:56:36.293864 823 consensus_queue.cc:237] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.294186 819 tablet_bootstrap.cc:492] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:36.295922 819 tablet_bootstrap.cc:654] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985: Neither blocks nor log segments found. Creating new log.
I20240502 01:56:36.296258 747 catalog_manager.cc:5484] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129). New cstate: current_term: 1 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:36.297828 819 tablet_bootstrap.cc:492] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985: No bootstrap required, opened a new log
I20240502 01:56:36.298003 819 ts_tablet_manager.cc:1367] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240502 01:56:36.298689 819 raft_consensus.cc:348] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.298864 819 raft_consensus.cc:374] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:56:36.298947 819 raft_consensus.cc:729] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:36.299224 819 consensus_queue.cc:260] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.299396 819 raft_consensus.cc:388] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:36.299500 819 raft_consensus.cc:482] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:36.299604 819 raft_consensus.cc:3037] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:56:36.301987 819 raft_consensus.cc:504] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.302269 819 leader_election.cc:302] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:36.302485 819 leader_election.cc:288] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:56:36.302542 823 raft_consensus.cc:2781] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:56:36.302749 823 raft_consensus.cc:686] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:36.302987 819 ts_tablet_manager.cc:1398] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20240502 01:56:36.303010 823 consensus_queue.cc:237] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.303345 819 tablet_bootstrap.cc:492] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:36.305172 819 tablet_bootstrap.cc:654] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985: Neither blocks nor log segments found. Creating new log.
I20240502 01:56:36.305721 747 catalog_manager.cc:5484] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129). New cstate: current_term: 1 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:36.307185 819 tablet_bootstrap.cc:492] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985: No bootstrap required, opened a new log
I20240502 01:56:36.307358 819 ts_tablet_manager.cc:1367] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20240502 01:56:36.308034 819 raft_consensus.cc:348] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.308174 819 raft_consensus.cc:374] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:56:36.308267 819 raft_consensus.cc:729] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:36.308487 819 consensus_queue.cc:260] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.308651 819 raft_consensus.cc:388] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:36.308720 819 raft_consensus.cc:482] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:36.308825 819 raft_consensus.cc:3037] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:56:36.310766 819 raft_consensus.cc:504] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.311002 819 leader_election.cc:302] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:36.311177 819 leader_election.cc:288] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:56:36.311388 823 raft_consensus.cc:2781] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:56:36.311589 823 raft_consensus.cc:686] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985 [term 1 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:36.311652 819 ts_tablet_manager.cc:1398] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20240502 01:56:36.311895 819 tablet_bootstrap.cc:492] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:36.311837 823 consensus_queue.cc:237] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.313580 819 tablet_bootstrap.cc:654] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985: Neither blocks nor log segments found. Creating new log.
I20240502 01:56:36.314600 747 catalog_manager.cc:5484] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129). New cstate: current_term: 1 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:36.315416 819 tablet_bootstrap.cc:492] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985: No bootstrap required, opened a new log
I20240502 01:56:36.315589 819 ts_tablet_manager.cc:1367] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20240502 01:56:36.316329 819 raft_consensus.cc:348] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.316490 819 raft_consensus.cc:374] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:56:36.316569 819 raft_consensus.cc:729] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:36.316845 819 consensus_queue.cc:260] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.316993 819 raft_consensus.cc:388] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:36.317087 819 raft_consensus.cc:482] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:36.317178 819 raft_consensus.cc:3037] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:56:36.319578 819 raft_consensus.cc:504] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.319806 819 leader_election.cc:302] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:36.319994 819 leader_election.cc:288] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:56:36.320080 823 raft_consensus.cc:2781] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:56:36.320279 823 raft_consensus.cc:686] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985 [term 1 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:36.320533 819 ts_tablet_manager.cc:1398] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20240502 01:56:36.320631 823 consensus_queue.cc:237] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.320883 819 tablet_bootstrap.cc:492] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:36.322706 819 tablet_bootstrap.cc:654] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985: Neither blocks nor log segments found. Creating new log.
I20240502 01:56:36.323173 747 catalog_manager.cc:5484] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129). New cstate: current_term: 1 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:36.324642 819 tablet_bootstrap.cc:492] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985: No bootstrap required, opened a new log
I20240502 01:56:36.324810 819 ts_tablet_manager.cc:1367] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240502 01:56:36.325569 819 raft_consensus.cc:348] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.325717 819 raft_consensus.cc:374] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:56:36.325814 819 raft_consensus.cc:729] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:36.326074 819 consensus_queue.cc:260] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.326305 819 raft_consensus.cc:388] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:36.326406 819 raft_consensus.cc:482] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:36.326539 819 raft_consensus.cc:3037] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:56:36.328665 819 raft_consensus.cc:504] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.328904 819 leader_election.cc:302] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:36.329067 819 leader_election.cc:288] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:56:36.329190 823 raft_consensus.cc:2781] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:56:36.329398 823 raft_consensus.cc:686] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:36.329560 819 ts_tablet_manager.cc:1398] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20240502 01:56:36.329692 823 consensus_queue.cc:237] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.329841 819 tablet_bootstrap.cc:492] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:36.331648 819 tablet_bootstrap.cc:654] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985: Neither blocks nor log segments found. Creating new log.
I20240502 01:56:36.332990 747 catalog_manager.cc:5484] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129). New cstate: current_term: 1 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:36.333526 819 tablet_bootstrap.cc:492] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985: No bootstrap required, opened a new log
I20240502 01:56:36.333686 819 ts_tablet_manager.cc:1367] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240502 01:56:36.334300 819 raft_consensus.cc:348] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.334486 819 raft_consensus.cc:374] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:56:36.334569 819 raft_consensus.cc:729] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:36.334812 819 consensus_queue.cc:260] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.334992 819 raft_consensus.cc:388] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:36.335085 819 raft_consensus.cc:482] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:36.335151 819 raft_consensus.cc:3037] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:56:36.337337 819 raft_consensus.cc:504] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.337610 819 leader_election.cc:302] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:36.337790 819 leader_election.cc:288] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:56:36.337862 823 raft_consensus.cc:2781] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:56:36.338079 823 raft_consensus.cc:686] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985 [term 1 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:36.338254 819 ts_tablet_manager.cc:1398] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.004s user 0.001s sys 0.003s
I20240502 01:56:36.338372 823 consensus_queue.cc:237] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.338539 819 tablet_bootstrap.cc:492] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:36.340478 819 tablet_bootstrap.cc:654] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985: Neither blocks nor log segments found. Creating new log.
I20240502 01:56:36.340664 747 catalog_manager.cc:5484] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129). New cstate: current_term: 1 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:36.342401 819 tablet_bootstrap.cc:492] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985: No bootstrap required, opened a new log
I20240502 01:56:36.342543 819 ts_tablet_manager.cc:1367] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240502 01:56:36.343142 819 raft_consensus.cc:348] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.343406 819 raft_consensus.cc:374] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:56:36.343514 819 raft_consensus.cc:729] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:36.343739 819 consensus_queue.cc:260] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.343907 819 raft_consensus.cc:388] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:36.343988 819 raft_consensus.cc:482] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:36.344096 819 raft_consensus.cc:3037] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:56:36.346096 819 raft_consensus.cc:504] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.346335 819 leader_election.cc:302] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:36.346527 819 leader_election.cc:288] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:56:36.346660 823 raft_consensus.cc:2781] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:56:36.346825 823 raft_consensus.cc:686] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:36.347020 819 ts_tablet_manager.cc:1398] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240502 01:56:36.347087 823 consensus_queue.cc:237] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.347293 819 tablet_bootstrap.cc:492] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:36.349006 819 tablet_bootstrap.cc:654] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985: Neither blocks nor log segments found. Creating new log.
I20240502 01:56:36.350193 747 catalog_manager.cc:5484] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129). New cstate: current_term: 1 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:36.351126 819 tablet_bootstrap.cc:492] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985: No bootstrap required, opened a new log
I20240502 01:56:36.351336 819 ts_tablet_manager.cc:1367] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240502 01:56:36.352056 819 raft_consensus.cc:348] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.352252 819 raft_consensus.cc:374] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:56:36.352324 819 raft_consensus.cc:729] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:36.352541 819 consensus_queue.cc:260] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.352690 819 raft_consensus.cc:388] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:36.352794 819 raft_consensus.cc:482] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:36.352896 819 raft_consensus.cc:3037] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:56:36.355228 819 raft_consensus.cc:504] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.355473 819 leader_election.cc:302] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:36.355684 819 leader_election.cc:288] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:56:36.355788 823 raft_consensus.cc:2781] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:56:36.356151 819 ts_tablet_manager.cc:1398] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20240502 01:56:36.356184 823 raft_consensus.cc:686] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985 [term 1 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:36.356467 819 tablet_bootstrap.cc:492] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:36.356460 823 consensus_queue.cc:237] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.358234 819 tablet_bootstrap.cc:654] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985: Neither blocks nor log segments found. Creating new log.
I20240502 01:56:36.359416 747 catalog_manager.cc:5484] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129). New cstate: current_term: 1 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:36.360322 819 tablet_bootstrap.cc:492] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985: No bootstrap required, opened a new log
I20240502 01:56:36.360466 819 ts_tablet_manager.cc:1367] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240502 01:56:36.361104 819 raft_consensus.cc:348] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.361299 819 raft_consensus.cc:374] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:56:36.361446 819 raft_consensus.cc:729] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:36.361689 819 consensus_queue.cc:260] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.361872 819 raft_consensus.cc:388] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:36.361953 819 raft_consensus.cc:482] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:36.362074 819 raft_consensus.cc:3037] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:56:36.364259 819 raft_consensus.cc:504] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.364544 819 leader_election.cc:302] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:36.364735 819 leader_election.cc:288] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:56:36.364849 823 raft_consensus.cc:2781] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:56:36.365028 823 raft_consensus.cc:686] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:36.365253 819 ts_tablet_manager.cc:1398] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20240502 01:56:36.365324 823 consensus_queue.cc:237] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.365581 819 tablet_bootstrap.cc:492] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:36.367414 819 tablet_bootstrap.cc:654] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985: Neither blocks nor log segments found. Creating new log.
I20240502 01:56:36.369851 747 catalog_manager.cc:5484] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129). New cstate: current_term: 1 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:36.370674 819 tablet_bootstrap.cc:492] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985: No bootstrap required, opened a new log
I20240502 01:56:36.370867 819 ts_tablet_manager.cc:1367] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20240502 01:56:36.371567 819 raft_consensus.cc:348] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.371798 819 raft_consensus.cc:374] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:56:36.371886 819 raft_consensus.cc:729] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:36.372134 819 consensus_queue.cc:260] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.372301 819 raft_consensus.cc:388] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:36.372404 819 raft_consensus.cc:482] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:36.372501 819 raft_consensus.cc:3037] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:56:36.375149 819 raft_consensus.cc:504] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.375397 819 leader_election.cc:302] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:36.375625 819 leader_election.cc:288] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:56:36.375715 823 raft_consensus.cc:2781] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:56:36.375937 823 raft_consensus.cc:686] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:36.376106 819 ts_tablet_manager.cc:1398] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.005s user 0.003s sys 0.001s
I20240502 01:56:36.376209 823 consensus_queue.cc:237] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.376436 819 tablet_bootstrap.cc:492] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:36.378482 819 tablet_bootstrap.cc:654] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985: Neither blocks nor log segments found. Creating new log.
I20240502 01:56:36.378851 747 catalog_manager.cc:5484] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129). New cstate: current_term: 1 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:36.380474 819 tablet_bootstrap.cc:492] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985: No bootstrap required, opened a new log
I20240502 01:56:36.380650 819 ts_tablet_manager.cc:1367] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20240502 01:56:36.381271 819 raft_consensus.cc:348] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.381479 819 raft_consensus.cc:374] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:56:36.381588 819 raft_consensus.cc:729] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:36.381819 819 consensus_queue.cc:260] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.381983 819 raft_consensus.cc:388] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:36.382073 819 raft_consensus.cc:482] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:36.382184 819 raft_consensus.cc:3037] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:56:36.384073 819 raft_consensus.cc:504] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.384299 819 leader_election.cc:302] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:36.384441 819 leader_election.cc:288] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:56:36.384598 823 raft_consensus.cc:2781] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:56:36.384757 823 raft_consensus.cc:686] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:36.384887 819 ts_tablet_manager.cc:1398] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240502 01:56:36.384991 823 consensus_queue.cc:237] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.385159 819 tablet_bootstrap.cc:492] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:36.387964 747 catalog_manager.cc:5484] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129). New cstate: current_term: 1 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:36.401638 819 tablet_bootstrap.cc:654] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985: Neither blocks nor log segments found. Creating new log.
I20240502 01:56:36.403739 819 tablet_bootstrap.cc:492] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985: No bootstrap required, opened a new log
I20240502 01:56:36.403941 819 ts_tablet_manager.cc:1367] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.000s
I20240502 01:56:36.404619 819 raft_consensus.cc:348] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.404799 819 raft_consensus.cc:374] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:56:36.404882 819 raft_consensus.cc:729] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:36.405154 819 consensus_queue.cc:260] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.405303 819 raft_consensus.cc:388] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:36.405436 819 raft_consensus.cc:482] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:36.405543 819 raft_consensus.cc:3037] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:56:36.407557 819 raft_consensus.cc:504] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.407836 819 leader_election.cc:302] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:36.408054 819 leader_election.cc:288] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:56:36.408176 823 raft_consensus.cc:2781] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:56:36.408387 823 raft_consensus.cc:686] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:36.408613 819 ts_tablet_manager.cc:1398] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20240502 01:56:36.408738 823 consensus_queue.cc:237] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.408933 819 tablet_bootstrap.cc:492] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:36.410856 819 tablet_bootstrap.cc:654] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985: Neither blocks nor log segments found. Creating new log.
I20240502 01:56:36.412232 747 catalog_manager.cc:5484] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129). New cstate: current_term: 1 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:36.412842 819 tablet_bootstrap.cc:492] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985: No bootstrap required, opened a new log
I20240502 01:56:36.412992 819 ts_tablet_manager.cc:1367] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240502 01:56:36.413833 819 raft_consensus.cc:348] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.414007 819 raft_consensus.cc:374] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:56:36.414109 819 raft_consensus.cc:729] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:36.414361 819 consensus_queue.cc:260] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.414587 819 raft_consensus.cc:388] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:36.414672 819 raft_consensus.cc:482] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:36.414784 819 raft_consensus.cc:3037] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:56:36.417042 819 raft_consensus.cc:504] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.417270 819 leader_election.cc:302] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:36.417495 819 leader_election.cc:288] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:56:36.417644 823 raft_consensus.cc:2781] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:56:36.417814 823 raft_consensus.cc:686] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:36.418033 819 ts_tablet_manager.cc:1398] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.005s user 0.003s sys 0.003s
I20240502 01:56:36.418144 823 consensus_queue.cc:237] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.418298 819 tablet_bootstrap.cc:492] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:36.420176 819 tablet_bootstrap.cc:654] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985: Neither blocks nor log segments found. Creating new log.
I20240502 01:56:36.421168 747 catalog_manager.cc:5484] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129). New cstate: current_term: 1 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:36.422187 819 tablet_bootstrap.cc:492] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985: No bootstrap required, opened a new log
I20240502 01:56:36.422363 819 ts_tablet_manager.cc:1367] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20240502 01:56:36.423117 819 raft_consensus.cc:348] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.423336 819 raft_consensus.cc:374] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:56:36.423424 819 raft_consensus.cc:729] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:36.423694 819 consensus_queue.cc:260] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.423889 819 raft_consensus.cc:388] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:36.424005 819 raft_consensus.cc:482] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:36.424101 819 raft_consensus.cc:3037] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:56:36.426378 819 raft_consensus.cc:504] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.426635 819 leader_election.cc:302] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:36.426844 819 leader_election.cc:288] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:56:36.426910 823 raft_consensus.cc:2781] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:56:36.427069 823 raft_consensus.cc:686] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985 [term 1 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:36.427362 819 ts_tablet_manager.cc:1398] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20240502 01:56:36.427300 823 consensus_queue.cc:237] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.427659 819 tablet_bootstrap.cc:492] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:36.429450 819 tablet_bootstrap.cc:654] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985: Neither blocks nor log segments found. Creating new log.
I20240502 01:56:36.430131 747 catalog_manager.cc:5484] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129). New cstate: current_term: 1 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:36.431442 819 tablet_bootstrap.cc:492] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985: No bootstrap required, opened a new log
I20240502 01:56:36.431605 819 ts_tablet_manager.cc:1367] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20240502 01:56:36.432391 819 raft_consensus.cc:348] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.432560 819 raft_consensus.cc:374] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:56:36.432660 819 raft_consensus.cc:729] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:36.432886 819 consensus_queue.cc:260] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.433096 819 raft_consensus.cc:388] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:36.433176 819 raft_consensus.cc:482] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:36.433302 819 raft_consensus.cc:3037] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:56:36.435565 819 raft_consensus.cc:504] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.435833 819 leader_election.cc:302] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:36.436039 819 leader_election.cc:288] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:56:36.436148 823 raft_consensus.cc:2781] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:56:36.436288 823 raft_consensus.cc:686] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:36.436614 819 ts_tablet_manager.cc:1398] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20240502 01:56:36.436571 823 consensus_queue.cc:237] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:36.439420 747 catalog_manager.cc:5484] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129). New cstate: current_term: 1 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
W20240502 01:56:36.681638 831 log.cc:924] Time spent T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985: Append to log took a long time: real 0.051s user 0.000s sys 0.000s
W20240502 01:56:36.752637 859 log.cc:924] Time spent T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985: Append to log took a long time: real 0.055s user 0.000s sys 0.000s
I20240502 01:56:40.359623 28510 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ga2ld/build/asan/bin/kudu
/tmp/dist-test-task7ga2ld/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.215.130:36617
--local_ip_for_outbound_sockets=127.27.215.130
--tserver_master_addrs=127.27.215.190:34609
--webserver_port=43997
--webserver_interface=127.27.215.130
--builtin_ntp_servers=127.27.215.148:44951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=20 with env {}
W20240502 01:56:40.717818 928 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:56:40.718138 928 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:56:40.718251 928 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:56:40.726259 928 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:56:40.726488 928 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.215.130
I20240502 01:56:40.735999 928 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.215.148:44951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.215.130:36617
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.215.130
--webserver_port=43997
--tserver_master_addrs=127.27.215.190:34609
--num_tablets_to_copy_simultaneously=20
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.215.130
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 02 May 2024 01:43:22 UTC on efd1337a2aa3
build id 83
ASAN enabled
I20240502 01:56:40.737447 928 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:56:40.739307 928 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:56:40.752123 933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:40.752076 936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:40.752146 934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:56:40.752465 928 server_base.cc:1034] running on GCE node
I20240502 01:56:40.753551 928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:56:40.754714 928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:56:40.755976 928 hybrid_clock.cc:648] HybridClock initialized: now 1714615000755911 us; error 31 us; skew 500 ppm
I20240502 01:56:40.756501 928 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:56:40.759081 928 webserver.cc:460] Webserver started at http://127.27.215.130:43997/ using document root <none> and password file <none>
I20240502 01:56:40.759943 928 fs_manager.cc:359] Metadata directory not provided
I20240502 01:56:40.760115 928 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:56:40.766023 928 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20240502 01:56:40.769055 942 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:40.770639 928 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240502 01:56:40.770853 928 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-1/wal
uuid: "617b001dc8134c21a5ace2b0b230818e"
format_stamp: "Formatted at 2024-05-02 01:56:34 on dist-test-slave-v8sz"
I20240502 01:56:40.771839 928 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:56:40.801924 928 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:56:40.802845 928 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:56:40.803135 928 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:56:40.804145 928 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:56:40.805878 928 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:56:40.805982 928 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:40.806108 928 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:56:40.806183 928 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:40.839697 928 rpc_server.cc:307] RPC server started. Bound to: 127.27.215.130:36617
I20240502 01:56:40.839783 1055 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.215.130:36617 every 8 connection(s)
I20240502 01:56:40.841847 928 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-1/data/info.pb
I20240502 01:56:40.846271 28510 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ga2ld/build/asan/bin/kudu as pid 928
I20240502 01:56:40.847756 28510 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task7ga2ld/build/asan/bin/kudu pid 445
I20240502 01:56:40.849702 567 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 01:56:40.870492 1056 heartbeater.cc:347] Connected to a master server at 127.27.215.190:34609
I20240502 01:56:40.870859 1056 heartbeater.cc:464] Registering TS with master...
I20240502 01:56:40.871776 1056 heartbeater.cc:511] Master 127.27.215.190:34609 requested a full tablet report, sending...
I20240502 01:56:40.873540 744 ts_manager.cc:194] Registered new tserver with Master: 617b001dc8134c21a5ace2b0b230818e (127.27.215.130:36617)
I20240502 01:56:40.874708 744 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.215.130:36707
I20240502 01:56:41.071833 28510 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ga2ld/build/asan/bin/kudu with pid 445
I20240502 01:56:41.109593 28510 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ga2ld/build/asan/bin/kudu
/tmp/dist-test-task7ga2ld/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.215.129:38143
--local_ip_for_outbound_sockets=127.27.215.129
--tserver_master_addrs=127.27.215.190:34609
--webserver_port=46235
--webserver_interface=127.27.215.129
--builtin_ntp_servers=127.27.215.148:44951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=20
--rpc_service_queue_length=1
--rpc_num_service_threads=1 with env {}
W20240502 01:56:41.470283 1061 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:56:41.470628 1061 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:56:41.470741 1061 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:56:41.479156 1061 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:56:41.479374 1061 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.215.129
I20240502 01:56:41.489056 1061 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.215.148:44951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.215.129:38143
--rpc_num_service_threads=1
--rpc_server_allow_ephemeral_ports=true
--rpc_service_queue_length=1
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.215.129
--webserver_port=46235
--tserver_master_addrs=127.27.215.190:34609
--num_tablets_to_copy_simultaneously=20
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.215.129
--log_dir=/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 02 May 2024 01:43:22 UTC on efd1337a2aa3
build id 83
ASAN enabled
I20240502 01:56:41.490569 1061 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:56:41.492482 1061 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:56:41.505709 1066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:56:41.505730 1069 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:56:41.505856 1061 server_base.cc:1034] running on GCE node
W20240502 01:56:41.505661 1067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:56:41.506898 1061 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:56:41.507977 1061 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:56:41.509223 1061 hybrid_clock.cc:648] HybridClock initialized: now 1714615001509130 us; error 67 us; skew 500 ppm
I20240502 01:56:41.509603 1061 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:56:41.512161 1061 webserver.cc:460] Webserver started at http://127.27.215.129:46235/ using document root <none> and password file <none>
I20240502 01:56:41.512988 1061 fs_manager.cc:359] Metadata directory not provided
I20240502 01:56:41.513159 1061 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:56:41.519065 1061 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.003s
I20240502 01:56:41.524508 1075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:56:41.526144 1061 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20240502 01:56:41.526345 1061 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-0/wal
uuid: "c3d82e05ada14e6c9393bbaae8d88985"
format_stamp: "Formatted at 2024-05-02 01:56:33 on dist-test-slave-v8sz"
I20240502 01:56:41.527290 1061 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:56:41.544981 1061 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:56:41.545943 1061 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:56:41.546234 1061 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:56:41.547267 1061 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:56:41.549782 1082 ts_tablet_manager.cc:522] Loading tablet metadata (0/20 complete)
I20240502 01:56:41.594442 1061 ts_tablet_manager.cc:559] Loaded tablet metadata (20 total tablets, 20 live tablets)
I20240502 01:56:41.594597 1061 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.045s user 0.003s sys 0.000s
I20240502 01:56:41.594734 1061 ts_tablet_manager.cc:574] Registering tablets (0/20 complete)
I20240502 01:56:41.598625 1082 tablet_bootstrap.cc:492] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:41.649173 1061 ts_tablet_manager.cc:590] Registered 20 tablets
I20240502 01:56:41.649307 1061 ts_tablet_manager.cc:569] Time spent register tablets: real 0.055s user 0.044s sys 0.007s
I20240502 01:56:41.658419 1082 log.cc:824] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985: Log is configured to *not* fsync() on all Append() calls
I20240502 01:56:41.661096 1061 rpc_server.cc:307] RPC server started. Bound to: 127.27.215.129:38143
I20240502 01:56:41.661136 1094 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.215.129:38143 every 8 connection(s)
I20240502 01:56:41.662611 1061 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ga2ld/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714614966221093-28510-0/minicluster-data/ts-0/data/info.pb
I20240502 01:56:41.667198 28510 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ga2ld/build/asan/bin/kudu as pid 1061
I20240502 01:56:41.691713 1095 heartbeater.cc:347] Connected to a master server at 127.27.215.190:34609
I20240502 01:56:41.692062 1095 heartbeater.cc:464] Registering TS with master...
I20240502 01:56:41.693508 1095 heartbeater.cc:511] Master 127.27.215.190:34609 requested a full tablet report, sending...
I20240502 01:56:41.698124 744 ts_manager.cc:194] Re-registered known tserver with Master: c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129:38143)
I20240502 01:56:41.704667 744 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.215.129:40137
I20240502 01:56:41.841869 1082 tablet_bootstrap.cc:492] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap replayed 1/1 log segments. Stats: ops{read=189 overwritten=0 applied=189 ignored=0} inserts{seen=499 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:56:41.842628 1082 tablet_bootstrap.cc:492] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap complete.
I20240502 01:56:41.844262 1082 ts_tablet_manager.cc:1367] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.246s user 0.216s sys 0.024s
I20240502 01:56:41.849745 1082 raft_consensus.cc:348] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:41.850642 1082 raft_consensus.cc:729] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:41.851326 1082 consensus_queue.cc:260] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 189, Last appended: 1.189, Last appended by leader: 189, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:41.851593 1082 raft_consensus.cc:388] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:41.851725 1082 raft_consensus.cc:482] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:41.851917 1082 raft_consensus.cc:3037] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:56:41.855890 1082 raft_consensus.cc:504] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:41.856493 1082 leader_election.cc:302] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:41.857148 1082 leader_election.cc:288] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 01:56:41.857378 1101 raft_consensus.cc:2781] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:56:41.858162 1101 raft_consensus.cc:686] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985 [term 2 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:41.858433 1095 heartbeater.cc:503] Master 127.27.215.190:34609 was elected leader, sending a full tablet report...
I20240502 01:56:41.858784 1101 consensus_queue.cc:237] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 189, Committed index: 189, Last appended: 1.189, Last appended by leader: 189, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:41.859244 1082 ts_tablet_manager.cc:1398] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.015s user 0.012s sys 0.004s
I20240502 01:56:41.859637 1082 tablet_bootstrap.cc:492] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:41.866845 744 catalog_manager.cc:5484] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:41.877863 1056 heartbeater.cc:503] Master 127.27.215.190:34609 was elected leader, sending a full tablet report...
I20240502 01:56:42.049216 1082 tablet_bootstrap.cc:492] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap replayed 1/1 log segments. Stats: ops{read=191 overwritten=0 applied=191 ignored=0} inserts{seen=499 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:56:42.049789 1082 tablet_bootstrap.cc:492] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap complete.
I20240502 01:56:42.050820 1082 ts_tablet_manager.cc:1367] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.191s user 0.162s sys 0.028s
I20240502 01:56:42.051656 1082 raft_consensus.cc:348] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:42.051821 1082 raft_consensus.cc:729] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:42.052094 1082 consensus_queue.cc:260] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 191, Last appended: 1.191, Last appended by leader: 191, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:42.052249 1082 raft_consensus.cc:388] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:42.052348 1082 raft_consensus.cc:482] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:42.052441 1082 raft_consensus.cc:3037] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:56:42.055258 1082 raft_consensus.cc:504] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:42.055555 1082 leader_election.cc:302] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:42.055804 1082 leader_election.cc:288] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 01:56:42.055888 1101 raft_consensus.cc:2781] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:56:42.056141 1101 raft_consensus.cc:686] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:42.056298 1082 ts_tablet_manager.cc:1398] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.005s user 0.000s sys 0.004s
I20240502 01:56:42.056561 1082 tablet_bootstrap.cc:492] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:42.056453 1101 consensus_queue.cc:237] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 191, Committed index: 191, Last appended: 1.191, Last appended by leader: 191, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:42.060415 744 catalog_manager.cc:5484] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:42.248502 1082 tablet_bootstrap.cc:492] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap replayed 1/1 log segments. Stats: ops{read=192 overwritten=0 applied=192 ignored=0} inserts{seen=512 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:56:42.249004 1082 tablet_bootstrap.cc:492] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap complete.
I20240502 01:56:42.250113 1082 ts_tablet_manager.cc:1367] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.194s user 0.157s sys 0.036s
I20240502 01:56:42.251519 1082 raft_consensus.cc:348] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:42.251965 1082 raft_consensus.cc:729] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:42.252446 1082 consensus_queue.cc:260] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 192, Last appended: 1.192, Last appended by leader: 192, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:42.252883 1082 raft_consensus.cc:388] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:42.253055 1082 raft_consensus.cc:482] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:42.253289 1082 raft_consensus.cc:3037] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:56:42.255481 1082 raft_consensus.cc:504] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:42.255779 1082 leader_election.cc:302] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:42.255997 1082 leader_election.cc:288] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 01:56:42.256098 1101 raft_consensus.cc:2781] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:56:42.256263 1101 raft_consensus.cc:686] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:42.256644 1082 ts_tablet_manager.cc:1398] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20240502 01:56:42.256556 1101 consensus_queue.cc:237] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 192, Committed index: 192, Last appended: 1.192, Last appended by leader: 192, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:42.256930 1082 tablet_bootstrap.cc:492] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:42.259229 744 catalog_manager.cc:5484] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:42.446790 1082 tablet_bootstrap.cc:492] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap replayed 1/1 log segments. Stats: ops{read=196 overwritten=0 applied=196 ignored=0} inserts{seen=546 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:56:42.447289 1082 tablet_bootstrap.cc:492] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap complete.
I20240502 01:56:42.448336 1082 ts_tablet_manager.cc:1367] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.191s user 0.157s sys 0.031s
I20240502 01:56:42.449033 1082 raft_consensus.cc:348] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:42.449187 1082 raft_consensus.cc:729] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:42.449501 1082 consensus_queue.cc:260] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 196, Last appended: 1.196, Last appended by leader: 196, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:42.449656 1082 raft_consensus.cc:388] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:42.449769 1082 raft_consensus.cc:482] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:42.449870 1082 raft_consensus.cc:3037] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:56:42.452075 1082 raft_consensus.cc:504] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:42.452368 1082 leader_election.cc:302] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:42.452610 1082 leader_election.cc:288] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 01:56:42.452663 1101 raft_consensus.cc:2781] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:56:42.452879 1101 raft_consensus.cc:686] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:42.453095 1082 ts_tablet_manager.cc:1398] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20240502 01:56:42.453148 1101 consensus_queue.cc:237] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 196, Committed index: 196, Last appended: 1.196, Last appended by leader: 196, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:42.453394 1082 tablet_bootstrap.cc:492] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:42.455701 744 catalog_manager.cc:5484] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:42.655046 1082 tablet_bootstrap.cc:492] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap replayed 1/1 log segments. Stats: ops{read=187 overwritten=0 applied=187 ignored=0} inserts{seen=502 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:56:42.655571 1082 tablet_bootstrap.cc:492] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap complete.
I20240502 01:56:42.656652 1082 ts_tablet_manager.cc:1367] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.203s user 0.164s sys 0.035s
I20240502 01:56:42.657460 1082 raft_consensus.cc:348] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:42.657655 1082 raft_consensus.cc:729] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:42.657956 1082 consensus_queue.cc:260] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 187, Last appended: 1.187, Last appended by leader: 187, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:42.658128 1082 raft_consensus.cc:388] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:42.658233 1082 raft_consensus.cc:482] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:42.658360 1082 raft_consensus.cc:3037] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:56:42.660763 1082 raft_consensus.cc:504] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:42.661141 1082 leader_election.cc:302] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:42.661461 1082 leader_election.cc:288] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 01:56:42.661618 1101 raft_consensus.cc:2781] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:56:42.661824 1101 raft_consensus.cc:686] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:42.662043 1082 ts_tablet_manager.cc:1398] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.005s user 0.004s sys 0.004s
I20240502 01:56:42.662106 1101 consensus_queue.cc:237] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 187, Committed index: 187, Last appended: 1.187, Last appended by leader: 187, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:42.662410 1082 tablet_bootstrap.cc:492] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:42.664889 744 catalog_manager.cc:5484] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:42.854341 1082 tablet_bootstrap.cc:492] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap replayed 1/1 log segments. Stats: ops{read=186 overwritten=0 applied=186 ignored=0} inserts{seen=481 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:56:42.854887 1082 tablet_bootstrap.cc:492] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap complete.
I20240502 01:56:42.855923 1082 ts_tablet_manager.cc:1367] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.194s user 0.179s sys 0.012s
I20240502 01:56:42.856580 1082 raft_consensus.cc:348] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:42.856743 1082 raft_consensus.cc:729] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:42.856997 1082 consensus_queue.cc:260] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 186, Last appended: 1.186, Last appended by leader: 186, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:42.857156 1082 raft_consensus.cc:388] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:42.857256 1082 raft_consensus.cc:482] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:42.857390 1082 raft_consensus.cc:3037] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:56:42.859331 1082 raft_consensus.cc:504] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:42.859570 1082 leader_election.cc:302] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:42.859784 1082 leader_election.cc:288] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 01:56:42.859900 1101 raft_consensus.cc:2781] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:56:42.860227 1101 raft_consensus.cc:686] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985 [term 2 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:42.860278 1082 ts_tablet_manager.cc:1398] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20240502 01:56:42.860553 1082 tablet_bootstrap.cc:492] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:42.860502 1101 consensus_queue.cc:237] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 186, Committed index: 186, Last appended: 1.186, Last appended by leader: 186, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:42.863428 744 catalog_manager.cc:5484] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:43.038179 1082 tablet_bootstrap.cc:492] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap replayed 1/1 log segments. Stats: ops{read=187 overwritten=0 applied=187 ignored=0} inserts{seen=489 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:56:43.038654 1082 tablet_bootstrap.cc:492] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap complete.
I20240502 01:56:43.039675 1082 ts_tablet_manager.cc:1367] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.179s user 0.165s sys 0.011s
I20240502 01:56:43.040331 1082 raft_consensus.cc:348] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:43.040503 1082 raft_consensus.cc:729] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:43.040714 1082 consensus_queue.cc:260] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 187, Last appended: 1.187, Last appended by leader: 187, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:43.040849 1082 raft_consensus.cc:388] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:43.040910 1082 raft_consensus.cc:482] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:43.040995 1082 raft_consensus.cc:3037] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:56:43.042940 1082 raft_consensus.cc:504] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:43.043185 1082 leader_election.cc:302] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:43.043351 1082 leader_election.cc:288] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 01:56:43.043537 1101 raft_consensus.cc:2781] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:56:43.043763 1101 raft_consensus.cc:686] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:43.043972 1082 ts_tablet_manager.cc:1398] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.004s user 0.006s sys 0.000s
I20240502 01:56:43.044060 1101 consensus_queue.cc:237] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 187, Committed index: 187, Last appended: 1.187, Last appended by leader: 187, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:43.044214 1082 tablet_bootstrap.cc:492] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:43.046825 744 catalog_manager.cc:5484] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:43.223470 1082 tablet_bootstrap.cc:492] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap replayed 1/1 log segments. Stats: ops{read=185 overwritten=0 applied=185 ignored=0} inserts{seen=507 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:56:43.223990 1082 tablet_bootstrap.cc:492] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap complete.
I20240502 01:56:43.225055 1082 ts_tablet_manager.cc:1367] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.181s user 0.161s sys 0.016s
I20240502 01:56:43.225747 1082 raft_consensus.cc:348] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:43.225900 1082 raft_consensus.cc:729] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:43.226123 1082 consensus_queue.cc:260] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 185, Last appended: 1.185, Last appended by leader: 185, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:43.226284 1082 raft_consensus.cc:388] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:43.226363 1082 raft_consensus.cc:482] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:43.226457 1082 raft_consensus.cc:3037] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:56:43.228356 1082 raft_consensus.cc:504] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:43.228586 1082 leader_election.cc:302] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:43.228813 1082 leader_election.cc:288] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 01:56:43.228932 1101 raft_consensus.cc:2781] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:56:43.229162 1101 raft_consensus.cc:686] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985 [term 2 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:43.229329 1082 ts_tablet_manager.cc:1398] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240502 01:56:43.229444 1101 consensus_queue.cc:237] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 185, Committed index: 185, Last appended: 1.185, Last appended by leader: 185, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:43.229636 1082 tablet_bootstrap.cc:492] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:43.232281 744 catalog_manager.cc:5484] T 4bf45f2db51b49e08fd09bad98bfab7f P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:43.414103 1082 tablet_bootstrap.cc:492] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap replayed 1/1 log segments. Stats: ops{read=191 overwritten=0 applied=191 ignored=0} inserts{seen=528 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:56:43.414602 1082 tablet_bootstrap.cc:492] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap complete.
I20240502 01:56:43.415640 1082 ts_tablet_manager.cc:1367] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.186s user 0.156s sys 0.028s
I20240502 01:56:43.416303 1082 raft_consensus.cc:348] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:43.416479 1082 raft_consensus.cc:729] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:43.416729 1082 consensus_queue.cc:260] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 191, Last appended: 1.191, Last appended by leader: 191, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:43.416888 1082 raft_consensus.cc:388] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:43.416972 1082 raft_consensus.cc:482] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:43.417086 1082 raft_consensus.cc:3037] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:56:43.419060 1082 raft_consensus.cc:504] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:43.419342 1082 leader_election.cc:302] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:43.419543 1082 leader_election.cc:288] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 01:56:43.419731 1101 raft_consensus.cc:2781] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:56:43.419946 1101 raft_consensus.cc:686] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:43.420117 1082 ts_tablet_manager.cc:1398] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240502 01:56:43.420215 1101 consensus_queue.cc:237] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 191, Committed index: 191, Last appended: 1.191, Last appended by leader: 191, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:43.420399 1082 tablet_bootstrap.cc:492] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:43.422986 744 catalog_manager.cc:5484] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:43.599170 1082 tablet_bootstrap.cc:492] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap replayed 1/1 log segments. Stats: ops{read=191 overwritten=0 applied=191 ignored=0} inserts{seen=500 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:56:43.599651 1082 tablet_bootstrap.cc:492] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap complete.
I20240502 01:56:43.600632 1082 ts_tablet_manager.cc:1367] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.180s user 0.164s sys 0.011s
I20240502 01:56:43.601246 1082 raft_consensus.cc:348] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:43.601423 1082 raft_consensus.cc:729] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:43.601670 1082 consensus_queue.cc:260] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 191, Last appended: 1.191, Last appended by leader: 191, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:43.601814 1082 raft_consensus.cc:388] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:43.601881 1082 raft_consensus.cc:482] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:43.601950 1082 raft_consensus.cc:3037] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:56:43.603798 1082 raft_consensus.cc:504] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:43.604018 1082 leader_election.cc:302] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:43.604213 1082 leader_election.cc:288] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 01:56:43.604317 1101 raft_consensus.cc:2781] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:56:43.604890 1101 raft_consensus.cc:686] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:43.604890 1082 ts_tablet_manager.cc:1398] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240502 01:56:43.605268 1082 tablet_bootstrap.cc:492] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:43.605203 1101 consensus_queue.cc:237] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 191, Committed index: 191, Last appended: 1.191, Last appended by leader: 191, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:43.608158 744 catalog_manager.cc:5484] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:43.796159 1082 tablet_bootstrap.cc:492] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap replayed 1/1 log segments. Stats: ops{read=186 overwritten=0 applied=186 ignored=0} inserts{seen=515 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:56:43.796717 1082 tablet_bootstrap.cc:492] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap complete.
I20240502 01:56:43.797854 1082 ts_tablet_manager.cc:1367] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.193s user 0.164s sys 0.027s
I20240502 01:56:43.798556 1082 raft_consensus.cc:348] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:43.798753 1082 raft_consensus.cc:729] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:43.799021 1082 consensus_queue.cc:260] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 186, Last appended: 1.186, Last appended by leader: 186, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:43.799216 1082 raft_consensus.cc:388] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:43.799307 1082 raft_consensus.cc:482] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:43.799422 1082 raft_consensus.cc:3037] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:56:43.801798 1082 raft_consensus.cc:504] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:43.802057 1082 leader_election.cc:302] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:43.802279 1082 leader_election.cc:288] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 01:56:43.802376 1101 raft_consensus.cc:2781] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:56:43.802644 1101 raft_consensus.cc:686] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:43.802819 1082 ts_tablet_manager.cc:1398] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20240502 01:56:43.802961 1101 consensus_queue.cc:237] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 186, Committed index: 186, Last appended: 1.186, Last appended by leader: 186, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:43.803177 1082 tablet_bootstrap.cc:492] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:43.805595 744 catalog_manager.cc:5484] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:43.974229 1082 tablet_bootstrap.cc:492] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap replayed 1/1 log segments. Stats: ops{read=182 overwritten=0 applied=182 ignored=0} inserts{seen=481 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:56:43.974735 1082 tablet_bootstrap.cc:492] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap complete.
I20240502 01:56:43.975740 1082 ts_tablet_manager.cc:1367] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.173s user 0.158s sys 0.012s
I20240502 01:56:43.976642 1082 raft_consensus.cc:348] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:43.976874 1082 raft_consensus.cc:729] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:43.977169 1082 consensus_queue.cc:260] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 182, Last appended: 1.182, Last appended by leader: 182, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:43.977397 1082 raft_consensus.cc:388] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:43.977538 1082 raft_consensus.cc:482] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:43.977665 1082 raft_consensus.cc:3037] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:56:43.980461 1082 raft_consensus.cc:504] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:43.980723 1082 leader_election.cc:302] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:43.980952 1082 leader_election.cc:288] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 01:56:43.981057 1101 raft_consensus.cc:2781] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:56:43.981289 1101 raft_consensus.cc:686] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985 [term 2 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:43.981499 1082 ts_tablet_manager.cc:1398] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.006s user 0.004s sys 0.004s
I20240502 01:56:43.981623 1101 consensus_queue.cc:237] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 182, Committed index: 182, Last appended: 1.182, Last appended by leader: 182, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:43.981774 1082 tablet_bootstrap.cc:492] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:43.984345 744 catalog_manager.cc:5484] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:44.169337 1082 tablet_bootstrap.cc:492] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap replayed 1/1 log segments. Stats: ops{read=188 overwritten=0 applied=188 ignored=0} inserts{seen=509 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:56:44.169962 1082 tablet_bootstrap.cc:492] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap complete.
I20240502 01:56:44.171183 1082 ts_tablet_manager.cc:1367] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.189s user 0.175s sys 0.012s
I20240502 01:56:44.171948 1082 raft_consensus.cc:348] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:44.172138 1082 raft_consensus.cc:729] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:44.172425 1082 consensus_queue.cc:260] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 188, Last appended: 1.188, Last appended by leader: 188, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:44.172617 1082 raft_consensus.cc:388] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:44.172703 1082 raft_consensus.cc:482] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:44.172819 1082 raft_consensus.cc:3037] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:56:44.174830 1082 raft_consensus.cc:504] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:44.175096 1082 leader_election.cc:302] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:44.175287 1082 leader_election.cc:288] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 01:56:44.175424 1101 raft_consensus.cc:2781] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:56:44.175637 1101 raft_consensus.cc:686] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985 [term 2 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:44.175873 1082 ts_tablet_manager.cc:1398] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20240502 01:56:44.175940 1101 consensus_queue.cc:237] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 188, Committed index: 188, Last appended: 1.188, Last appended by leader: 188, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:44.176157 1082 tablet_bootstrap.cc:492] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:44.178773 744 catalog_manager.cc:5484] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:44.360189 1082 tablet_bootstrap.cc:492] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap replayed 1/1 log segments. Stats: ops{read=192 overwritten=0 applied=192 ignored=0} inserts{seen=512 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:56:44.360729 1082 tablet_bootstrap.cc:492] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap complete.
I20240502 01:56:44.361765 1082 ts_tablet_manager.cc:1367] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.186s user 0.165s sys 0.020s
I20240502 01:56:44.362452 1082 raft_consensus.cc:348] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:44.362630 1082 raft_consensus.cc:729] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:44.362906 1082 consensus_queue.cc:260] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 192, Last appended: 1.192, Last appended by leader: 192, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:44.363057 1082 raft_consensus.cc:388] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:44.363154 1082 raft_consensus.cc:482] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:44.363248 1082 raft_consensus.cc:3037] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:56:44.365482 1082 raft_consensus.cc:504] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:44.365732 1082 leader_election.cc:302] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:44.365939 1082 leader_election.cc:288] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 01:56:44.366007 1101 raft_consensus.cc:2781] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:56:44.366247 1101 raft_consensus.cc:686] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985 [term 2 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:44.366456 1082 ts_tablet_manager.cc:1398] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.005s user 0.000s sys 0.004s
I20240502 01:56:44.366533 1101 consensus_queue.cc:237] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 192, Committed index: 192, Last appended: 1.192, Last appended by leader: 192, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:44.366747 1082 tablet_bootstrap.cc:492] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:44.369233 744 catalog_manager.cc:5484] T c69ca6f4204a4d7badf4bf2e9923bdba P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:44.559015 1082 tablet_bootstrap.cc:492] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap replayed 1/1 log segments. Stats: ops{read=193 overwritten=0 applied=193 ignored=0} inserts{seen=530 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:56:44.559702 1082 tablet_bootstrap.cc:492] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap complete.
I20240502 01:56:44.561053 1082 ts_tablet_manager.cc:1367] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.194s user 0.155s sys 0.036s
I20240502 01:56:44.561945 1082 raft_consensus.cc:348] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:44.562177 1082 raft_consensus.cc:729] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:44.562439 1082 consensus_queue.cc:260] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 193, Last appended: 1.193, Last appended by leader: 193, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:44.562603 1082 raft_consensus.cc:388] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:44.562690 1082 raft_consensus.cc:482] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:44.562801 1082 raft_consensus.cc:3037] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:56:44.564916 1082 raft_consensus.cc:504] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:44.565192 1082 leader_election.cc:302] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:44.565457 1082 leader_election.cc:288] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 01:56:44.565593 1101 raft_consensus.cc:2781] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:56:44.565804 1101 raft_consensus.cc:686] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:44.565935 1082 ts_tablet_manager.cc:1398] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.005s user 0.008s sys 0.000s
I20240502 01:56:44.566203 1082 tablet_bootstrap.cc:492] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:44.566121 1101 consensus_queue.cc:237] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 193, Committed index: 193, Last appended: 1.193, Last appended by leader: 193, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:44.569185 744 catalog_manager.cc:5484] T 11e6a662c8154187918dd3b26a2a53c3 P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:44.775728 1082 tablet_bootstrap.cc:492] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap replayed 1/1 log segments. Stats: ops{read=185 overwritten=0 applied=185 ignored=0} inserts{seen=492 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:56:44.776257 1082 tablet_bootstrap.cc:492] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap complete.
I20240502 01:56:44.777302 1082 ts_tablet_manager.cc:1367] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.211s user 0.163s sys 0.020s
I20240502 01:56:44.778052 1082 raft_consensus.cc:348] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:44.778234 1082 raft_consensus.cc:729] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:44.778474 1082 consensus_queue.cc:260] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 185, Last appended: 1.185, Last appended by leader: 185, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:44.778617 1082 raft_consensus.cc:388] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:44.778730 1082 raft_consensus.cc:482] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:44.778823 1082 raft_consensus.cc:3037] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:56:44.781756 1082 raft_consensus.cc:504] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:44.782011 1082 leader_election.cc:302] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:44.782248 1082 leader_election.cc:288] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 01:56:44.782305 1101 raft_consensus.cc:2781] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:56:44.782527 1101 raft_consensus.cc:686] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:44.782737 1082 ts_tablet_manager.cc:1398] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20240502 01:56:44.782816 1101 consensus_queue.cc:237] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 185, Committed index: 185, Last appended: 1.185, Last appended by leader: 185, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:44.783001 1082 tablet_bootstrap.cc:492] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:44.785866 744 catalog_manager.cc:5484] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:44.986706 1082 tablet_bootstrap.cc:492] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap replayed 1/1 log segments. Stats: ops{read=195 overwritten=0 applied=195 ignored=0} inserts{seen=537 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:56:44.987318 1082 tablet_bootstrap.cc:492] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap complete.
I20240502 01:56:44.988736 1082 ts_tablet_manager.cc:1367] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.206s user 0.182s sys 0.020s
I20240502 01:56:44.989682 1082 raft_consensus.cc:348] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:44.989926 1082 raft_consensus.cc:729] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:44.990173 1082 consensus_queue.cc:260] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:44.990337 1082 raft_consensus.cc:388] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:44.990417 1082 raft_consensus.cc:482] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:44.990530 1082 raft_consensus.cc:3037] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:56:44.993825 1082 raft_consensus.cc:504] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:44.994181 1082 leader_election.cc:302] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:44.994477 1082 leader_election.cc:288] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 01:56:44.994675 1101 raft_consensus.cc:2781] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:56:44.994880 1101 raft_consensus.cc:686] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:44.995059 1082 ts_tablet_manager.cc:1398] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20240502 01:56:44.995183 1101 consensus_queue.cc:237] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 195, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:44.995350 1082 tablet_bootstrap.cc:492] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:44.998363 744 catalog_manager.cc:5484] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:45.210063 1082 tablet_bootstrap.cc:492] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap replayed 1/1 log segments. Stats: ops{read=194 overwritten=0 applied=194 ignored=0} inserts{seen=523 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:56:45.210649 1082 tablet_bootstrap.cc:492] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap complete.
I20240502 01:56:45.211663 1082 ts_tablet_manager.cc:1367] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.216s user 0.182s sys 0.032s
I20240502 01:56:45.212416 1082 raft_consensus.cc:348] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:45.212590 1082 raft_consensus.cc:729] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:45.212860 1082 consensus_queue.cc:260] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 194, Last appended: 1.194, Last appended by leader: 194, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:45.213025 1082 raft_consensus.cc:388] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:45.213135 1082 raft_consensus.cc:482] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:45.213274 1082 raft_consensus.cc:3037] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:56:45.215225 1082 raft_consensus.cc:504] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:45.215461 1082 leader_election.cc:302] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:45.215677 1082 leader_election.cc:288] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 01:56:45.215746 1101 raft_consensus.cc:2781] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:56:45.215978 1101 raft_consensus.cc:686] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:45.216202 1082 ts_tablet_manager.cc:1398] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240502 01:56:45.216248 1101 consensus_queue.cc:237] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 194, Committed index: 194, Last appended: 1.194, Last appended by leader: 194, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:45.216533 1082 tablet_bootstrap.cc:492] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:45.219411 744 catalog_manager.cc:5484] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:45.415711 1082 tablet_bootstrap.cc:492] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap replayed 1/1 log segments. Stats: ops{read=197 overwritten=0 applied=197 ignored=0} inserts{seen=560 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:56:45.416160 1082 tablet_bootstrap.cc:492] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap complete.
I20240502 01:56:45.417119 1082 ts_tablet_manager.cc:1367] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.201s user 0.165s sys 0.032s
I20240502 01:56:45.417773 1082 raft_consensus.cc:348] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:45.417940 1082 raft_consensus.cc:729] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:45.418179 1082 consensus_queue.cc:260] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 197, Last appended: 1.197, Last appended by leader: 197, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:45.418332 1082 raft_consensus.cc:388] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:45.418411 1082 raft_consensus.cc:482] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:45.418517 1082 raft_consensus.cc:3037] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:56:45.420359 1082 raft_consensus.cc:504] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:45.420591 1082 leader_election.cc:302] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:45.420778 1082 leader_election.cc:288] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 01:56:45.420904 1101 raft_consensus.cc:2781] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:56:45.421108 1101 raft_consensus.cc:686] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985 [term 2 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:45.421312 1082 ts_tablet_manager.cc:1398] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240502 01:56:45.421447 1101 consensus_queue.cc:237] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 197, Committed index: 197, Last appended: 1.197, Last appended by leader: 197, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:45.421602 1082 tablet_bootstrap.cc:492] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap starting.
I20240502 01:56:45.424358 744 catalog_manager.cc:5484] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:45.605836 1082 tablet_bootstrap.cc:492] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap replayed 1/1 log segments. Stats: ops{read=186 overwritten=0 applied=186 ignored=0} inserts{seen=478 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:56:45.606323 1082 tablet_bootstrap.cc:492] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985: Bootstrap complete.
I20240502 01:56:45.607286 1082 ts_tablet_manager.cc:1367] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985: Time spent bootstrapping tablet: real 0.186s user 0.168s sys 0.016s
I20240502 01:56:45.607929 1082 raft_consensus.cc:348] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:45.608093 1082 raft_consensus.cc:729] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Initialized, Role: FOLLOWER
I20240502 01:56:45.608311 1082 consensus_queue.cc:260] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 186, Last appended: 1.186, Last appended by leader: 186, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:45.608434 1082 raft_consensus.cc:388] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:56:45.608503 1082 raft_consensus.cc:482] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:56:45.608568 1082 raft_consensus.cc:3037] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:56:45.610494 1082 raft_consensus.cc:504] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:45.610719 1082 leader_election.cc:302] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3d82e05ada14e6c9393bbaae8d88985; no voters:
I20240502 01:56:45.610899 1082 leader_election.cc:288] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 01:56:45.611059 1101 raft_consensus.cc:2781] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:56:45.611266 1101 raft_consensus.cc:686] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985 [term 2 LEADER]: Becoming Leader. State: Replica: c3d82e05ada14e6c9393bbaae8d88985, State: Running, Role: LEADER
I20240502 01:56:45.611435 1082 ts_tablet_manager.cc:1398] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20240502 01:56:45.611732 1101 consensus_queue.cc:237] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 186, Committed index: 186, Last appended: 1.186, Last appended by leader: 186, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } }
I20240502 01:56:45.614714 744 catalog_manager.cc:5484] T f489372a5a044d8e937c22d47fbf012a P c3d82e05ada14e6c9393bbaae8d88985 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "c3d82e05ada14e6c9393bbaae8d88985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3d82e05ada14e6c9393bbaae8d88985" member_type: VOTER last_known_addr { host: "127.27.215.129" port: 38143 } health_report { overall_health: HEALTHY } } }
I20240502 01:56:45.656716 1173 ts_tablet_manager.cc:902] T 061b85c3b39e4ad5a37aee8c2eedebe3 P 617b001dc8134c21a5ace2b0b230818e: Initiating tablet copy from peer c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129:38143)
I20240502 01:56:45.659734 1177 ts_tablet_manager.cc:902] T ce929e1dde744ca5a1fac80bc6dedd6e P 617b001dc8134c21a5ace2b0b230818e: Initiating tablet copy from peer c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129:38143)
I20240502 01:56:45.667172 1189 ts_tablet_manager.cc:902] T 973e137d8ede43b98bfe6414e5d45b35 P 617b001dc8134c21a5ace2b0b230818e: Initiating tablet copy from peer c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129:38143)
I20240502 01:56:45.668697 1185 ts_tablet_manager.cc:902] T c0eb986300e046a0bc8d76f833028ab8 P 617b001dc8134c21a5ace2b0b230818e: Initiating tablet copy from peer c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129:38143)
I20240502 01:56:45.670114 1182 ts_tablet_manager.cc:902] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P 617b001dc8134c21a5ace2b0b230818e: Initiating tablet copy from peer c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129:38143)
I20240502 01:56:45.670965 1172 ts_tablet_manager.cc:902] T 543e8b00ccf44f40a995150bdab2c4b6 P 617b001dc8134c21a5ace2b0b230818e: Initiating tablet copy from peer c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129:38143)
I20240502 01:56:45.682909 1181 ts_tablet_manager.cc:902] T bbde935d2bc644dd9beb8a3d2e417658 P 617b001dc8134c21a5ace2b0b230818e: Initiating tablet copy from peer c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129:38143)
I20240502 01:56:45.685770 1179 ts_tablet_manager.cc:902] T 69cb274b201d46bca78efa7d53c0f7d1 P 617b001dc8134c21a5ace2b0b230818e: Initiating tablet copy from peer c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129:38143)
I20240502 01:56:45.687129 1186 ts_tablet_manager.cc:902] T c8c84eae62744f3e99ac4c75fdd796fb P 617b001dc8134c21a5ace2b0b230818e: Initiating tablet copy from peer c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129:38143)
I20240502 01:56:45.688369 1183 ts_tablet_manager.cc:902] T 3907fc0853ff48189e9f32b65742f5b6 P 617b001dc8134c21a5ace2b0b230818e: Initiating tablet copy from peer c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129:38143)
I20240502 01:56:45.689129 1189 tablet_copy_client.cc:308] T 973e137d8ede43b98bfe6414e5d45b35 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:38143
I20240502 01:56:45.689555 1184 ts_tablet_manager.cc:902] T afc558ecc01b4575ae5e8055f9499d89 P 617b001dc8134c21a5ace2b0b230818e: Initiating tablet copy from peer c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129:38143)
I20240502 01:56:45.690881 1174 ts_tablet_manager.cc:902] T 058c687b8c6744faa2136721a285b24d P 617b001dc8134c21a5ace2b0b230818e: Initiating tablet copy from peer c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129:38143)
I20240502 01:56:45.692023 1176 ts_tablet_manager.cc:902] T e024604ddf064f14a75df50c286074c5 P 617b001dc8134c21a5ace2b0b230818e: Initiating tablet copy from peer c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129:38143)
I20240502 01:56:45.693143 1178 ts_tablet_manager.cc:902] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P 617b001dc8134c21a5ace2b0b230818e: Initiating tablet copy from peer c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129:38143)
I20240502 01:56:45.694240 1188 ts_tablet_manager.cc:902] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P 617b001dc8134c21a5ace2b0b230818e: Initiating tablet copy from peer c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129:38143)
I20240502 01:56:45.695300 1180 ts_tablet_manager.cc:902] T ecdea67458ca42c3a200f3b30b82f071 P 617b001dc8134c21a5ace2b0b230818e: Initiating tablet copy from peer c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129:38143)
I20240502 01:56:45.696677 1171 ts_tablet_manager.cc:902] T c69ca6f4204a4d7badf4bf2e9923bdba P 617b001dc8134c21a5ace2b0b230818e: Initiating tablet copy from peer c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129:38143)
F20240502 01:56:45.697178 1171 trace_metrics.cc:68] Check failed: g_intern_map->size() < 100 (100 vs. 100) Too many interned strings: (MaintenanceMgr.queue_time_us, MaintenanceMgr.queue_time_us) (MaintenanceMgr.run_cpu_time_us, MaintenanceMgr.run_cpu_time_us) (MaintenanceMgr.run_wall_time_us, MaintenanceMgr.run_wall_time_us) (apply.queue_time_us, apply.queue_time_us) (apply.run_cpu_time_us, apply.run_cpu_time_us) (apply.run_wall_time_us, apply.run_wall_time_us) (client-negotiator.queue_time_us, client-negotiator.queue_time_us) (client-negotiator.run_cpu_time_us, client-negotiator.run_cpu_time_us) (client-negotiator.run_wall_time_us, client-negotiator.run_wall_time_us) (compiler_manager_pool.queue_time_us, compiler_manager_pool.queue_time_us) (compiler_manager_pool.run_cpu_time_us, compiler_manager_pool.run_cpu_time_us) (compiler_manager_pool.run_wall_time_us, compiler_manager_pool.run_wall_time_us) (dirs.queue_time_us, dirs.queue_time_us) (dirs.run_cpu_time_us, dirs.run_cpu_time_us) (dirs.run_wall_time_us, dirs.run_wall_time_us) (dns-resolver.queue_time_us, dns-resolver.queue_time_us) (dns-resolver.run_cpu_time_us, dns-resolver.run_cpu_time_us) (dns-resolver.run_wall_time_us, dns-resolver.run_wall_time_us) (prepare.queue_time_us, prepare.queue_time_us) (prepare.run_cpu_time_us, prepare.run_cpu_time_us) (prepare.run_wall_time_us, prepare.run_wall_time_us) (raft.queue_time_us, raft.queue_time_us) (raft.run_cpu_time_us, raft.run_cpu_time_us) (raft.run_wall_time_us, raft.run_wall_time_us) (repair_pool.queue_time_us, repair_pool.queue_time_us) (repair_pool.run_cpu_time_us, repair_pool.run_cpu_time_us) (repair_pool.run_wall_time_us, repair_pool.run_wall_time_us) (server-negotiator.queue_time_us, server-negotiator.queue_time_us) (server-negotiator.run_cpu_time_us, server-negotiator.run_cpu_time_us) (server-negotiator.run_wall_time_us, server-negotiator.run_wall_time_us) (tablet-copy.queue_time_us, tablet-copy.queue_time_us) (tablet-copy.run_cpu_time_us, tablet-copy.run_cpu_time_us) (tablet-copy.run_wall_time_us, tablet-copy.run_wall_time_us) (tablet-delete.queue_time_us, tablet-delete.queue_time_us) (tablet-delete.run_cpu_time_us, tablet-delete.run_cpu_time_us) (tablet-delete.run_wall_time_us, tablet-delete.run_wall_time_us) (tablet-download-pool-058c687b8c6744faa2136721a285b24d.queue_time_us, tablet-download-pool-058c687b8c6744faa2136721a285b24d.queue_time_us) (tablet-download-pool-058c687b8c6744faa2136721a285b24d.run_cpu_time_us, tablet-download-pool-058c687b8c6744faa2136721a285b24d.run_cpu_time_us) (tablet-download-pool-058c687b8c6744faa2136721a285b24d.run_wall_time_us, tablet-download-pool-058c687b8c6744faa2136721a285b24d.run_wall_time_us) (tablet-download-pool-061b85c3b39e4ad5a37aee8c2eedebe3.queue_time_us, tablet-download-pool-061b85c3b39e4ad5a37aee8c2eedebe3.queue_time_us) (tablet-download-pool-061b85c3b39e4ad5a37aee8c2eedebe3.run_cpu_time_us, tablet-download-pool-061b85c3b39e4ad5a37aee8c2eedebe3.run_cpu_time_us) (tablet-download-pool-061b85c3b39e4ad5a37aee8c2eedebe3.run_wall_time_us, tablet-download-pool-061b85c3b39e4ad5a37aee8c2eedebe3.run_wall_time_us) (tablet-download-pool-0fcad6d06fdc4cc5865f1f94f9ad15cb.queue_time_us, tablet-download-pool-0fcad6d06fdc4cc5865f1f94f9ad15cb.queue_time_us) (tablet-download-pool-0fcad6d06fdc4cc5865f1f94f9ad15cb.run_cpu_time_us, tablet-download-pool-0fcad6d06fdc4cc5865f1f94f9ad15cb.run_cpu_time_us) (tablet-download-pool-0fcad6d06fdc4cc5865f1f94f9ad15cb.run_wall_time_us, tablet-download-pool-0fcad6d06fdc4cc5865f1f94f9ad15cb.run_wall_time_us) (tablet-download-pool-24aa0d82fe9f4ca2889bccf2e63ec9c5.queue_time_us, tablet-download-pool-24aa0d82fe9f4ca2889bccf2e63ec9c5.queue_time_us) (tablet-download-pool-24aa0d82fe9f4ca2889bccf2e63ec9c5.run_cpu_time_us, tablet-download-pool-24aa0d82fe9f4ca2889bccf2e63ec9c5.run_cpu_time_us) (tablet-download-pool-24aa0d82fe9f4ca2889bccf2e63ec9c5.run_wall_time_us, tablet-download-pool-24aa0d82fe9f4ca2889bccf2e63ec9c5.run_wall_time_us) (tablet-download-pool-3907fc0853ff48189e9f32b65742f5b6.queue_time_us, tablet-download-pool-3907fc0853ff48189e9f32b65742f5b6.queue_time_us) (tablet-download-pool-3907fc0853ff48189e9f32b65742f5b6.run_cpu_time_us, tablet-download-pool-3907fc0853ff48189e9f32b65742f5b6.run_cpu_time_us) (tablet-download-pool-3907fc0853ff48189e9f32b65742f5b6.run_wall_time_us, tablet-download-pool-3907fc0853ff48189e9f32b65742f5b6.run_wall_time_us) (tablet-download-pool-543e8b00ccf44f40a995150bdab2c4b6.queue_time_us, tablet-download-pool-543e8b00ccf44f40a995150bdab2c4b6.queue_time_us) (tablet-download-pool-543e8b00ccf44f40a995150bdab2c4b6.run_cpu_time_us, tablet-download-pool-543e8b00ccf44f40a995150bdab2c4b6.run_cpu_time_us) (tablet-download-pool-543e8b00ccf44f40a995150bdab2c4b6.run_wall_time_us, tablet-download-pool-543e8b00ccf44f40a995150bdab2c4b6.run_wall_time_us) (tablet-download-pool-69cb274b201d46bca78efa7d53c0f7d1.queue_time_us, tablet-download-pool-69cb274b201d46bca78efa7d53c0f7d1.queue_time_us) (tablet-download-pool-69cb274b201d46bca78efa7d53c0f7d1.run_cpu_time_us, tablet-download-pool-69cb274b201d46bca78efa7d53c0f7d1.run_cpu_time_us) (tablet-download-pool-69cb274b201d46bca78efa7d53c0f7d1.run_wall_time_us, tablet-download-pool-69cb274b201d46bca78efa7d53c0f7d1.run_wall_time_us) (tablet-download-pool-973e137d8ede43b98bfe6414e5d45b35.queue_time_us, tablet-download-pool-973e137d8ede43b98bfe6414e5d45b35.queue_time_us) (tablet-download-pool-973e137d8ede43b98bfe6414e5d45b35.run_cpu_time_us, tablet-download-pool-973e137d8ede43b98bfe6414e5d45b35.run_cpu_time_us) (tablet-download-pool-973e137d8ede43b98bfe6414e5d45b35.run_wall_time_us, tablet-download-pool-973e137d8ede43b98bfe6414e5d45b35.run_wall_time_us) (tablet-download-pool-afc558ecc01b4575ae5e8055f9499d89.queue_time_us, tablet-download-pool-afc558ecc01b4575ae5e8055f9499d89.queue_time_us) (tablet-download-pool-afc558ecc01b4575ae5e8055f9499d89.run_cpu_time_us, tablet-download-pool-afc558ecc01b4575ae5e8055f9499d89.run_cpu_time_us) (tablet-download-pool-afc558ecc01b4575ae5e8055f9499d89.run_wall_time_us, tablet-download-pool-afc558ecc01b4575ae5e8055f9499d89.run_wall_time_us) (tablet-download-pool-bbde935d2bc644dd9beb8a3d2e417658.queue_time_us, tablet-download-pool-bbde935d2bc644dd9beb8a3d2e417658.queue_time_us) (tablet-download-pool-bbde935d2bc644dd9beb8a3d2e417658.run_cpu_time_us, tablet-download-pool-bbde935d2bc644dd9beb8a3d2e417658.run_cpu_time_us) (tablet-download-pool-bbde935d2bc644dd9beb8a3d2e417658.run_wall_time_us, tablet-download-pool-bbde935d2bc644dd9beb8a3d2e417658.run_wall_time_us) (tablet-download-pool-c0eb986300e046a0bc8d76f833028ab8.queue_time_us, tablet-download-pool-c0eb986300e046a0bc8d76f833028ab8.queue_time_us) (tablet-download-pool-c0eb986300e046a0bc8d76f833028ab8.run_cpu_time_us, tablet-download-pool-c0eb986300e046a0bc8d76f833028ab8.run_cpu_time_us) (tablet-download-pool-c0eb986300e046a0bc8d76f833028ab8.run_wall_time_us, tablet-download-pool-c0eb986300e046a0bc8d76f833028ab8.run_wall_time_us) (tablet-download-pool-c69ca6f4204a4d7badf4bf2e9923bdba.queue_time_us, tablet-download-pool-c69ca6f4204a4d7badf4bf2e9923bdba.queue_time_us) (tablet-download-pool-c8c84eae62744f3e99ac4c75fdd796fb.queue_time_us, tablet-download-pool-c8c84eae62744f3e99ac4c75fdd796fb.queue_time_us) (tablet-download-pool-c8c84eae62744f3e99ac4c75fdd796fb.run_cpu_time_us, tablet-download-pool-c8c84eae62744f3e99ac4c75fdd796fb.run_cpu_time_us) (tablet-download-pool-c8c84eae62744f3e99ac4c75fdd796fb.run_wall_time_us, tablet-download-pool-c8c84eae62744f3e99ac4c75fdd796fb.run_wall_time_us) (tablet-download-pool-ce929e1dde744ca5a1fac80bc6dedd6e.queue_time_us, tablet-download-pool-ce929e1dde744ca5a1fac80bc6dedd6e.queue_time_us) (tablet-download-pool-ce929e1dde744ca5a1fac80bc6dedd6e.run_cpu_time_us, tablet-download-pool-ce929e1dde744ca5a1fac80bc6dedd6e.run_cpu_time_us) (tablet-download-pool-ce929e1dde744ca5a1fac80bc6dedd6e.run_wall_time_us, tablet-download-pool-ce929e1dde744ca5a1fac80bc6dedd6e.run_wall_time_us) (tablet-download-pool-e024604ddf064f14a75df50c286074c5.queue_time_us, tablet-download-pool-e024604ddf064f14a75df50c286074c5.queue_time_us) (tablet-download-pool-e024604ddf064f14a75df50c286074c5.run_cpu_time_us, tablet-download-pool-e024604ddf064f14a75df50c286074c5.run_cpu_time_us) (tablet-download-pool-e024604ddf064f14a75df50c286074c5.run_wall_time_us, tablet-download-pool-e024604ddf064f14a75df50c286074c5.run_wall_time_us) (tablet-download-pool-ecdea67458ca42c3a200f3b30b82f071.queue_time_us, tablet-download-pool-ecdea67458ca42c3a200f3b30b82f071.queue_time_us) (tablet-download-pool-ecdea67458ca42c3a200f3b30b82f071.run_cpu_time_us, tablet-download-pool-ecdea67458ca42c3a200f3b30b82f071.run_cpu_time_us) (tablet-download-pool-ecdea67458ca42c3a200f3b30b82f071.run_wall_time_us, tablet-download-pool-ecdea67458ca42c3a200f3b30b82f071.run_wall_time_us) (tablet-download-pool-fc2e63f8b5874c908d5ec98c8bbf6aa3.queue_time_us, tablet-download-pool-fc2e63f8b5874c908d5ec98c8bbf6aa3.queue_time_us) (tablet-download-pool-fc2e63f8b5874c908d5ec98c8bbf6aa3.run_cpu_time_us, tablet-download-pool-fc2e63f8b5874c908d5ec98c8bbf6aa3.run_cpu_time_us) (tablet-download-pool-fc2e63f8b5874c908d5ec98c8bbf6aa3.run_wall_time_us, tablet-download-pool-fc2e63f8b5874c908d5ec98c8bbf6aa3.run_wall_time_us) (tablet-open.queue_time_us, tablet-open.queue_time_us) (tablet-open.run_cpu_time_us, tablet-open.run_cpu_time_us) (tablet-open.run_wall_time_us, tablet-open.run_wall_time_us) (txn-commit.queue_time_us, txn-commit.queue_time_us) (txn-commit.run_cpu_time_us, txn-commit.run_cpu_time_us) (txn-commit.run_wall_time_us, txn-commit.run_wall_time_us) (txn-participant-registration.queue_time_us, txn-participant-registration.queue_time_us) (txn-participant-registration.run_cpu_time_us, txn-participant-registration.run_cpu_time_us) (txn-participant-registration.run_wall_time_us, txn-participant-registration.run_wall_time_us) (txn-status-manager.queue_time_us, txn-status-manager.queue_time_us) (txn-status-manager.run_cpu_time_us, txn-status-manager.run_cpu_time_us) (txn-status-manager.run_wall_time_us, txn-status-manager.run_wall_time_us) (txn-status-tablet-reload.queue_time_us, txn-status-tablet-reload.queue_time_us) (txn-status-tablet-reload.run_cpu_time_us, txn-status-tablet-reload.run_cpu_time_us) (txn-status-tablet-reload.run_wall_time_us, txn-status-tablet-reload.run_wall_time_us)
*** Check failure stack trace: ***
I20240502 01:56:45.706036 1190 ts_tablet_manager.cc:902] T f489372a5a044d8e937c22d47fbf012a P 617b001dc8134c21a5ace2b0b230818e: Initiating tablet copy from peer c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129:38143)
@ 0x7f1881398dcd google::LogMessage::Fail() at ??:0
I20240502 01:56:45.699627 1173 tablet_copy_client.cc:308] T 061b85c3b39e4ad5a37aee8c2eedebe3 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:38143
I20240502 01:56:45.700872 1175 ts_tablet_manager.cc:902] T 11e6a662c8154187918dd3b26a2a53c3 P 617b001dc8134c21a5ace2b0b230818e: Initiating tablet copy from peer c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129:38143)
I20240502 01:56:45.705657 1187 ts_tablet_manager.cc:902] T 4bf45f2db51b49e08fd09bad98bfab7f P 617b001dc8134c21a5ace2b0b230818e: Initiating tablet copy from peer c3d82e05ada14e6c9393bbaae8d88985 (127.27.215.129:38143)
I20240502 01:56:45.724829 1182 tablet_copy_client.cc:308] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:38143
I20240502 01:56:45.730216 1185 tablet_copy_client.cc:308] T c0eb986300e046a0bc8d76f833028ab8 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:38143
I20240502 01:56:45.730998 1186 tablet_copy_client.cc:308] T c8c84eae62744f3e99ac4c75fdd796fb P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:38143
I20240502 01:56:45.737123 1088 tablet_copy_service.cc:140] P c3d82e05ada14e6c9393bbaae8d88985: Received BeginTabletCopySession request for tablet 973e137d8ede43b98bfe6414e5d45b35 from peer 617b001dc8134c21a5ace2b0b230818e ({username='slave'} at 127.27.215.130:45665)
W20240502 01:56:45.737452 1076 service_pool.cc:135] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.27.215.130:45665 dropped due to backpressure. The service queue is full; it has 1 items.
I20240502 01:56:45.737548 1088 tablet_copy_service.cc:161] P c3d82e05ada14e6c9393bbaae8d88985: Beginning new tablet copy session on tablet 973e137d8ede43b98bfe6414e5d45b35 from peer 617b001dc8134c21a5ace2b0b230818e at {username='slave'} at 127.27.215.130:45665: session id = 617b001dc8134c21a5ace2b0b230818e-973e137d8ede43b98bfe6414e5d45b35
@ 0x7f188139cb93 google::LogMessage::SendToLog() at ??:0
I20240502 01:56:45.737936 1076 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.27.215.130:45665 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.27.215.130:45665 (request call id 1)
I20240502 01:56:45.738538 1076 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.27.215.130:45665 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.27.215.130:45665 (request call id 1)
I20240502 01:56:45.738883 1076 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.27.215.130:45665 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.27.215.130:45665 (request call id 1)
@ 0x7f18813987cc google::LogMessage::Flush() at ??:0
I20240502 01:56:45.741740 1088 tablet_copy_source_session.cc:205] T 973e137d8ede43b98bfe6414e5d45b35 P c3d82e05ada14e6c9393bbaae8d88985: Tablet Copy: opened 0 blocks and 1 log segments
@ 0x7f1881399f59 google::LogMessageFatal::~LogMessageFatal() at ??:0
I20240502 01:56:45.747620 1189 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 973e137d8ede43b98bfe6414e5d45b35. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f18840d9742 kudu::TraceMetrics::InternName() at ??:0
I20240502 01:56:45.750242 1076 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.27.215.130:45665 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.27.215.130:45665 (request call id 5)
I20240502 01:56:45.750618 1076 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.27.215.130:45665 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.27.215.130:45665 (request call id 5)
I20240502 01:56:45.750967 1076 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.27.215.130:45665 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.27.215.130:45665 (request call id 7)
I20240502 01:56:45.753564 1088 tablet_copy_service.cc:140] P c3d82e05ada14e6c9393bbaae8d88985: Received BeginTabletCopySession request for tablet 0fcad6d06fdc4cc5865f1f94f9ad15cb from peer 617b001dc8134c21a5ace2b0b230818e ({username='slave'} at 127.27.215.130:45665)
I20240502 01:56:45.753758 1088 tablet_copy_service.cc:161] P c3d82e05ada14e6c9393bbaae8d88985: Beginning new tablet copy session on tablet 0fcad6d06fdc4cc5865f1f94f9ad15cb from peer 617b001dc8134c21a5ace2b0b230818e at {username='slave'} at 127.27.215.130:45665: session id = 617b001dc8134c21a5ace2b0b230818e-0fcad6d06fdc4cc5865f1f94f9ad15cb
@ 0x7f18840a5f8b kudu::ThreadPool::ThreadPool() at ??:0
I20240502 01:56:45.756770 1088 tablet_copy_source_session.cc:205] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P c3d82e05ada14e6c9393bbaae8d88985: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:56:45.758349 1182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0fcad6d06fdc4cc5865f1f94f9ad15cb. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f188409fcd6 kudu::ThreadPoolBuilder::Build() at ??:0
I20240502 01:56:45.764792 1088 tablet_copy_service.cc:140] P c3d82e05ada14e6c9393bbaae8d88985: Received BeginTabletCopySession request for tablet 061b85c3b39e4ad5a37aee8c2eedebe3 from peer 617b001dc8134c21a5ace2b0b230818e ({username='slave'} at 127.27.215.130:45665)
I20240502 01:56:45.764983 1088 tablet_copy_service.cc:161] P c3d82e05ada14e6c9393bbaae8d88985: Beginning new tablet copy session on tablet 061b85c3b39e4ad5a37aee8c2eedebe3 from peer 617b001dc8134c21a5ace2b0b230818e at {username='slave'} at 127.27.215.130:45665: session id = 617b001dc8134c21a5ace2b0b230818e-061b85c3b39e4ad5a37aee8c2eedebe3
I20240502 01:56:45.768366 1088 tablet_copy_source_session.cc:205] T 061b85c3b39e4ad5a37aee8c2eedebe3 P c3d82e05ada14e6c9393bbaae8d88985: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:56:45.770960 1173 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 061b85c3b39e4ad5a37aee8c2eedebe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:45.782665 1088 tablet_copy_service.cc:140] P c3d82e05ada14e6c9393bbaae8d88985: Received BeginTabletCopySession request for tablet c0eb986300e046a0bc8d76f833028ab8 from peer 617b001dc8134c21a5ace2b0b230818e ({username='slave'} at 127.27.215.130:45665)
I20240502 01:56:45.782950 1088 tablet_copy_service.cc:161] P c3d82e05ada14e6c9393bbaae8d88985: Beginning new tablet copy session on tablet c0eb986300e046a0bc8d76f833028ab8 from peer 617b001dc8134c21a5ace2b0b230818e at {username='slave'} at 127.27.215.130:45665: session id = 617b001dc8134c21a5ace2b0b230818e-c0eb986300e046a0bc8d76f833028ab8
I20240502 01:56:45.785300 1179 tablet_copy_client.cc:308] T 69cb274b201d46bca78efa7d53c0f7d1 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:38143
I20240502 01:56:45.788053 1088 tablet_copy_source_session.cc:205] T c0eb986300e046a0bc8d76f833028ab8 P c3d82e05ada14e6c9393bbaae8d88985: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:56:45.788280 1172 tablet_copy_client.cc:308] T 543e8b00ccf44f40a995150bdab2c4b6 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:38143
I20240502 01:56:45.789163 1088 tablet_copy_service.cc:140] P c3d82e05ada14e6c9393bbaae8d88985: Received BeginTabletCopySession request for tablet 69cb274b201d46bca78efa7d53c0f7d1 from peer 617b001dc8134c21a5ace2b0b230818e ({username='slave'} at 127.27.215.130:45665)
I20240502 01:56:45.789389 1174 tablet_copy_client.cc:308] T 058c687b8c6744faa2136721a285b24d P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:38143
I20240502 01:56:45.789417 1088 tablet_copy_service.cc:161] P c3d82e05ada14e6c9393bbaae8d88985: Beginning new tablet copy session on tablet 69cb274b201d46bca78efa7d53c0f7d1 from peer 617b001dc8134c21a5ace2b0b230818e at {username='slave'} at 127.27.215.130:45665: session id = 617b001dc8134c21a5ace2b0b230818e-69cb274b201d46bca78efa7d53c0f7d1
I20240502 01:56:45.790671 1189 tablet_copy_client.cc:783] T 973e137d8ede43b98bfe6414e5d45b35 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Starting download of 0 data blocks...
I20240502 01:56:45.791326 1189 tablet_copy_client.cc:647] T 973e137d8ede43b98bfe6414e5d45b35 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Starting download of 1 WAL segments...
I20240502 01:56:45.792394 1076 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.27.215.130:45665 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.27.215.130:45665 (request call id 12)
I20240502 01:56:45.792421 1188 tablet_copy_client.cc:308] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:38143
I20240502 01:56:45.792837 1076 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.27.215.130:45665 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.27.215.130:45665 (request call id 12)
I20240502 01:56:45.794173 1185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0eb986300e046a0bc8d76f833028ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:45.794376 1182 tablet_copy_client.cc:783] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Starting download of 0 data blocks...
I20240502 01:56:45.795176 1076 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.27.215.130:45665 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.27.215.130:45665 (request call id 12)
I20240502 01:56:45.797019 1088 tablet_copy_source_session.cc:205] T 69cb274b201d46bca78efa7d53c0f7d1 P c3d82e05ada14e6c9393bbaae8d88985: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:56:45.799930 1088 tablet_copy_service.cc:140] P c3d82e05ada14e6c9393bbaae8d88985: Received BeginTabletCopySession request for tablet c8c84eae62744f3e99ac4c75fdd796fb from peer 617b001dc8134c21a5ace2b0b230818e ({username='slave'} at 127.27.215.130:45665)
I20240502 01:56:45.800148 1088 tablet_copy_service.cc:161] P c3d82e05ada14e6c9393bbaae8d88985: Beginning new tablet copy session on tablet c8c84eae62744f3e99ac4c75fdd796fb from peer 617b001dc8134c21a5ace2b0b230818e at {username='slave'} at 127.27.215.130:45665: session id = 617b001dc8134c21a5ace2b0b230818e-c8c84eae62744f3e99ac4c75fdd796fb
I20240502 01:56:45.804183 1088 tablet_copy_source_session.cc:205] T c8c84eae62744f3e99ac4c75fdd796fb P c3d82e05ada14e6c9393bbaae8d88985: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:56:45.805419 1182 tablet_copy_client.cc:647] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Starting download of 1 WAL segments...
I20240502 01:56:45.813712 1088 tablet_copy_service.cc:140] P c3d82e05ada14e6c9393bbaae8d88985: Received BeginTabletCopySession request for tablet 058c687b8c6744faa2136721a285b24d from peer 617b001dc8134c21a5ace2b0b230818e ({username='slave'} at 127.27.215.130:45665)
I20240502 01:56:45.813982 1186 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8c84eae62744f3e99ac4c75fdd796fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:45.813977 1088 tablet_copy_service.cc:161] P c3d82e05ada14e6c9393bbaae8d88985: Beginning new tablet copy session on tablet 058c687b8c6744faa2136721a285b24d from peer 617b001dc8134c21a5ace2b0b230818e at {username='slave'} at 127.27.215.130:45665: session id = 617b001dc8134c21a5ace2b0b230818e-058c687b8c6744faa2136721a285b24d
I20240502 01:56:45.816756 1179 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69cb274b201d46bca78efa7d53c0f7d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:45.818251 1088 tablet_copy_source_session.cc:205] T 058c687b8c6744faa2136721a285b24d P c3d82e05ada14e6c9393bbaae8d88985: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:56:45.820394 1174 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 058c687b8c6744faa2136721a285b24d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:45.821686 1076 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.27.215.130:45665 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.27.215.130:45665 (request call id 17)
I20240502 01:56:45.823499 1088 tablet_copy_service.cc:140] P c3d82e05ada14e6c9393bbaae8d88985: Received BeginTabletCopySession request for tablet 24aa0d82fe9f4ca2889bccf2e63ec9c5 from peer 617b001dc8134c21a5ace2b0b230818e ({username='slave'} at 127.27.215.130:45665)
I20240502 01:56:45.823752 1088 tablet_copy_service.cc:161] P c3d82e05ada14e6c9393bbaae8d88985: Beginning new tablet copy session on tablet 24aa0d82fe9f4ca2889bccf2e63ec9c5 from peer 617b001dc8134c21a5ace2b0b230818e at {username='slave'} at 127.27.215.130:45665: session id = 617b001dc8134c21a5ace2b0b230818e-24aa0d82fe9f4ca2889bccf2e63ec9c5
I20240502 01:56:45.827914 1088 tablet_copy_source_session.cc:205] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P c3d82e05ada14e6c9393bbaae8d88985: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:56:45.830374 1088 tablet_copy_service.cc:140] P c3d82e05ada14e6c9393bbaae8d88985: Received BeginTabletCopySession request for tablet 543e8b00ccf44f40a995150bdab2c4b6 from peer 617b001dc8134c21a5ace2b0b230818e ({username='slave'} at 127.27.215.130:45665)
I20240502 01:56:45.830624 1088 tablet_copy_service.cc:161] P c3d82e05ada14e6c9393bbaae8d88985: Beginning new tablet copy session on tablet 543e8b00ccf44f40a995150bdab2c4b6 from peer 617b001dc8134c21a5ace2b0b230818e at {username='slave'} at 127.27.215.130:45665: session id = 617b001dc8134c21a5ace2b0b230818e-543e8b00ccf44f40a995150bdab2c4b6
I20240502 01:56:45.840549 1173 tablet_copy_client.cc:783] T 061b85c3b39e4ad5a37aee8c2eedebe3 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Starting download of 0 data blocks...
I20240502 01:56:45.840956 1173 tablet_copy_client.cc:647] T 061b85c3b39e4ad5a37aee8c2eedebe3 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Starting download of 1 WAL segments...
I20240502 01:56:45.843542 1088 tablet_copy_source_session.cc:205] T 543e8b00ccf44f40a995150bdab2c4b6 P c3d82e05ada14e6c9393bbaae8d88985: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:56:45.854607 1184 tablet_copy_client.cc:308] T afc558ecc01b4575ae5e8055f9499d89 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:38143
I20240502 01:56:45.856055 1188 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24aa0d82fe9f4ca2889bccf2e63ec9c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:45.857266 1183 tablet_copy_client.cc:308] T 3907fc0853ff48189e9f32b65742f5b6 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:38143
I20240502 01:56:45.865708 1185 tablet_copy_client.cc:783] T c0eb986300e046a0bc8d76f833028ab8 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Starting download of 0 data blocks...
I20240502 01:56:45.866004 1185 tablet_copy_client.cc:647] T c0eb986300e046a0bc8d76f833028ab8 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Starting download of 1 WAL segments...
I20240502 01:56:45.867071 1181 tablet_copy_client.cc:308] T bbde935d2bc644dd9beb8a3d2e417658 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:38143
I20240502 01:56:45.867651 1180 tablet_copy_client.cc:308] T ecdea67458ca42c3a200f3b30b82f071 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:38143
I20240502 01:56:45.868994 1088 tablet_copy_service.cc:140] P c3d82e05ada14e6c9393bbaae8d88985: Received BeginTabletCopySession request for tablet 3907fc0853ff48189e9f32b65742f5b6 from peer 617b001dc8134c21a5ace2b0b230818e ({username='slave'} at 127.27.215.130:45665)
I20240502 01:56:45.869171 1088 tablet_copy_service.cc:161] P c3d82e05ada14e6c9393bbaae8d88985: Beginning new tablet copy session on tablet 3907fc0853ff48189e9f32b65742f5b6 from peer 617b001dc8134c21a5ace2b0b230818e at {username='slave'} at 127.27.215.130:45665: session id = 617b001dc8134c21a5ace2b0b230818e-3907fc0853ff48189e9f32b65742f5b6
I20240502 01:56:45.871173 1088 tablet_copy_source_session.cc:205] T 3907fc0853ff48189e9f32b65742f5b6 P c3d82e05ada14e6c9393bbaae8d88985: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:56:45.871547 1179 tablet_copy_client.cc:783] T 69cb274b201d46bca78efa7d53c0f7d1 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Starting download of 0 data blocks...
I20240502 01:56:45.871997 1172 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 543e8b00ccf44f40a995150bdab2c4b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:45.873634 1177 tablet_copy_client.cc:308] T ce929e1dde744ca5a1fac80bc6dedd6e P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:38143
I20240502 01:56:45.873826 1176 tablet_copy_client.cc:308] T e024604ddf064f14a75df50c286074c5 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:38143
I20240502 01:56:45.876502 1179 tablet_copy_client.cc:647] T 69cb274b201d46bca78efa7d53c0f7d1 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Starting download of 1 WAL segments...
I20240502 01:56:45.878077 1088 tablet_copy_service.cc:140] P c3d82e05ada14e6c9393bbaae8d88985: Received BeginTabletCopySession request for tablet afc558ecc01b4575ae5e8055f9499d89 from peer 617b001dc8134c21a5ace2b0b230818e ({username='slave'} at 127.27.215.130:45665)
I20240502 01:56:45.878245 1088 tablet_copy_service.cc:161] P c3d82e05ada14e6c9393bbaae8d88985: Beginning new tablet copy session on tablet afc558ecc01b4575ae5e8055f9499d89 from peer 617b001dc8134c21a5ace2b0b230818e at {username='slave'} at 127.27.215.130:45665: session id = 617b001dc8134c21a5ace2b0b230818e-afc558ecc01b4575ae5e8055f9499d89
I20240502 01:56:45.880940 1088 tablet_copy_source_session.cc:205] T afc558ecc01b4575ae5e8055f9499d89 P c3d82e05ada14e6c9393bbaae8d88985: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:56:45.880985 1076 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.27.215.130:45665 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.27.215.130:45665 (request call id 24)
I20240502 01:56:45.881407 1088 tablet_copy_service.cc:140] P c3d82e05ada14e6c9393bbaae8d88985: Received BeginTabletCopySession request for tablet ecdea67458ca42c3a200f3b30b82f071 from peer 617b001dc8134c21a5ace2b0b230818e ({username='slave'} at 127.27.215.130:45665)
I20240502 01:56:45.881592 1088 tablet_copy_service.cc:161] P c3d82e05ada14e6c9393bbaae8d88985: Beginning new tablet copy session on tablet ecdea67458ca42c3a200f3b30b82f071 from peer 617b001dc8134c21a5ace2b0b230818e at {username='slave'} at 127.27.215.130:45665: session id = 617b001dc8134c21a5ace2b0b230818e-ecdea67458ca42c3a200f3b30b82f071
I20240502 01:56:45.882418 1178 tablet_copy_client.cc:308] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Beginning tablet copy session from remote peer at address 127.27.215.129:38143
I20240502 01:56:45.884896 1088 tablet_copy_source_session.cc:205] T ecdea67458ca42c3a200f3b30b82f071 P c3d82e05ada14e6c9393bbaae8d88985: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:56:45.885607 1182 tablet_copy_client.cc:523] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:56:45.888378 1173 tablet_copy_client.cc:523] T 061b85c3b39e4ad5a37aee8c2eedebe3 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:56:45.889246 1189 tablet_copy_client.cc:523] T 973e137d8ede43b98bfe6414e5d45b35 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:56:45.890236 1088 tablet_copy_service.cc:140] P c3d82e05ada14e6c9393bbaae8d88985: Received BeginTabletCopySession request for tablet bbde935d2bc644dd9beb8a3d2e417658 from peer 617b001dc8134c21a5ace2b0b230818e ({username='slave'} at 127.27.215.130:45665)
I20240502 01:56:45.890432 1088 tablet_copy_service.cc:161] P c3d82e05ada14e6c9393bbaae8d88985: Beginning new tablet copy session on tablet bbde935d2bc644dd9beb8a3d2e417658 from peer 617b001dc8134c21a5ace2b0b230818e at {username='slave'} at 127.27.215.130:45665: session id = 617b001dc8134c21a5ace2b0b230818e-bbde935d2bc644dd9beb8a3d2e417658
I20240502 01:56:45.890460 1076 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.27.215.130:45665 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.27.215.130:45665 (request call id 27)
I20240502 01:56:45.890614 1183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3907fc0853ff48189e9f32b65742f5b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:45.890897 1076 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.27.215.130:45665 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.27.215.130:45665 (request call id 27)
I20240502 01:56:45.891398 1076 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.27.215.130:45665 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.27.215.130:45665 (request call id 27)
I20240502 01:56:45.892148 1184 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afc558ecc01b4575ae5e8055f9499d89. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:45.894811 1174 tablet_copy_client.cc:783] T 058c687b8c6744faa2136721a285b24d P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Starting download of 0 data blocks...
I20240502 01:56:45.895855 1088 tablet_copy_source_session.cc:205] T bbde935d2bc644dd9beb8a3d2e417658 P c3d82e05ada14e6c9393bbaae8d88985: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:56:45.895890 1076 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.27.215.130:45665 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.27.215.130:45665 (request call id 31)
I20240502 01:56:45.896318 1088 tablet_copy_service.cc:140] P c3d82e05ada14e6c9393bbaae8d88985: Received BeginTabletCopySession request for tablet ce929e1dde744ca5a1fac80bc6dedd6e from peer 617b001dc8134c21a5ace2b0b230818e ({username='slave'} at 127.27.215.130:45665)
I20240502 01:56:45.896485 1088 tablet_copy_service.cc:161] P c3d82e05ada14e6c9393bbaae8d88985: Beginning new tablet copy session on tablet ce929e1dde744ca5a1fac80bc6dedd6e from peer 617b001dc8134c21a5ace2b0b230818e at {username='slave'} at 127.27.215.130:45665: session id = 617b001dc8134c21a5ace2b0b230818e-ce929e1dde744ca5a1fac80bc6dedd6e
I20240502 01:56:45.898890 1088 tablet_copy_source_session.cc:205] T ce929e1dde744ca5a1fac80bc6dedd6e P c3d82e05ada14e6c9393bbaae8d88985: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:56:45.900840 1088 tablet_copy_service.cc:140] P c3d82e05ada14e6c9393bbaae8d88985: Received BeginTabletCopySession request for tablet fc2e63f8b5874c908d5ec98c8bbf6aa3 from peer 617b001dc8134c21a5ace2b0b230818e ({username='slave'} at 127.27.215.130:45665)
I20240502 01:56:45.901019 1088 tablet_copy_service.cc:161] P c3d82e05ada14e6c9393bbaae8d88985: Beginning new tablet copy session on tablet fc2e63f8b5874c908d5ec98c8bbf6aa3 from peer 617b001dc8134c21a5ace2b0b230818e at {username='slave'} at 127.27.215.130:45665: session id = 617b001dc8134c21a5ace2b0b230818e-fc2e63f8b5874c908d5ec98c8bbf6aa3
I20240502 01:56:45.904603 1088 tablet_copy_source_session.cc:205] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P c3d82e05ada14e6c9393bbaae8d88985: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:56:45.901891 1174 tablet_copy_client.cc:647] T 058c687b8c6744faa2136721a285b24d P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Starting download of 1 WAL segments...
I20240502 01:56:45.908812 1180 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ecdea67458ca42c3a200f3b30b82f071. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f18934f28de kudu::tserver::TabletCopyClient::TabletCopyClient() at ??:0
I20240502 01:56:45.912003 1188 tablet_copy_client.cc:783] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Starting download of 0 data blocks...
I20240502 01:56:45.912590 1177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce929e1dde744ca5a1fac80bc6dedd6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:45.917079 1181 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbde935d2bc644dd9beb8a3d2e417658. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:45.917181 1183 tablet_copy_client.cc:783] T 3907fc0853ff48189e9f32b65742f5b6 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Starting download of 0 data blocks...
I20240502 01:56:45.919083 1182 tablet_bootstrap.cc:492] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P 617b001dc8134c21a5ace2b0b230818e: Bootstrap starting.
I20240502 01:56:45.920357 1177 tablet_copy_client.cc:783] T ce929e1dde744ca5a1fac80bc6dedd6e P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Starting download of 0 data blocks...
I20240502 01:56:45.920730 1177 tablet_copy_client.cc:647] T ce929e1dde744ca5a1fac80bc6dedd6e P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Starting download of 1 WAL segments...
I20240502 01:56:45.921533 1173 tablet_bootstrap.cc:492] T 061b85c3b39e4ad5a37aee8c2eedebe3 P 617b001dc8134c21a5ace2b0b230818e: Bootstrap starting.
I20240502 01:56:45.924234 1179 tablet_copy_client.cc:523] T 69cb274b201d46bca78efa7d53c0f7d1 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:56:45.924746 1189 tablet_bootstrap.cc:492] T 973e137d8ede43b98bfe6414e5d45b35 P 617b001dc8134c21a5ace2b0b230818e: Bootstrap starting.
I20240502 01:56:45.925299 1076 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.27.215.130:45665 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.27.215.130:45665 (request call id 35)
I20240502 01:56:45.925753 1076 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.27.215.130:45665 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.27.215.130:45665 (request call id 35)
I20240502 01:56:45.925966 1088 tablet_copy_service.cc:140] P c3d82e05ada14e6c9393bbaae8d88985: Received BeginTabletCopySession request for tablet e024604ddf064f14a75df50c286074c5 from peer 617b001dc8134c21a5ace2b0b230818e ({username='slave'} at 127.27.215.130:45665)
I20240502 01:56:45.926156 1088 tablet_copy_service.cc:161] P c3d82e05ada14e6c9393bbaae8d88985: Beginning new tablet copy session on tablet e024604ddf064f14a75df50c286074c5 from peer 617b001dc8134c21a5ace2b0b230818e at {username='slave'} at 127.27.215.130:45665: session id = 617b001dc8134c21a5ace2b0b230818e-e024604ddf064f14a75df50c286074c5
I20240502 01:56:45.930449 1088 tablet_copy_source_session.cc:205] T e024604ddf064f14a75df50c286074c5 P c3d82e05ada14e6c9393bbaae8d88985: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:56:45.932606 1188 tablet_copy_client.cc:647] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Starting download of 1 WAL segments...
I20240502 01:56:45.933627 1185 tablet_copy_client.cc:523] T c0eb986300e046a0bc8d76f833028ab8 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:56:45.933785 1181 tablet_copy_client.cc:783] T bbde935d2bc644dd9beb8a3d2e417658 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Starting download of 0 data blocks...
I20240502 01:56:45.936352 1183 tablet_copy_client.cc:647] T 3907fc0853ff48189e9f32b65742f5b6 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Starting download of 1 WAL segments...
I20240502 01:56:45.939358 1184 tablet_copy_client.cc:783] T afc558ecc01b4575ae5e8055f9499d89 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Starting download of 0 data blocks...
I20240502 01:56:45.939885 1181 tablet_copy_client.cc:647] T bbde935d2bc644dd9beb8a3d2e417658 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Starting download of 1 WAL segments...
I20240502 01:56:45.941035 1178 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc2e63f8b5874c908d5ec98c8bbf6aa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:45.943363 1176 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e024604ddf064f14a75df50c286074c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:56:45.944270 1179 tablet_bootstrap.cc:492] T 69cb274b201d46bca78efa7d53c0f7d1 P 617b001dc8134c21a5ace2b0b230818e: Bootstrap starting.
I20240502 01:56:45.948516 1184 tablet_copy_client.cc:647] T afc558ecc01b4575ae5e8055f9499d89 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Starting download of 1 WAL segments...
I20240502 01:56:45.951186 1176 tablet_copy_client.cc:783] T e024604ddf064f14a75df50c286074c5 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Starting download of 0 data blocks...
I20240502 01:56:45.966224 1176 tablet_copy_client.cc:647] T e024604ddf064f14a75df50c286074c5 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Starting download of 1 WAL segments...
I20240502 01:56:45.966657 1185 tablet_bootstrap.cc:492] T c0eb986300e046a0bc8d76f833028ab8 P 617b001dc8134c21a5ace2b0b230818e: Bootstrap starting.
@ 0x7f189350adaf kudu::tserver::RemoteTabletCopyClient::RemoteTabletCopyClient() at ??:0
I20240502 01:56:45.978116 1174 tablet_copy_client.cc:523] T 058c687b8c6744faa2136721a285b24d P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:56:45.978932 1076 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.27.215.130:45665 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.27.215.130:45665 (request call id 40)
I20240502 01:56:45.979315 1076 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.27.215.130:45665 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.27.215.130:45665 (request call id 40)
I20240502 01:56:45.979863 1076 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.27.215.130:45665 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.27.215.130:45665 (request call id 43)
I20240502 01:56:45.986439 1186 tablet_copy_client.cc:783] T c8c84eae62744f3e99ac4c75fdd796fb P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Starting download of 0 data blocks...
I20240502 01:56:45.987094 1180 tablet_copy_client.cc:783] T ecdea67458ca42c3a200f3b30b82f071 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Starting download of 0 data blocks...
I20240502 01:56:45.991204 1177 tablet_copy_client.cc:523] T ce929e1dde744ca5a1fac80bc6dedd6e P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:56:45.991250 1180 tablet_copy_client.cc:647] T ecdea67458ca42c3a200f3b30b82f071 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Starting download of 1 WAL segments...
I20240502 01:56:45.992014 1181 tablet_copy_client.cc:523] T bbde935d2bc644dd9beb8a3d2e417658 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:56:45.992308 1172 tablet_copy_client.cc:783] T 543e8b00ccf44f40a995150bdab2c4b6 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Starting download of 0 data blocks...
I20240502 01:56:45.992832 1186 tablet_copy_client.cc:647] T c8c84eae62744f3e99ac4c75fdd796fb P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Starting download of 1 WAL segments...
I20240502 01:56:45.996588 1076 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.27.215.130:45665 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.27.215.130:45665 (request call id 46)
I20240502 01:56:45.998983 1184 tablet_copy_client.cc:523] T afc558ecc01b4575ae5e8055f9499d89 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:56:46.000480 1172 tablet_copy_client.cc:647] T 543e8b00ccf44f40a995150bdab2c4b6 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Starting download of 1 WAL segments...
I20240502 01:56:46.002168 1183 tablet_copy_client.cc:523] T 3907fc0853ff48189e9f32b65742f5b6 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:56:46.015707 1188 tablet_copy_client.cc:523] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:56:46.016763 1076 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.27.215.130:45665 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.27.215.130:45665 (request call id 49)
I20240502 01:56:46.017509 1181 tablet_bootstrap.cc:492] T bbde935d2bc644dd9beb8a3d2e417658 P 617b001dc8134c21a5ace2b0b230818e: Bootstrap starting.
I20240502 01:56:46.019356 1174 tablet_bootstrap.cc:492] T 058c687b8c6744faa2136721a285b24d P 617b001dc8134c21a5ace2b0b230818e: Bootstrap starting.
I20240502 01:56:46.021292 1186 tablet_copy_client.cc:523] T c8c84eae62744f3e99ac4c75fdd796fb P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:56:46.024030 1184 tablet_bootstrap.cc:492] T afc558ecc01b4575ae5e8055f9499d89 P 617b001dc8134c21a5ace2b0b230818e: Bootstrap starting.
I20240502 01:56:46.030347 1177 tablet_bootstrap.cc:492] T ce929e1dde744ca5a1fac80bc6dedd6e P 617b001dc8134c21a5ace2b0b230818e: Bootstrap starting.
I20240502 01:56:46.030827 1172 tablet_copy_client.cc:523] T 543e8b00ccf44f40a995150bdab2c4b6 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:56:46.037992 1183 tablet_bootstrap.cc:492] T 3907fc0853ff48189e9f32b65742f5b6 P 617b001dc8134c21a5ace2b0b230818e: Bootstrap starting.
I20240502 01:56:46.045607 1186 tablet_bootstrap.cc:492] T c8c84eae62744f3e99ac4c75fdd796fb P 617b001dc8134c21a5ace2b0b230818e: Bootstrap starting.
I20240502 01:56:46.045737 1188 tablet_bootstrap.cc:492] T 24aa0d82fe9f4ca2889bccf2e63ec9c5 P 617b001dc8134c21a5ace2b0b230818e: Bootstrap starting.
I20240502 01:56:46.058421 1176 tablet_copy_client.cc:523] T e024604ddf064f14a75df50c286074c5 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:56:46.069886 1172 tablet_bootstrap.cc:492] T 543e8b00ccf44f40a995150bdab2c4b6 P 617b001dc8134c21a5ace2b0b230818e: Bootstrap starting.
I20240502 01:56:46.074133 1178 tablet_copy_client.cc:783] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Starting download of 0 data blocks...
I20240502 01:56:46.077103 1180 tablet_copy_client.cc:523] T ecdea67458ca42c3a200f3b30b82f071 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:56:46.077185 1178 tablet_copy_client.cc:647] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Starting download of 1 WAL segments...
@ 0x7f1893635480 kudu::tserver::TSTabletManager::RunTabletCopy() at ??:0
I20240502 01:56:46.106169 1180 tablet_bootstrap.cc:492] T ecdea67458ca42c3a200f3b30b82f071 P 617b001dc8134c21a5ace2b0b230818e: Bootstrap starting.
I20240502 01:56:46.113685 1178 tablet_copy_client.cc:523] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P 617b001dc8134c21a5ace2b0b230818e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:56:46.121591 1176 tablet_bootstrap.cc:492] T e024604ddf064f14a75df50c286074c5 P 617b001dc8134c21a5ace2b0b230818e: Bootstrap starting.
I20240502 01:56:46.136526 1178 tablet_bootstrap.cc:492] T fc2e63f8b5874c908d5ec98c8bbf6aa3 P 617b001dc8134c21a5ace2b0b230818e: Bootstrap starting.
@ 0x7f189366da8d kudu::tserver::TabletCopyRunnable::Run() at ??:0
@ 0x7f1893650981 kudu::tserver::TSTabletManager::StartTabletCopy()::$_12::operator()() at ??:0
@ 0x7f189365070e std::_Function_handler<>::_M_invoke() at ??:0
@ 0xa60bcd std::function<>::operator()() at ??:?
@ 0x7f18840a9b75 kudu::ThreadPool::DispatchThread() at ??:0
I20240502 01:56:46.389122 1182 log.cc:824] T 0fcad6d06fdc4cc5865f1f94f9ad15cb P 617b001dc8134c21a5ace2b0b230818e: Log is configured to *not* fsync() on all Append() calls
@ 0x7f18840ad19c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f18840ad019 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xa60bcd std::function<>::operator()() at ??:?
@ 0x7f188408801e kudu::Thread::SuperviseThread() at ??:0
@ 0x7f188740d6db start_thread at ??:0
@ 0x7f188024b71f clone at ??:0
W20240502 01:56:46.749030 351 connection.cc:535] client connection to 127.27.215.130:36617 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
F20240502 01:56:46.749979 1170 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: F20240502 01:56:46.749940 1160 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: F20240502 01:56:46.750039 1149 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
F20240502 01:56:46.749979 1170 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: F20240502 01:56:46.749940 1160 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: F20240502 01:56:46.750039 1149 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
*** Check failure stack trace: ***
*** Aborted at 1714615006 (unix time) try "date -d @1714615006" if you are using GNU date ***
F20240502 01:56:46.749928 1169 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
F20240502 01:56:46.749979 1170 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: F20240502 01:56:46.749940 1160 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: F20240502 01:56:46.750039 1149 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e800006f5e) received by PID 28510 (TID 0x7f17c512b700) from PID 28510; stack trace: ***
@ 0x7f17dc238980 (unknown) at ??:0
@ 0x7f17d52e3fb7 gsignal at ??:0
@ 0x7f17d52e5921 abort at ??:0
@ 0x7f17d800cdcd google::LogMessage::Fail() at ??:0
@ 0x7f17d8010b93 google::LogMessage::SendToLog() at ??:0
@ 0x7f17d800c7cc google::LogMessage::Flush() at ??:0
@ 0x7f17d800df59 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x3b9874 kudu::TabletCopyClientSessionITest_TestTabletCopyWithBusySource_Test::TestBody()::$_3::operator()() at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/tablet_copy_client_session-itest.cc:313
@ 0x3b926e std::__invoke_impl<>() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/invoke.h:60
@ 0x3b91ee std::__invoke<>() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/invoke.h:95
@ 0x3b91b3 _ZNSt6thread8_InvokerISt5tupleIJZN4kudu62TabletCopyClientSessionITest_TestTabletCopyWithBusySource_Test8TestBodyEvE3$_3EEE9_M_invokeIJLm0EEEEDTclsr3stdE8__invokespcl10_S_declvalIXT_EEEEESt12_Index_tupleIJXspT_EEE at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:234
@ 0x3b917e std::thread::_Invoker<>::operator()() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:243
@ 0x3b9069 std::thread::_State_impl<>::_M_run() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:186
@ 0x7f17d596d6df (unknown) at ??:0
@ 0x7f17dc22d6db start_thread at ??:0
@ 0x7f17d53c671f clone at ??:0