[==========] Running 5 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 5 tests from TabletCopyClientSessionITest
[ RUN ] TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping
2024-05-03T14:15:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-03T14:15:41Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20240503 14:15:41.414259 25877 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
/tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.69.126:35521
--webserver_interface=127.25.69.126
--webserver_port=0
--builtin_ntp_servers=127.25.69.84:38153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.69.126:35521
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240503 14:15:41.710960 25885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 14:15:41.711221 25885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 14:15:41.711298 25885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 14:15:41.717730 25885 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240503 14:15:41.717818 25885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 14:15:41.717864 25885 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240503 14:15:41.717916 25885 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240503 14:15:41.725955 25885 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.69.84:38153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.25.69.126:35521
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.69.126:35521
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.69.126
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 13:43:24 UTC on efd1337a2aa3
build id 107
ASAN enabled
I20240503 14:15:41.727202 25885 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 14:15:41.728772 25885 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:15:41.739104 25890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:15:41.739671 25891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:15:41.740350 25893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:15:41.741351 25885 server_base.cc:1034] running on GCE node
I20240503 14:15:41.742053 25885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 14:15:41.743330 25885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 14:15:41.744544 25885 hybrid_clock.cc:648] HybridClock initialized: now 1714745741744481 us; error 36 us; skew 500 ppm
I20240503 14:15:41.744869 25885 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:15:41.753367 25885 webserver.cc:460] Webserver started at http://127.25.69.126:36227/ using document root <none> and password file <none>
I20240503 14:15:41.754050 25885 fs_manager.cc:359] Metadata directory not provided
I20240503 14:15:41.754150 25885 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:15:41.754391 25885 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 14:15:41.756901 25885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/master-0/data/instance:
uuid: "dbc7fc62de7b4c8db532f03c2ea06d14"
format_stamp: "Formatted at 2024-05-03 14:15:41 on dist-test-slave-0c7n"
I20240503 14:15:41.757632 25885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/master-0/wal/instance:
uuid: "dbc7fc62de7b4c8db532f03c2ea06d14"
format_stamp: "Formatted at 2024-05-03 14:15:41 on dist-test-slave-0c7n"
I20240503 14:15:41.762805 25885 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20240503 14:15:41.765849 25899 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:41.766989 25885 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240503 14:15:41.767118 25885 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/master-0/data,/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/master-0/wal
uuid: "dbc7fc62de7b4c8db532f03c2ea06d14"
format_stamp: "Formatted at 2024-05-03 14:15:41 on dist-test-slave-0c7n"
I20240503 14:15:41.767297 25885 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:15:41.795527 25885 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:15:41.796293 25885 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 14:15:41.796588 25885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:15:41.813766 25885 rpc_server.cc:307] RPC server started. Bound to: 127.25.69.126:35521
I20240503 14:15:41.813788 25950 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.69.126:35521 every 8 connection(s)
I20240503 14:15:41.815059 25885 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/master-0/data/info.pb
I20240503 14:15:41.818472 25951 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:15:41.818874 25877 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu as pid 25885
I20240503 14:15:41.819156 25877 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/master-0/wal/instance
I20240503 14:15:41.829735 25951 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14: Bootstrap starting.
I20240503 14:15:41.832278 25951 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14: Neither blocks nor log segments found. Creating new log.
I20240503 14:15:41.833150 25951 log.cc:824] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14: Log is configured to *not* fsync() on all Append() calls
I20240503 14:15:41.835731 25951 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14: No bootstrap required, opened a new log
I20240503 14:15:41.841638 25951 raft_consensus.cc:348] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbc7fc62de7b4c8db532f03c2ea06d14" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 35521 } }
I20240503 14:15:41.841948 25951 raft_consensus.cc:374] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:15:41.842056 25951 raft_consensus.cc:729] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc7fc62de7b4c8db532f03c2ea06d14, State: Initialized, Role: FOLLOWER
I20240503 14:15:41.842628 25951 consensus_queue.cc:260] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbc7fc62de7b4c8db532f03c2ea06d14" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 35521 } }
I20240503 14:15:41.842851 25951 raft_consensus.cc:388] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:15:41.842999 25951 raft_consensus.cc:482] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:15:41.843178 25951 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:15:41.845690 25951 raft_consensus.cc:504] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbc7fc62de7b4c8db532f03c2ea06d14" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 35521 } }
I20240503 14:15:41.846179 25951 leader_election.cc:302] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dbc7fc62de7b4c8db532f03c2ea06d14; no voters:
I20240503 14:15:41.846711 25951 leader_election.cc:288] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 14:15:41.846880 25956 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:15:41.847491 25956 raft_consensus.cc:686] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14 [term 1 LEADER]: Becoming Leader. State: Replica: dbc7fc62de7b4c8db532f03c2ea06d14, State: Running, Role: LEADER
I20240503 14:15:41.848026 25956 consensus_queue.cc:237] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbc7fc62de7b4c8db532f03c2ea06d14" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 35521 } }
I20240503 14:15:41.848327 25951 sys_catalog.cc:564] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14 [sys.catalog]: configured and running, proceeding with master startup.
I20240503 14:15:41.850807 25958 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dbc7fc62de7b4c8db532f03c2ea06d14. Latest consensus state: current_term: 1 leader_uuid: "dbc7fc62de7b4c8db532f03c2ea06d14" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbc7fc62de7b4c8db532f03c2ea06d14" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 35521 } } }
I20240503 14:15:41.850787 25957 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dbc7fc62de7b4c8db532f03c2ea06d14" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbc7fc62de7b4c8db532f03c2ea06d14" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 35521 } } }
I20240503 14:15:41.851191 25958 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14 [sys.catalog]: This master's current role is: LEADER
I20240503 14:15:41.851197 25957 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14 [sys.catalog]: This master's current role is: LEADER
I20240503 14:15:41.857018 25965 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240503 14:15:41.860810 25965 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240503 14:15:41.868642 25965 catalog_manager.cc:1347] Generated new cluster ID: f5ceb84db3e1487faed6292126a91826
I20240503 14:15:41.868736 25965 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240503 14:15:41.878203 25965 catalog_manager.cc:1370] Generated new certificate authority record
I20240503 14:15:41.879171 25965 catalog_manager.cc:1504] Loading token signing keys...
I20240503 14:15:41.886735 25965 catalog_manager.cc:5857] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14: Generated new TSK 0
I20240503 14:15:41.887392 25965 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240503 14:15:41.898020 25877 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
/tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.69.65:0
--local_ip_for_outbound_sockets=127.25.69.65
--webserver_interface=127.25.69.65
--webserver_port=0
--tserver_master_addrs=127.25.69.126:35521
--builtin_ntp_servers=127.25.69.84:38153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240503 14:15:42.202277 25975 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 14:15:42.202541 25975 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 14:15:42.202626 25975 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 14:15:42.209466 25975 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 14:15:42.209637 25975 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.69.65
I20240503 14:15:42.217911 25975 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.69.84:38153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.69.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.69.65
--webserver_port=0
--tserver_master_addrs=127.25.69.126:35521
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.69.65
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 13:43:24 UTC on efd1337a2aa3
build id 107
ASAN enabled
I20240503 14:15:42.219206 25975 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 14:15:42.220796 25975 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:15:42.232976 25981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:15:42.233930 25983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:15:42.234362 25980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:15:42.235056 25975 server_base.cc:1034] running on GCE node
I20240503 14:15:42.235602 25975 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 14:15:42.236357 25975 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 14:15:42.237547 25975 hybrid_clock.cc:648] HybridClock initialized: now 1714745742237492 us; error 31 us; skew 500 ppm
I20240503 14:15:42.237807 25975 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:15:42.239884 25975 webserver.cc:460] Webserver started at http://127.25.69.65:37683/ using document root <none> and password file <none>
I20240503 14:15:42.240521 25975 fs_manager.cc:359] Metadata directory not provided
I20240503 14:15:42.240633 25975 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:15:42.240897 25975 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 14:15:42.243453 25975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/data/instance:
uuid: "3d51e5a9f26244d9939afe6bcf6e193f"
format_stamp: "Formatted at 2024-05-03 14:15:42 on dist-test-slave-0c7n"
I20240503 14:15:42.244159 25975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/wal/instance:
uuid: "3d51e5a9f26244d9939afe6bcf6e193f"
format_stamp: "Formatted at 2024-05-03 14:15:42 on dist-test-slave-0c7n"
I20240503 14:15:42.248906 25975 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20240503 14:15:42.252063 25989 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:42.253285 25975 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20240503 14:15:42.253434 25975 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/wal
uuid: "3d51e5a9f26244d9939afe6bcf6e193f"
format_stamp: "Formatted at 2024-05-03 14:15:42 on dist-test-slave-0c7n"
I20240503 14:15:42.253623 25975 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:15:42.266724 25975 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:15:42.267540 25975 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 14:15:42.267791 25975 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:15:42.268646 25975 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 14:15:42.270112 25975 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 14:15:42.270196 25975 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:42.270335 25975 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 14:15:42.270388 25975 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:42.299548 25975 rpc_server.cc:307] RPC server started. Bound to: 127.25.69.65:46353
I20240503 14:15:42.299574 26101 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.69.65:46353 every 8 connection(s)
I20240503 14:15:42.301072 25975 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/data/info.pb
I20240503 14:15:42.303072 25877 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu as pid 25975
I20240503 14:15:42.303428 25877 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/wal/instance
I20240503 14:15:42.307596 25877 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
/tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.69.66:0
--local_ip_for_outbound_sockets=127.25.69.66
--webserver_interface=127.25.69.66
--webserver_port=0
--tserver_master_addrs=127.25.69.126:35521
--builtin_ntp_servers=127.25.69.84:38153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240503 14:15:42.313654 26102 heartbeater.cc:347] Connected to a master server at 127.25.69.126:35521
I20240503 14:15:42.313928 26102 heartbeater.cc:464] Registering TS with master...
I20240503 14:15:42.314667 26102 heartbeater.cc:511] Master 127.25.69.126:35521 requested a full tablet report, sending...
I20240503 14:15:42.316538 25916 ts_manager.cc:194] Registered new tserver with Master: 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:42.317898 25916 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.69.65:42595
W20240503 14:15:42.619033 26105 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 14:15:42.619307 26105 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 14:15:42.619421 26105 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 14:15:42.626744 26105 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 14:15:42.626941 26105 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.69.66
I20240503 14:15:42.635638 26105 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.69.84:38153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.69.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.69.66
--webserver_port=0
--tserver_master_addrs=127.25.69.126:35521
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.69.66
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 13:43:24 UTC on efd1337a2aa3
build id 107
ASAN enabled
I20240503 14:15:42.636904 26105 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 14:15:42.638582 26105 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:15:42.650030 26110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:15:42.650568 26113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:15:42.651333 26111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:15:42.651902 26105 server_base.cc:1034] running on GCE node
I20240503 14:15:42.652472 26105 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 14:15:42.653390 26105 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 14:15:42.654595 26105 hybrid_clock.cc:648] HybridClock initialized: now 1714745742654544 us; error 33 us; skew 500 ppm
I20240503 14:15:42.654865 26105 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:15:42.656875 26105 webserver.cc:460] Webserver started at http://127.25.69.66:45785/ using document root <none> and password file <none>
I20240503 14:15:42.657619 26105 fs_manager.cc:359] Metadata directory not provided
I20240503 14:15:42.657737 26105 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:15:42.658025 26105 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 14:15:42.660399 26105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data/instance:
uuid: "c5409ba5401b40849ce7da3266b26d98"
format_stamp: "Formatted at 2024-05-03 14:15:42 on dist-test-slave-0c7n"
I20240503 14:15:42.661155 26105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/wal/instance:
uuid: "c5409ba5401b40849ce7da3266b26d98"
format_stamp: "Formatted at 2024-05-03 14:15:42 on dist-test-slave-0c7n"
I20240503 14:15:42.665889 26105 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20240503 14:15:42.668988 26119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:42.670212 26105 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240503 14:15:42.670363 26105 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/wal
uuid: "c5409ba5401b40849ce7da3266b26d98"
format_stamp: "Formatted at 2024-05-03 14:15:42 on dist-test-slave-0c7n"
I20240503 14:15:42.670547 26105 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:15:42.691320 26105 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:15:42.692028 26105 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 14:15:42.692265 26105 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:15:42.693096 26105 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 14:15:42.694515 26105 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 14:15:42.694591 26105 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:42.694710 26105 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 14:15:42.694769 26105 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:42.725662 26105 rpc_server.cc:307] RPC server started. Bound to: 127.25.69.66:39457
I20240503 14:15:42.725708 26231 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.69.66:39457 every 8 connection(s)
I20240503 14:15:42.726863 26105 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data/info.pb
I20240503 14:15:42.730494 25877 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu as pid 26105
I20240503 14:15:42.730674 25877 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/wal/instance
I20240503 14:15:42.738852 26232 heartbeater.cc:347] Connected to a master server at 127.25.69.126:35521
I20240503 14:15:42.739100 26232 heartbeater.cc:464] Registering TS with master...
I20240503 14:15:42.739799 26232 heartbeater.cc:511] Master 127.25.69.126:35521 requested a full tablet report, sending...
I20240503 14:15:42.740907 25916 ts_manager.cc:194] Registered new tserver with Master: c5409ba5401b40849ce7da3266b26d98 (127.25.69.66:39457)
I20240503 14:15:42.741679 25916 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.69.66:49521
I20240503 14:15:42.746774 25877 external_mini_cluster.cc:930] 2 TS(s) registered with all masters
I20240503 14:15:42.763370 25877 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu pid 26105
I20240503 14:15:42.771674 26227 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 14:15:42.859210 25877 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu with pid 26105
I20240503 14:15:42.875645 25877 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu pid 25885
I20240503 14:15:42.876679 25946 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 14:15:42.973903 25877 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu with pid 25885
I20240503 14:15:42.992025 25877 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
/tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.69.126:35521
--webserver_interface=127.25.69.126
--webserver_port=36227
--builtin_ntp_servers=127.25.69.84:38153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.69.126:35521
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240503 14:15:43.293443 26244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 14:15:43.293723 26244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 14:15:43.293869 26244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 14:15:43.301028 26244 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240503 14:15:43.301141 26244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 14:15:43.301234 26244 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240503 14:15:43.301322 26244 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240503 14:15:43.311002 26244 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.69.84:38153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.25.69.126:35521
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.69.126:35521
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.69.126
--webserver_port=36227
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 13:43:24 UTC on efd1337a2aa3
build id 107
ASAN enabled
I20240503 14:15:43.312216 26244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 14:15:43.314035 26244 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20240503 14:15:43.320341 26102 heartbeater.cc:503] Master 127.25.69.126:35521 was elected leader, sending a full tablet report...
W20240503 14:15:43.321782 26102 heartbeater.cc:644] Failed to heartbeat to 127.25.69.126:35521 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.25.69.126:35521: connect: Connection refused (error 111)
W20240503 14:15:43.324515 26249 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:15:43.325238 26252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:15:43.325871 26250 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:15:43.326543 26244 server_base.cc:1034] running on GCE node
I20240503 14:15:43.327208 26244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 14:15:43.328408 26244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 14:15:43.329608 26244 hybrid_clock.cc:648] HybridClock initialized: now 1714745743329547 us; error 33 us; skew 500 ppm
I20240503 14:15:43.329910 26244 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:15:43.331969 26244 webserver.cc:460] Webserver started at http://127.25.69.126:36227/ using document root <none> and password file <none>
I20240503 14:15:43.332592 26244 fs_manager.cc:359] Metadata directory not provided
I20240503 14:15:43.332731 26244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:15:43.337682 26244 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20240503 14:15:43.340400 26259 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:43.341645 26244 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240503 14:15:43.341810 26244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/master-0/data,/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/master-0/wal
uuid: "dbc7fc62de7b4c8db532f03c2ea06d14"
format_stamp: "Formatted at 2024-05-03 14:15:41 on dist-test-slave-0c7n"
I20240503 14:15:43.342670 26244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:15:43.364997 26244 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:15:43.365880 26244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 14:15:43.366199 26244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:15:43.384851 26244 rpc_server.cc:307] RPC server started. Bound to: 127.25.69.126:35521
I20240503 14:15:43.384867 26310 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.69.126:35521 every 8 connection(s)
I20240503 14:15:43.386355 26244 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/master-0/data/info.pb
I20240503 14:15:43.392172 26311 sys_catalog.cc:263] Verifying existing consensus state
I20240503 14:15:43.394896 26311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14: Bootstrap starting.
I20240503 14:15:43.396385 25877 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu as pid 26244
I20240503 14:15:43.412151 26311 log.cc:824] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14: Log is configured to *not* fsync() on all Append() calls
I20240503 14:15:43.419315 26311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:15:43.419760 26311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14: Bootstrap complete.
I20240503 14:15:43.426535 26311 raft_consensus.cc:348] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbc7fc62de7b4c8db532f03c2ea06d14" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 35521 } }
I20240503 14:15:43.427188 26311 raft_consensus.cc:729] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc7fc62de7b4c8db532f03c2ea06d14, State: Initialized, Role: FOLLOWER
I20240503 14:15:43.427729 26311 consensus_queue.cc:260] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbc7fc62de7b4c8db532f03c2ea06d14" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 35521 } }
I20240503 14:15:43.427930 26311 raft_consensus.cc:388] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:15:43.428025 26311 raft_consensus.cc:482] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:15:43.428170 26311 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:15:43.431385 26311 raft_consensus.cc:504] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbc7fc62de7b4c8db532f03c2ea06d14" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 35521 } }
I20240503 14:15:43.431810 26311 leader_election.cc:302] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dbc7fc62de7b4c8db532f03c2ea06d14; no voters:
I20240503 14:15:43.432351 26311 leader_election.cc:288] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 14:15:43.432490 26316 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:15:43.433212 26316 raft_consensus.cc:686] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14 [term 2 LEADER]: Becoming Leader. State: Replica: dbc7fc62de7b4c8db532f03c2ea06d14, State: Running, Role: LEADER
I20240503 14:15:43.433719 26316 consensus_queue.cc:237] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbc7fc62de7b4c8db532f03c2ea06d14" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 35521 } }
I20240503 14:15:43.434245 26311 sys_catalog.cc:564] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14 [sys.catalog]: configured and running, proceeding with master startup.
I20240503 14:15:43.435914 26318 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dbc7fc62de7b4c8db532f03c2ea06d14. Latest consensus state: current_term: 2 leader_uuid: "dbc7fc62de7b4c8db532f03c2ea06d14" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbc7fc62de7b4c8db532f03c2ea06d14" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 35521 } } }
I20240503 14:15:43.436219 26318 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14 [sys.catalog]: This master's current role is: LEADER
I20240503 14:15:43.436882 26317 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "dbc7fc62de7b4c8db532f03c2ea06d14" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbc7fc62de7b4c8db532f03c2ea06d14" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 35521 } } }
I20240503 14:15:43.437234 26317 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14 [sys.catalog]: This master's current role is: LEADER
I20240503 14:15:43.438993 26321 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240503 14:15:43.444553 26321 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240503 14:15:43.446015 26321 catalog_manager.cc:1259] Loaded cluster ID: f5ceb84db3e1487faed6292126a91826
I20240503 14:15:43.446133 26321 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240503 14:15:43.449692 26321 catalog_manager.cc:1504] Loading token signing keys...
I20240503 14:15:43.450809 26321 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dbc7fc62de7b4c8db532f03c2ea06d14: Loaded TSK: 0
I20240503 14:15:43.452001 26321 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240503 14:15:44.327872 26102 heartbeater.cc:347] Connected to a master server at 127.25.69.126:35521
I20240503 14:15:44.328064 26102 heartbeater.cc:503] Master 127.25.69.126:35521 was elected leader, sending a full tablet report...
I20240503 14:15:44.329705 26276 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "3d51e5a9f26244d9939afe6bcf6e193f" instance_seqno: 1714745742292867) as {username='slave'} at 127.25.69.65:59529; Asking this server to re-register.
I20240503 14:15:44.330348 26102 heartbeater.cc:464] Registering TS with master...
I20240503 14:15:44.330556 26102 heartbeater.cc:511] Master 127.25.69.126:35521 requested a full tablet report, sending...
I20240503 14:15:44.331641 26276 ts_manager.cc:194] Registered new tserver with Master: 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:44.333285 25877 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20240503 14:15:44.333554 25877 test_util.cc:268] Using random seed: 1526242001
I20240503 14:15:44.354398 26275 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43262:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20240503 14:15:44.375133 26037 tablet_service.cc:1467] Processing CreateTablet for tablet 1942c4894cbe441b86b6631dea870349 (DEFAULT_TABLE table=test-workload [id=9ab4d3cff2214d2393e2b726f362667b]), partition=RANGE (key) PARTITION UNBOUNDED
I20240503 14:15:44.376323 26037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1942c4894cbe441b86b6631dea870349. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:15:44.387071 26346 tablet_bootstrap.cc:492] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f: Bootstrap starting.
I20240503 14:15:44.390113 26346 tablet_bootstrap.cc:654] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f: Neither blocks nor log segments found. Creating new log.
I20240503 14:15:44.391084 26346 log.cc:824] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f: Log is configured to *not* fsync() on all Append() calls
I20240503 14:15:44.393568 26346 tablet_bootstrap.cc:492] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f: No bootstrap required, opened a new log
I20240503 14:15:44.393805 26346 ts_tablet_manager.cc:1367] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20240503 14:15:44.399252 26346 raft_consensus.cc:348] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d51e5a9f26244d9939afe6bcf6e193f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 46353 } }
I20240503 14:15:44.399518 26346 raft_consensus.cc:374] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:15:44.399613 26346 raft_consensus.cc:729] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d51e5a9f26244d9939afe6bcf6e193f, State: Initialized, Role: FOLLOWER
I20240503 14:15:44.400180 26346 consensus_queue.cc:260] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d51e5a9f26244d9939afe6bcf6e193f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 46353 } }
I20240503 14:15:44.400379 26346 raft_consensus.cc:388] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:15:44.400499 26346 raft_consensus.cc:482] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:15:44.400640 26346 raft_consensus.cc:3037] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:15:44.402550 26346 raft_consensus.cc:504] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d51e5a9f26244d9939afe6bcf6e193f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 46353 } }
I20240503 14:15:44.402984 26346 leader_election.cc:302] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3d51e5a9f26244d9939afe6bcf6e193f; no voters:
I20240503 14:15:44.403522 26346 leader_election.cc:288] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 14:15:44.403668 26348 raft_consensus.cc:2781] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:15:44.404485 26348 raft_consensus.cc:686] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [term 1 LEADER]: Becoming Leader. State: Replica: 3d51e5a9f26244d9939afe6bcf6e193f, State: Running, Role: LEADER
I20240503 14:15:44.405045 26348 consensus_queue.cc:237] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d51e5a9f26244d9939afe6bcf6e193f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 46353 } }
I20240503 14:15:44.405264 26346 ts_tablet_manager.cc:1398] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20240503 14:15:44.409353 26275 catalog_manager.cc:5484] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65). New cstate: current_term: 1 leader_uuid: "3d51e5a9f26244d9939afe6bcf6e193f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d51e5a9f26244d9939afe6bcf6e193f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 46353 } health_report { overall_health: HEALTHY } } }
I20240503 14:15:45.014338 25877 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
/tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.69.66:39457
--local_ip_for_outbound_sockets=127.25.69.66
--tserver_master_addrs=127.25.69.126:35521
--webserver_port=45785
--webserver_interface=127.25.69.66
--builtin_ntp_servers=127.25.69.84:38153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240503 14:15:45.330765 26364 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 14:15:45.331010 26364 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 14:15:45.331095 26364 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 14:15:45.338186 26364 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 14:15:45.338358 26364 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.69.66
I20240503 14:15:45.346773 26364 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.69.84:38153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.69.66:39457
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.69.66
--webserver_port=45785
--tserver_master_addrs=127.25.69.126:35521
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.69.66
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 13:43:24 UTC on efd1337a2aa3
build id 107
ASAN enabled
I20240503 14:15:45.347983 26364 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 14:15:45.349627 26364 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:15:45.361364 26370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:15:45.361864 26369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:15:45.362519 26372 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:15:45.363576 26364 server_base.cc:1034] running on GCE node
I20240503 14:15:45.364099 26364 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 14:15:45.364933 26364 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 14:15:45.366135 26364 hybrid_clock.cc:648] HybridClock initialized: now 1714745745366075 us; error 41 us; skew 500 ppm
I20240503 14:15:45.366492 26364 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:15:45.368659 26364 webserver.cc:460] Webserver started at http://127.25.69.66:45785/ using document root <none> and password file <none>
I20240503 14:15:45.369410 26364 fs_manager.cc:359] Metadata directory not provided
I20240503 14:15:45.369550 26364 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:15:45.374416 26364 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20240503 14:15:45.376952 26378 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:45.378144 26364 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240503 14:15:45.378288 26364 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/wal
uuid: "c5409ba5401b40849ce7da3266b26d98"
format_stamp: "Formatted at 2024-05-03 14:15:42 on dist-test-slave-0c7n"
I20240503 14:15:45.379092 26364 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:15:45.402997 26364 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:15:45.404058 26364 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 14:15:45.404356 26364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:15:45.405473 26364 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 14:15:45.406949 26364 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 14:15:45.407071 26364 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:45.407159 26364 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 14:15:45.407210 26364 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:45.437338 26364 rpc_server.cc:307] RPC server started. Bound to: 127.25.69.66:39457
I20240503 14:15:45.437425 26490 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.69.66:39457 every 8 connection(s)
I20240503 14:15:45.438707 26364 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data/info.pb
I20240503 14:15:45.445549 25877 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu as pid 26364
I20240503 14:15:45.450141 25877 tablet_copy_client_session-itest.cc:139] Starting loop 0
I20240503 14:15:45.450330 25877 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu pid 25975
I20240503 14:15:45.451308 26097 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 14:15:45.452167 26491 heartbeater.cc:347] Connected to a master server at 127.25.69.126:35521
I20240503 14:15:45.452454 26491 heartbeater.cc:464] Registering TS with master...
I20240503 14:15:45.453172 26491 heartbeater.cc:511] Master 127.25.69.126:35521 requested a full tablet report, sending...
I20240503 14:15:45.454787 26274 ts_manager.cc:194] Registered new tserver with Master: c5409ba5401b40849ce7da3266b26d98 (127.25.69.66:39457)
I20240503 14:15:45.455886 26274 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.69.66:54161
I20240503 14:15:45.550027 25877 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu with pid 25975
I20240503 14:15:45.571094 25877 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
/tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.69.65:46353
--local_ip_for_outbound_sockets=127.25.69.65
--tserver_master_addrs=127.25.69.126:35521
--webserver_port=37683
--webserver_interface=127.25.69.65
--builtin_ntp_servers=127.25.69.84:38153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240503 14:15:45.595223 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.600756 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.615515 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.616691 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.634594 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.635848 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.645692 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.646754 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.650183 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.651288 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.657817 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.658764 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.669816 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.670816 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.672313 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.673556 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.677122 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.678160 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.684671 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.689476 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.691768 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.693231 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.704984 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.706117 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.718160 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.719183 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.724385 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.725426 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.734925 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.735937 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.741349 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.742475 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.756173 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.757287 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.763892 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.765709 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.789431 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.790675 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.793926 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.795089 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.797578 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.801928 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.806648 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.807737 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.811172 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.818434 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.825531 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.826658 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.828769 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.829839 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.847545 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.848802 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.856842 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.859362 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.873752 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.874933 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.879509 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.880578 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.886126 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.887210 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.912407 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.914016 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.916081 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
W20240503 14:15:45.921738 26502 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 14:15:45.922027 26502 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 14:15:45.922219 26502 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20240503 14:15:45.922327 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.924096 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
W20240503 14:15:45.930604 26502 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 14:15:45.930806 26502 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.69.65
I20240503 14:15:45.930862 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.939370 26502 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.69.84:38153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.69.65:46353
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.69.65
--webserver_port=37683
--tserver_master_addrs=127.25.69.126:35521
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.69.65
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 13:43:24 UTC on efd1337a2aa3
build id 107
ASAN enabled
I20240503 14:15:45.940260 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.940752 26502 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 14:15:45.941542 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.942901 26502 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20240503 14:15:45.949926 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.950994 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
W20240503 14:15:45.955785 26647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:15:45.956449 26650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:15:45.956955 26648 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:15:45.957722 26502 server_base.cc:1034] running on GCE node
I20240503 14:15:45.958272 26502 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 14:15:45.959136 26502 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 14:15:45.960341 26502 hybrid_clock.cc:648] HybridClock initialized: now 1714745745960274 us; error 48 us; skew 500 ppm
I20240503 14:15:45.960620 26502 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:15:45.962841 26502 webserver.cc:460] Webserver started at http://127.25.69.65:37683/ using document root <none> and password file <none>
I20240503 14:15:45.963534 26502 fs_manager.cc:359] Metadata directory not provided
I20240503 14:15:45.963678 26502 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:15:45.967792 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.968865 26502 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20240503 14:15:45.972268 26663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:45.973609 26502 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20240503 14:15:45.973760 26502 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/wal
uuid: "3d51e5a9f26244d9939afe6bcf6e193f"
format_stamp: "Formatted at 2024-05-03 14:15:42 on dist-test-slave-0c7n"
I20240503 14:15:45.974582 26502 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:15:45.977555 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.981443 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.982571 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.989629 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.990552 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:45.994975 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:45.995781 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.007206 26502 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:15:46.008023 26502 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 14:15:46.008282 26502 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:15:46.009280 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.009289 26502 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 14:15:46.010188 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.011739 26687 ts_tablet_manager.cc:522] Loading tablet metadata (0/1 complete)
I20240503 14:15:46.016777 26502 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240503 14:15:46.016880 26502 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20240503 14:15:46.017015 26502 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240503 14:15:46.019667 26502 ts_tablet_manager.cc:590] Registered 1 tablets
I20240503 14:15:46.019732 26502 ts_tablet_manager.cc:569] Time spent register tablets: real 0.003s user 0.001s sys 0.000s
I20240503 14:15:46.020082 26687 tablet_bootstrap.cc:492] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f: Bootstrap starting.
I20240503 14:15:46.025617 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.028888 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.031158 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.038264 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.051292 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.052412 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.056075 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.057220 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.063326 26502 rpc_server.cc:307] RPC server started. Bound to: 127.25.69.65:46353
I20240503 14:15:46.063422 26809 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.69.65:46353 every 8 connection(s)
I20240503 14:15:46.064872 26502 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/data/info.pb
I20240503 14:15:46.067394 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.068828 25877 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu as pid 26502
I20240503 14:15:46.101497 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.105913 26810 heartbeater.cc:347] Connected to a master server at 127.25.69.126:35521
I20240503 14:15:46.106293 26810 heartbeater.cc:464] Registering TS with master...
I20240503 14:15:46.107743 26810 heartbeater.cc:511] Master 127.25.69.126:35521 requested a full tablet report, sending...
I20240503 14:15:46.111569 26274 ts_manager.cc:194] Re-registered known tserver with Master: 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.113010 26274 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.69.65:53861
I20240503 14:15:46.113415 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.113780 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.115867 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.127296 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.133482 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.134163 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.134364 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.134537 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.141079 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.142254 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.142992 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.143164 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.143355 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.144929 26687 log.cc:824] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f: Log is configured to *not* fsync() on all Append() calls
I20240503 14:15:46.159956 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.161135 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.161746 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.161942 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.162140 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.173019 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.174221 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.174866 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.175010 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.175191 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.179648 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.180665 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.181282 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.181419 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.181604 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.187472 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.188376 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.189033 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.189201 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.189389 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.193784 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.194885 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.195448 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.195597 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.195753 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.204728 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.206226 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.206812 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.206979 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.207160 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.216481 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.217674 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.218231 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.218398 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.218560 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.225095 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.226197 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.226806 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.226943 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.227133 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.228782 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.229825 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.230435 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.230600 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.230770 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.233861 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.234962 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.235577 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.235713 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.235872 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.237434 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.244884 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.245491 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.245635 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.245791 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.254889 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.255833 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.256384 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.256505 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.256662 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.258790 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.259795 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.260624 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.260808 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.261035 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.266839 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.267771 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.268340 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.268481 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.268658 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.296334 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.297580 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.298260 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.298450 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.298660 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.303406 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.304925 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.305512 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.305666 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.305866 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.311265 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.314498 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.315335 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.315501 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.315686 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.328294 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.329244 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.329845 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.329970 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.330143 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.340256 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.341543 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.342173 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.342335 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.342478 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.347990 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.348940 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.349582 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.349707 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.349864 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.359580 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.361532 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.362156 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.362313 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.362481 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.371608 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.372895 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.373617 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.373764 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.373967 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.388922 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.393682 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.394407 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.394603 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.394814 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.396473 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.397547 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.398129 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.398275 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.398460 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.413053 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.414587 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.415261 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.415460 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.415647 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.419476 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.420584 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.421298 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.421453 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.421651 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.429531 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.430570 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.431320 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.431502 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.431676 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.441035 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.446252 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.446970 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.447156 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.447381 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.449522 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.456862 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.457543 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.457690 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.457861 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.459291 26491 heartbeater.cc:503] Master 127.25.69.126:35521 was elected leader, sending a full tablet report...
I20240503 14:15:46.463955 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.465008 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.468966 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.469143 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.469391 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.477344 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.484833 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.485445 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.485599 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.485801 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.487476 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.488560 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.489140 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.489320 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.489490 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.505026 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.506145 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.506728 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.506899 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.507082 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.510366 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.517568 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.518234 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.518386 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.518569 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.535357 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.536546 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.537135 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.537324 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.537494 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.539680 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.540710 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.541409 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.541563 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.541764 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.547475 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.548465 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.549019 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.549171 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.549371 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.558845 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.562091 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.562827 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.563002 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.563211 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.568562 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.569569 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.570188 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.570359 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.570546 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.573760 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.579406 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.579972 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.580114 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.580309 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.582966 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.584055 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.584638 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.584796 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.584983 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.593389 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.594372 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.594964 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.595110 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.595291 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.601868 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.606557 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.607154 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.607300 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.607486 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.612712 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.613668 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.614264 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.614404 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.614555 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.624547 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.625440 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.626016 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.626173 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.626334 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.652791 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.653995 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.654667 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.654819 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.654983 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.659056 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.666283 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.666868 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.667028 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.667212 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.690444 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.691545 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.692215 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.692348 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:46.692530 26777 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:45903: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:46.692570 26687 tablet_bootstrap.cc:492] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f: Bootstrap replayed 1/1 log segments. Stats: ops{read=214 overwritten=0 applied=214 ignored=0} inserts{seen=10650 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:15:46.693318 26687 tablet_bootstrap.cc:492] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f: Bootstrap complete.
I20240503 14:15:46.694787 26687 ts_tablet_manager.cc:1367] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f: Time spent bootstrapping tablet: real 0.675s user 0.609s sys 0.060s
I20240503 14:15:46.699081 26687 raft_consensus.cc:348] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d51e5a9f26244d9939afe6bcf6e193f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 46353 } }
I20240503 14:15:46.699771 26687 raft_consensus.cc:729] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d51e5a9f26244d9939afe6bcf6e193f, State: Initialized, Role: FOLLOWER
I20240503 14:15:46.700304 26687 consensus_queue.cc:260] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 214, Last appended: 1.214, Last appended by leader: 214, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d51e5a9f26244d9939afe6bcf6e193f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 46353 } }
I20240503 14:15:46.700476 26687 raft_consensus.cc:388] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:15:46.700557 26687 raft_consensus.cc:482] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:15:46.700672 26687 raft_consensus.cc:3037] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:15:46.703953 26687 raft_consensus.cc:504] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d51e5a9f26244d9939afe6bcf6e193f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 46353 } }
I20240503 14:15:46.704384 26687 leader_election.cc:302] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3d51e5a9f26244d9939afe6bcf6e193f; no voters:
I20240503 14:15:46.704850 26687 leader_election.cc:288] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 14:15:46.704993 27020 raft_consensus.cc:2781] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:15:46.705490 27020 raft_consensus.cc:686] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [term 2 LEADER]: Becoming Leader. State: Replica: 3d51e5a9f26244d9939afe6bcf6e193f, State: Running, Role: LEADER
I20240503 14:15:46.705865 26810 heartbeater.cc:503] Master 127.25.69.126:35521 was elected leader, sending a full tablet report...
I20240503 14:15:46.706347 26687 ts_tablet_manager.cc:1398] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f: Time spent starting tablet: real 0.011s user 0.011s sys 0.001s
I20240503 14:15:46.706372 27020 consensus_queue.cc:237] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 214, Committed index: 214, Last appended: 1.214, Last appended by leader: 214, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d51e5a9f26244d9939afe6bcf6e193f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 46353 } }
I20240503 14:15:46.707551 26505 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:46.709529 26505 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:46.709936 26274 catalog_manager.cc:5484] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "3d51e5a9f26244d9939afe6bcf6e193f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d51e5a9f26244d9939afe6bcf6e193f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 46353 } health_report { overall_health: HEALTHY } } }
I20240503 14:15:46.710100 26777 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:45903)
I20240503 14:15:46.710229 26777 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:45903: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
I20240503 14:15:46.712808 26777 tablet_copy_source_session.cc:205] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 14:15:46.717312 26505 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1942c4894cbe441b86b6631dea870349. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:15:46.727315 26505 tablet_copy_client.cc:783] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Starting download of 0 data blocks...
I20240503 14:15:46.727574 26505 tablet_copy_client.cc:647] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Starting download of 1 WAL segments...
I20240503 14:15:46.731356 26505 tablet_copy_client.cc:523] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 14:15:46.734133 26505 tablet_bootstrap.cc:492] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Bootstrap starting.
I20240503 14:15:46.795310 26505 log.cc:824] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Log is configured to *not* fsync() on all Append() calls
I20240503 14:15:47.305837 26505 tablet_bootstrap.cc:492] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Bootstrap replayed 1/1 log segments. Stats: ops{read=215 overwritten=0 applied=215 ignored=0} inserts{seen=10650 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:15:47.306293 26505 tablet_bootstrap.cc:492] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Bootstrap complete.
I20240503 14:15:47.306711 26505 ts_tablet_manager.cc:1367] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Time spent bootstrapping tablet: real 0.573s user 0.527s sys 0.045s
I20240503 14:15:47.310715 26505 raft_consensus.cc:348] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d51e5a9f26244d9939afe6bcf6e193f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 46353 } }
I20240503 14:15:47.311167 26505 raft_consensus.cc:729] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98 [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: c5409ba5401b40849ce7da3266b26d98, State: Initialized, Role: NON_PARTICIPANT
I20240503 14:15:47.311787 26505 consensus_queue.cc:260] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 215, Last appended: 2.215, Last appended by leader: 215, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d51e5a9f26244d9939afe6bcf6e193f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 46353 } }
I20240503 14:15:47.313252 26505 ts_tablet_manager.cc:1398] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20240503 14:15:47.314157 26777 tablet_copy_service.cc:342] P 3d51e5a9f26244d9939afe6bcf6e193f: Request end of tablet copy session c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349 received from {username='slave'} at 127.25.69.66:45903
I20240503 14:15:47.314325 26777 tablet_copy_service.cc:433] P 3d51e5a9f26244d9939afe6bcf6e193f: ending tablet copy session c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349 on tablet 1942c4894cbe441b86b6631dea870349 with peer c5409ba5401b40849ce7da3266b26d98
W20240503 14:15:47.316035 26505 ts_tablet_manager.cc:701] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Tablet Copy: Invalid argument: Leader has replica of tablet 1942c4894cbe441b86b6631dea870349 with term 0, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20240503 14:15:47.317473 26505 ts_tablet_manager.cc:701] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Tablet Copy: Invalid argument: Leader has replica of tablet 1942c4894cbe441b86b6631dea870349 with term 0, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
I20240503 14:15:47.323468 26426 tablet_service.cc:1514] Processing DeleteTablet for tablet 1942c4894cbe441b86b6631dea870349 with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:50386
I20240503 14:15:47.324065 27036 tablet_replica.cc:330] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: stopping tablet replica
I20240503 14:15:47.324385 27036 raft_consensus.cc:2229] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98 [term 2 NON_PARTICIPANT]: Raft consensus shutting down.
I20240503 14:15:47.324640 27036 raft_consensus.cc:2258] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98 [term 2 NON_PARTICIPANT]: Raft consensus is shut down!
I20240503 14:15:47.325742 27036 ts_tablet_manager.cc:1875] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Deleting tablet data with delete state TABLET_DATA_DELETED
I20240503 14:15:47.329651 27036 ts_tablet_manager.cc:1888] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.215
I20240503 14:15:47.329756 27036 log.cc:1196] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Deleting WAL directory at /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/wal/wals/1942c4894cbe441b86b6631dea870349
I20240503 14:15:47.330189 27036 ts_tablet_manager.cc:1909] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Deleting consensus metadata
I20240503 14:15:47.331672 25877 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu pid 26364
I20240503 14:15:47.332473 26486 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 14:15:47.432317 25877 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu with pid 26364
I20240503 14:15:47.451763 25877 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
/tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.69.66:39457
--local_ip_for_outbound_sockets=127.25.69.66
--tserver_master_addrs=127.25.69.126:35521
--webserver_port=45785
--webserver_interface=127.25.69.66
--builtin_ntp_servers=127.25.69.84:38153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240503 14:15:47.755569 27038 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 14:15:47.755846 27038 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 14:15:47.755973 27038 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 14:15:47.762773 27038 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 14:15:47.762959 27038 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.69.66
I20240503 14:15:47.771534 27038 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.69.84:38153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.69.66:39457
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.69.66
--webserver_port=45785
--tserver_master_addrs=127.25.69.126:35521
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.69.66
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 13:43:24 UTC on efd1337a2aa3
build id 107
ASAN enabled
I20240503 14:15:47.772760 27038 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 14:15:47.774426 27038 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:15:47.786089 27043 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:15:47.786605 27046 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:15:47.787236 27044 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:15:47.788233 27038 server_base.cc:1034] running on GCE node
I20240503 14:15:47.788741 27038 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 14:15:47.789594 27038 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 14:15:47.790800 27038 hybrid_clock.cc:648] HybridClock initialized: now 1714745747790738 us; error 28 us; skew 500 ppm
I20240503 14:15:47.791096 27038 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:15:47.801024 27038 webserver.cc:460] Webserver started at http://127.25.69.66:45785/ using document root <none> and password file <none>
I20240503 14:15:47.801829 27038 fs_manager.cc:359] Metadata directory not provided
I20240503 14:15:47.801954 27038 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:15:47.807070 27038 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20240503 14:15:47.809561 27052 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:47.810751 27038 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240503 14:15:47.810891 27038 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/wal
uuid: "c5409ba5401b40849ce7da3266b26d98"
format_stamp: "Formatted at 2024-05-03 14:15:42 on dist-test-slave-0c7n"
I20240503 14:15:47.811663 27038 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:15:47.830101 27038 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:15:47.830826 27038 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 14:15:47.831069 27038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:15:47.831877 27038 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 14:15:47.833228 27038 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 14:15:47.833365 27038 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:47.833475 27038 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 14:15:47.833549 27038 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:47.864159 27038 rpc_server.cc:307] RPC server started. Bound to: 127.25.69.66:39457
I20240503 14:15:47.864213 27164 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.69.66:39457 every 8 connection(s)
I20240503 14:15:47.865579 27038 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data/info.pb
I20240503 14:15:47.867457 25877 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu as pid 27038
I20240503 14:15:47.867691 25877 tablet_copy_client_session-itest.cc:139] Starting loop 1
I20240503 14:15:47.867764 25877 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu pid 26502
I20240503 14:15:47.875466 26805 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 14:15:47.879829 27165 heartbeater.cc:347] Connected to a master server at 127.25.69.126:35521
I20240503 14:15:47.880086 27165 heartbeater.cc:464] Registering TS with master...
I20240503 14:15:47.880811 27165 heartbeater.cc:511] Master 127.25.69.126:35521 requested a full tablet report, sending...
I20240503 14:15:47.882213 26274 ts_manager.cc:194] Re-registered known tserver with Master: c5409ba5401b40849ce7da3266b26d98 (127.25.69.66:39457)
I20240503 14:15:47.883241 26274 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.69.66:56493
I20240503 14:15:47.969969 25877 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu with pid 26502
I20240503 14:15:47.989583 25877 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
/tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.69.65:46353
--local_ip_for_outbound_sockets=127.25.69.65
--tserver_master_addrs=127.25.69.126:35521
--webserver_port=37683
--webserver_interface=127.25.69.65
--builtin_ntp_servers=127.25.69.84:38153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240503 14:15:48.003177 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.017370 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.019326 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.020300 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.028097 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.029006 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.030937 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.031852 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.046757 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.047880 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.053135 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.054111 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.065347 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.066416 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.070855 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.071925 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.075601 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.076541 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.078848 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.079703 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.105146 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.106168 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.113312 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.114426 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.116798 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.120441 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.127991 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.129036 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.134420 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.135564 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.158972 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.161978 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.174774 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.175976 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.188053 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.189167 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.197536 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.198513 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.204965 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.205860 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.208094 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.210044 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.231626 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.232688 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.236990 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.238004 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.249250 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.250434 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.256645 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.257764 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.266698 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.267786 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.285451 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.286588 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.291844 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.292858 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.306783 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.308235 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.312484 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.313593 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.316097 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.317732 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.320766 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.325737 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.334153 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
W20240503 14:15:48.334090 27177 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 14:15:48.334394 27177 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 14:15:48.334585 27177 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20240503 14:15:48.335245 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
W20240503 14:15:48.342314 27177 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 14:15:48.342505 27177 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.69.65
I20240503 14:15:48.343149 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.344197 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.349314 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.350242 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.352806 27177 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.69.84:38153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.69.65:46353
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.69.65
--webserver_port=37683
--tserver_master_addrs=127.25.69.126:35521
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.69.65
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 13:43:24 UTC on efd1337a2aa3
build id 107
ASAN enabled
I20240503 14:15:48.354169 27177 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 14:15:48.355783 27177 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:15:48.366993 27326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:15:48.367621 27327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:15:48.368093 27329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:15:48.369069 27177 server_base.cc:1034] running on GCE node
I20240503 14:15:48.369657 27177 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 14:15:48.370517 27177 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 14:15:48.371728 27177 hybrid_clock.cc:648] HybridClock initialized: now 1714745748371673 us; error 33 us; skew 500 ppm
I20240503 14:15:48.372006 27177 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:15:48.373239 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.374439 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.376154 27177 webserver.cc:460] Webserver started at http://127.25.69.65:37683/ using document root <none> and password file <none>
I20240503 14:15:48.376608 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.377133 27177 fs_manager.cc:359] Metadata directory not provided
I20240503 14:15:48.377317 27177 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:15:48.381451 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.383747 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.385006 27177 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.002s sys 0.005s
I20240503 14:15:48.385448 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.390424 27347 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:48.391628 27177 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20240503 14:15:48.391798 27177 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/wal
uuid: "3d51e5a9f26244d9939afe6bcf6e193f"
format_stamp: "Formatted at 2024-05-03 14:15:42 on dist-test-slave-0c7n"
I20240503 14:15:48.392629 27177 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:15:48.407557 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.408691 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.411027 27177 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:15:48.411499 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.412093 27177 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 14:15:48.412447 27177 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:15:48.412582 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.413571 27177 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 14:15:48.415762 27362 ts_tablet_manager.cc:522] Loading tablet metadata (0/1 complete)
I20240503 14:15:48.420387 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.420955 27177 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240503 14:15:48.421092 27177 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20240503 14:15:48.421227 27177 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240503 14:15:48.423880 27177 ts_tablet_manager.cc:590] Registered 1 tablets
I20240503 14:15:48.423956 27177 ts_tablet_manager.cc:569] Time spent register tablets: real 0.003s user 0.000s sys 0.000s
I20240503 14:15:48.424405 27362 tablet_bootstrap.cc:492] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f: Bootstrap starting.
I20240503 14:15:48.424786 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.429405 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.431783 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.441685 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.461774 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.470132 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.483413 27177 rpc_server.cc:307] RPC server started. Bound to: 127.25.69.65:46353
I20240503 14:15:48.483441 27484 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.69.65:46353 every 8 connection(s)
I20240503 14:15:48.486039 27177 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/data/info.pb
I20240503 14:15:48.487669 25877 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu as pid 27177
I20240503 14:15:48.489497 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.513695 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.514019 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
I20240503 14:15:48.514340 27485 heartbeater.cc:347] Connected to a master server at 127.25.69.126:35521
I20240503 14:15:48.514640 27485 heartbeater.cc:464] Registering TS with master...
I20240503 14:15:48.515707 27485 heartbeater.cc:511] Master 127.25.69.126:35521 requested a full tablet report, sending...
W20240503 14:15:48.516806 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.519239 26274 ts_manager.cc:194] Re-registered known tserver with Master: 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.520812 26274 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.69.65:58785
I20240503 14:15:48.522008 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.526044 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.526636 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.526779 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.526939 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.531216 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.532146 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.532660 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.532799 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.532950 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.537851 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.538762 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.539327 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.539476 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.539628 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.544912 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.545917 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.546578 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.546778 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.546996 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.551116 27362 log.cc:824] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f: Log is configured to *not* fsync() on all Append() calls
I20240503 14:15:48.558228 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.559159 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.559726 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.559880 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.560048 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.574647 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.575673 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.576251 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.576383 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.576567 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.578439 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.585525 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.586320 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.586481 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.586639 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.600522 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.601619 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.602252 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.602406 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.602583 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.604434 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.605407 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.605906 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.606055 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.606225 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.609439 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.610435 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.611001 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.611142 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.611325 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.617849 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.618842 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.619450 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.619611 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.619782 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.625116 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.626199 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.626811 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.626945 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.627118 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.640713 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.642225 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.642773 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.642944 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.643107 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.645449 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.652674 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.653321 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.653455 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.653645 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.667594 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.668704 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.669299 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.669445 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.669643 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.685978 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.686945 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.687599 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.687731 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.687903 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.689621 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.690460 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.690980 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.691138 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.691319 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.696861 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.697897 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.698380 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.698501 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.698638 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.707751 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.708832 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.709388 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.709524 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.709700 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.728453 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.729687 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.730384 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.730543 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.730736 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.732386 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.738835 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.739686 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.739889 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.740087 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.744498 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.745626 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.746277 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.746441 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.746666 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.765044 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.766103 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.766732 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.766903 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.767081 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.775398 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.781584 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.782297 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.782485 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.782716 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.790573 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.791564 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.792132 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.792312 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.792469 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.797971 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.805016 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.805734 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.805912 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.806113 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.812645 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.813994 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.814659 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.814837 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.815029 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.817267 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.821902 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.822522 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.822672 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.822870 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.826375 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.833448 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.834071 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.834245 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.834443 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.838864 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.839947 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.840574 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.840701 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.840874 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.858402 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.859795 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.860446 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.860591 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.860759 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.865168 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.885521 27165 heartbeater.cc:503] Master 127.25.69.126:35521 was elected leader, sending a full tablet report...
I20240503 14:15:48.885937 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.886584 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.886759 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.886981 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.896351 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.897487 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.898005 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.898195 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.898384 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.901777 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.908540 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.909092 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.909269 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.909452 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.935045 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.939018 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.939637 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.939791 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.939961 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.946337 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.947897 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.948537 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.948669 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.948827 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.953405 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.958281 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.958858 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.959002 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.959177 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.965019 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.968917 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.969472 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.969588 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.969755 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.975039 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.976040 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.976593 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.976751 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.976907 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.978530 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.979607 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.980329 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.980444 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.980558 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.989940 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.991684 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.992259 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.992453 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.992633 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.994993 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:48.995942 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:48.996508 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:48.996634 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:48.996806 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:48.999917 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:49.000927 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:49.001714 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:49.001875 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:49.002032 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:49.006541 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:49.010314 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:49.011134 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:49.011274 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:49.011436 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:49.017278 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:49.018218 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:49.018822 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:49.018982 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:49.019142 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:49.032788 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:49.033996 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:49.034709 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:49.034927 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:49.035167 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:49.052891 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:49.054486 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:49.055097 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:49.055253 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:49.055416 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:49.057009 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:49.058049 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:49.058633 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:49.058766 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:49.058929 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:49.067209 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:49.068394 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:49.069089 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:49.069275 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:49.069444 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:49.095438 27362 tablet_bootstrap.cc:492] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f: Bootstrap replayed 1/1 log segments. Stats: ops{read=215 overwritten=0 applied=215 ignored=0} inserts{seen=10650 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:15:49.096009 27362 tablet_bootstrap.cc:492] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f: Bootstrap complete.
I20240503 14:15:49.097005 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:49.097419 27362 ts_tablet_manager.cc:1367] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f: Time spent bootstrapping tablet: real 0.673s user 0.595s sys 0.063s
I20240503 14:15:49.102294 27362 raft_consensus.cc:348] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d51e5a9f26244d9939afe6bcf6e193f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 46353 } }
I20240503 14:15:49.102970 27362 raft_consensus.cc:729] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d51e5a9f26244d9939afe6bcf6e193f, State: Initialized, Role: FOLLOWER
I20240503 14:15:49.103713 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:49.103758 27362 consensus_queue.cc:260] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 215, Last appended: 2.215, Last appended by leader: 215, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d51e5a9f26244d9939afe6bcf6e193f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 46353 } }
I20240503 14:15:49.104020 27362 raft_consensus.cc:388] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:15:49.104166 27362 raft_consensus.cc:482] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:15:49.104395 27362 raft_consensus.cc:3037] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [term 2 FOLLOWER]: Advancing to term 3
I20240503 14:15:49.104439 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:49.104641 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:49.104804 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:49.108239 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:49.108335 27362 raft_consensus.cc:504] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d51e5a9f26244d9939afe6bcf6e193f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 46353 } }
I20240503 14:15:49.108930 27362 leader_election.cc:302] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3d51e5a9f26244d9939afe6bcf6e193f; no voters:
I20240503 14:15:49.109966 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:49.110321 27362 leader_election.cc:288] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [CANDIDATE]: Term 3 election: Requested vote from peers
I20240503 14:15:49.110446 27694 raft_consensus.cc:2781] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [term 3 FOLLOWER]: Leader election won for term 3
I20240503 14:15:49.110589 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:49.110735 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:49.110906 27455 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:51053: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:49.112481 27362 ts_tablet_manager.cc:1398] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f: Time spent starting tablet: real 0.015s user 0.006s sys 0.008s
I20240503 14:15:49.112988 27485 heartbeater.cc:503] Master 127.25.69.126:35521 was elected leader, sending a full tablet report...
I20240503 14:15:49.115060 27178 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:49.116068 27178 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:49.116744 27455 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:51053)
I20240503 14:15:49.116865 27455 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:51053: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
I20240503 14:15:49.117254 27694 raft_consensus.cc:686] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [term 3 LEADER]: Becoming Leader. State: Replica: 3d51e5a9f26244d9939afe6bcf6e193f, State: Running, Role: LEADER
I20240503 14:15:49.117709 27694 consensus_queue.cc:237] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 215, Committed index: 215, Last appended: 2.215, Last appended by leader: 215, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d51e5a9f26244d9939afe6bcf6e193f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 46353 } }
I20240503 14:15:49.119679 27455 tablet_copy_source_session.cc:205] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 14:15:49.121134 26274 catalog_manager.cc:5484] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f reported cstate change: term changed from 2 to 3. New cstate: current_term: 3 leader_uuid: "3d51e5a9f26244d9939afe6bcf6e193f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d51e5a9f26244d9939afe6bcf6e193f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 46353 } health_report { overall_health: HEALTHY } } }
I20240503 14:15:49.124302 27178 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1942c4894cbe441b86b6631dea870349. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:15:49.134763 27178 tablet_copy_client.cc:783] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Starting download of 0 data blocks...
I20240503 14:15:49.135041 27178 tablet_copy_client.cc:647] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Starting download of 1 WAL segments...
I20240503 14:15:49.138928 27178 tablet_copy_client.cc:523] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 14:15:49.142096 27178 tablet_bootstrap.cc:492] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Bootstrap starting.
I20240503 14:15:49.205644 27178 log.cc:824] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Log is configured to *not* fsync() on all Append() calls
I20240503 14:15:49.707654 27178 tablet_bootstrap.cc:492] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Bootstrap replayed 1/1 log segments. Stats: ops{read=216 overwritten=0 applied=215 ignored=0} inserts{seen=10650 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20240503 14:15:49.708197 27178 tablet_bootstrap.cc:492] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Bootstrap complete.
I20240503 14:15:49.708765 27178 ts_tablet_manager.cc:1367] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Time spent bootstrapping tablet: real 0.567s user 0.496s sys 0.067s
I20240503 14:15:49.712985 27178 raft_consensus.cc:348] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98 [term 3 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d51e5a9f26244d9939afe6bcf6e193f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 46353 } }
I20240503 14:15:49.713725 27178 raft_consensus.cc:729] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98 [term 3 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: c5409ba5401b40849ce7da3266b26d98, State: Initialized, Role: NON_PARTICIPANT
I20240503 14:15:49.714337 27178 consensus_queue.cc:260] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 215, Last appended: 3.216, Last appended by leader: 216, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d51e5a9f26244d9939afe6bcf6e193f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 46353 } }
I20240503 14:15:49.715992 27178 ts_tablet_manager.cc:1398] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Time spent starting tablet: real 0.007s user 0.005s sys 0.004s
I20240503 14:15:49.717003 27455 tablet_copy_service.cc:342] P 3d51e5a9f26244d9939afe6bcf6e193f: Request end of tablet copy session c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349 received from {username='slave'} at 127.25.69.66:51053
I20240503 14:15:49.717168 27455 tablet_copy_service.cc:433] P 3d51e5a9f26244d9939afe6bcf6e193f: ending tablet copy session c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349 on tablet 1942c4894cbe441b86b6631dea870349 with peer c5409ba5401b40849ce7da3266b26d98
W20240503 14:15:49.718971 27178 ts_tablet_manager.cc:701] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Tablet Copy: Invalid argument: Leader has replica of tablet 1942c4894cbe441b86b6631dea870349 with term 0, which is lower than last-logged term 3 on local replica. Rejecting tablet copy request
W20240503 14:15:49.750334 27178 ts_tablet_manager.cc:701] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Tablet Copy: Invalid argument: Leader has replica of tablet 1942c4894cbe441b86b6631dea870349 with term 0, which is lower than last-logged term 3 on local replica. Rejecting tablet copy request
I20240503 14:15:49.753046 27100 tablet_service.cc:1514] Processing DeleteTablet for tablet 1942c4894cbe441b86b6631dea870349 with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:50394
I20240503 14:15:49.753998 27710 tablet_replica.cc:330] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: stopping tablet replica
I20240503 14:15:49.754421 27710 raft_consensus.cc:2229] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98 [term 3 NON_PARTICIPANT]: Raft consensus shutting down.
I20240503 14:15:49.754745 27710 pending_rounds.cc:62] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Trying to abort 1 pending ops.
I20240503 14:15:49.754879 27710 pending_rounds.cc:68] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Aborting op as it isn't in flight: id { term: 3 index: 216 } timestamp: 7023598588387196928 op_type: NO_OP noop_request { }
I20240503 14:15:49.755067 27710 raft_consensus.cc:2866] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98 [term 3 NON_PARTICIPANT]: NO_OP replication failed: Aborted: Op aborted
I20240503 14:15:49.755189 27710 raft_consensus.cc:2258] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98 [term 3 NON_PARTICIPANT]: Raft consensus is shut down!
I20240503 14:15:49.756347 27710 ts_tablet_manager.cc:1875] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Deleting tablet data with delete state TABLET_DATA_DELETED
I20240503 14:15:49.760437 27710 ts_tablet_manager.cc:1888] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 3.216
I20240503 14:15:49.760576 27710 log.cc:1196] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Deleting WAL directory at /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/wal/wals/1942c4894cbe441b86b6631dea870349
I20240503 14:15:49.761090 27710 ts_tablet_manager.cc:1909] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Deleting consensus metadata
I20240503 14:15:49.762722 25877 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu pid 27038
I20240503 14:15:49.763649 27160 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 14:15:49.864292 25877 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu with pid 27038
I20240503 14:15:49.883502 25877 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
/tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.69.66:39457
--local_ip_for_outbound_sockets=127.25.69.66
--tserver_master_addrs=127.25.69.126:35521
--webserver_port=45785
--webserver_interface=127.25.69.66
--builtin_ntp_servers=127.25.69.84:38153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240503 14:15:50.192307 27712 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 14:15:50.192612 27712 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 14:15:50.192757 27712 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 14:15:50.200336 27712 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 14:15:50.200542 27712 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.69.66
I20240503 14:15:50.209237 27712 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.69.84:38153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.69.66:39457
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.69.66
--webserver_port=45785
--tserver_master_addrs=127.25.69.126:35521
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.69.66
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 13:43:24 UTC on efd1337a2aa3
build id 107
ASAN enabled
I20240503 14:15:50.210512 27712 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 14:15:50.212189 27712 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:15:50.224128 27717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:15:50.224818 27718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:15:50.225502 27720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:15:50.226351 27712 server_base.cc:1034] running on GCE node
I20240503 14:15:50.226891 27712 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 14:15:50.227769 27712 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 14:15:50.229013 27712 hybrid_clock.cc:648] HybridClock initialized: now 1714745750228944 us; error 41 us; skew 500 ppm
I20240503 14:15:50.229425 27712 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:15:50.231705 27712 webserver.cc:460] Webserver started at http://127.25.69.66:45785/ using document root <none> and password file <none>
I20240503 14:15:50.232414 27712 fs_manager.cc:359] Metadata directory not provided
I20240503 14:15:50.232522 27712 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:15:50.237700 27712 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20240503 14:15:50.240324 27726 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:50.241683 27712 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240503 14:15:50.241814 27712 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/wal
uuid: "c5409ba5401b40849ce7da3266b26d98"
format_stamp: "Formatted at 2024-05-03 14:15:42 on dist-test-slave-0c7n"
I20240503 14:15:50.242601 27712 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:15:50.258383 27712 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:15:50.259141 27712 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 14:15:50.259402 27712 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:15:50.260264 27712 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 14:15:50.261757 27712 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 14:15:50.261852 27712 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:50.261938 27712 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 14:15:50.262001 27712 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:50.292496 27712 rpc_server.cc:307] RPC server started. Bound to: 127.25.69.66:39457
I20240503 14:15:50.292564 27838 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.69.66:39457 every 8 connection(s)
I20240503 14:15:50.293907 27712 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data/info.pb
I20240503 14:15:50.300411 25877 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu as pid 27712
I20240503 14:15:50.300649 25877 tablet_copy_client_session-itest.cc:139] Starting loop 2
I20240503 14:15:50.300757 25877 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu pid 27177
I20240503 14:15:50.306636 27839 heartbeater.cc:347] Connected to a master server at 127.25.69.126:35521
I20240503 14:15:50.306898 27839 heartbeater.cc:464] Registering TS with master...
I20240503 14:15:50.307598 27476 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 14:15:50.307829 27839 heartbeater.cc:511] Master 127.25.69.126:35521 requested a full tablet report, sending...
I20240503 14:15:50.309505 26274 ts_manager.cc:194] Re-registered known tserver with Master: c5409ba5401b40849ce7da3266b26d98 (127.25.69.66:39457)
I20240503 14:15:50.310253 26274 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.69.66:45093
I20240503 14:15:50.406536 25877 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu with pid 27177
I20240503 14:15:50.426328 25877 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
/tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.69.65:46353
--local_ip_for_outbound_sockets=127.25.69.65
--tserver_master_addrs=127.25.69.126:35521
--webserver_port=37683
--webserver_interface=127.25.69.65
--builtin_ntp_servers=127.25.69.84:38153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240503 14:15:50.447268 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.456161 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.463083 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.464349 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.479130 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.480319 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.486353 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.487473 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.499738 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.500842 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.503239 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.504243 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.515343 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.516248 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.525262 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.526206 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.530826 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.531868 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.554284 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.555514 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.559098 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.560086 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.575814 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.577026 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.588044 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.589475 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.605047 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.612273 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.631659 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.632910 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.643280 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.644563 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.650445 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.652088 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.656098 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.657809 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.669008 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.670060 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.673983 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.675103 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.683724 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.684804 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.693598 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.694664 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.719100 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.720187 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.724422 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.729521 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.747269 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.748661 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.760156 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.761440 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.767105 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.768093 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
W20240503 14:15:50.771694 27851 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 14:15:50.771950 27851 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 14:15:50.772115 27851 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 14:15:50.779690 27851 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 14:15:50.779879 27851 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.69.65
I20240503 14:15:50.781322 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.782513 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.789395 27851 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.69.84:38153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.69.65:46353
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.69.65
--webserver_port=37683
--tserver_master_addrs=127.25.69.126:35521
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.69.65
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 13:43:24 UTC on efd1337a2aa3
build id 107
ASAN enabled
I20240503 14:15:50.790676 27851 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 14:15:50.792313 27851 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20240503 14:15:50.794881 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.796001 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.798671 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
W20240503 14:15:50.807637 27976 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:15:50.808239 27978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:15:50.809425 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
W20240503 14:15:50.810216 27980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:15:50.811020 27851 server_base.cc:1034] running on GCE node
I20240503 14:15:50.811745 27851 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 14:15:50.812896 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.812808 27851 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 14:15:50.814327 27851 hybrid_clock.cc:648] HybridClock initialized: now 1714745750814242 us; error 57 us; skew 500 ppm
I20240503 14:15:50.814637 27851 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:15:50.817111 27851 webserver.cc:460] Webserver started at http://127.25.69.65:37683/ using document root <none> and password file <none>
I20240503 14:15:50.817832 27851 fs_manager.cc:359] Metadata directory not provided
I20240503 14:15:50.817960 27851 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:15:50.820159 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.823624 27851 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20240503 14:15:50.826424 27993 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:50.827618 27851 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20240503 14:15:50.827746 27851 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/wal
uuid: "3d51e5a9f26244d9939afe6bcf6e193f"
format_stamp: "Formatted at 2024-05-03 14:15:42 on dist-test-slave-0c7n"
I20240503 14:15:50.828555 27851 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:15:50.829368 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.830459 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.840289 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.841490 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.843670 27851 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:15:50.844388 27851 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 14:15:50.844640 27851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:15:50.845319 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.845654 27851 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 14:15:50.846446 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.848407 28012 ts_tablet_manager.cc:522] Loading tablet metadata (0/1 complete)
I20240503 14:15:50.853113 27851 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240503 14:15:50.853263 27851 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.001s
I20240503 14:15:50.853361 27851 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240503 14:15:50.855967 27851 ts_tablet_manager.cc:590] Registered 1 tablets
I20240503 14:15:50.856055 27851 ts_tablet_manager.cc:569] Time spent register tablets: real 0.003s user 0.000s sys 0.000s
I20240503 14:15:50.856431 28012 tablet_bootstrap.cc:492] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f: Bootstrap starting.
I20240503 14:15:50.867408 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.880419 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.887290 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.889398 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.902437 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.910439 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.917145 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.919181 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.919808 27851 rpc_server.cc:307] RPC server started. Bound to: 127.25.69.65:46353
I20240503 14:15:50.919870 28134 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.69.65:46353 every 8 connection(s)
I20240503 14:15:50.921788 27851 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-0/data/info.pb
I20240503 14:15:50.925410 25877 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu as pid 27851
I20240503 14:15:50.952975 28136 heartbeater.cc:347] Connected to a master server at 127.25.69.126:35521
I20240503 14:15:50.953323 28136 heartbeater.cc:464] Registering TS with master...
I20240503 14:15:50.953657 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:50.954016 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
I20240503 14:15:50.955447 28136 heartbeater.cc:511] Master 127.25.69.126:35521 requested a full tablet report, sending...
W20240503 14:15:50.956019 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:50.958535 26274 ts_manager.cc:194] Re-registered known tserver with Master: 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.960052 26274 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.69.65:49023
I20240503 14:15:50.972399 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.973558 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.974236 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:50.974414 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:50.974587 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:50.978029 28012 log.cc:824] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f: Log is configured to *not* fsync() on all Append() calls
I20240503 14:15:50.978339 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:50.979449 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:50.980028 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:50.980165 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:50.980330 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.001792 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.003166 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.003774 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.003942 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.004108 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.005708 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.006641 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.007191 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.007302 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.007465 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.015893 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.016767 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.017395 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.017552 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.017740 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.024721 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.025681 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.026180 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.026296 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.026437 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.030450 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.031481 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.031978 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.032127 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.032258 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.046669 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.049793 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.050422 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.050570 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.050761 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.052474 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.053508 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.054080 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.054210 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.054364 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.061789 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.062798 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.063393 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.063531 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.063750 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.070956 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.071856 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.072422 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.072572 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.072746 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.077288 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.078313 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.078863 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.078979 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.079139 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.088104 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.089242 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.089890 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.090070 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.090216 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.102385 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.103653 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.104302 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.104452 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.104652 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.110327 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.111624 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.112145 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.112304 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.112468 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.115686 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.117724 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.118297 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.118431 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.118603 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.123898 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.125835 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.126355 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.126507 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.126696 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.130185 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.131839 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.133154 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.133316 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.133481 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.146982 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.147998 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.148594 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.148764 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.148936 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.152545 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.153462 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.154124 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.154279 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.154443 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.167064 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.168046 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.168792 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.168957 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.169112 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.170792 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.171767 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.172384 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.172537 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.172693 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.190375 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.191466 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.192112 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.192274 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.192433 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.196079 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.196928 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.197508 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.197638 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.197819 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.202914 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.203919 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.204463 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.204610 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.204777 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.208503 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.213433 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.214069 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.214205 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.214438 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.219049 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.224864 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.225466 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.225610 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.225783 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.237179 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.238274 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.238924 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.239064 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.239225 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.251567 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.252810 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.253451 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.253664 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.253839 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.259397 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.260403 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.261016 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.261214 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.261418 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.263208 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.264487 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.265085 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.265249 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.265439 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.268203 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.275192 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.275738 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.275866 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.276057 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.279290 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.280262 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.280782 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.280916 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.281106 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.297340 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.298363 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.298940 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.299072 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.299221 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.300976 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.304462 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.305003 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.305126 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.305320 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.307679 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.308583 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.309098 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.309218 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.309373 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.313570 27839 heartbeater.cc:503] Master 127.25.69.126:35521 was elected leader, sending a full tablet report...
I20240503 14:15:51.316195 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.317140 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.317672 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.317795 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.317945 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.319571 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.320461 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.321054 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.321177 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.321391 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.333609 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.340531 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.341161 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.341385 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.341573 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.344527 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.345525 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.346122 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.346244 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.346431 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.354138 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.361858 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.362455 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.362586 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.362742 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.384366 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.385593 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.386220 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.386361 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.386533 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.389688 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.393524 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.394171 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.394328 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.394505 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.399143 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.400174 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.400807 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.400933 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.401142 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.408047 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.409417 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.409986 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.410143 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.410310 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.418217 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.419360 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.419936 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.420063 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.420245 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.426998 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.428508 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.429210 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.429401 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.429580 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.437790 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.438946 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.439604 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.439777 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.440013 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.443130 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.444252 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.444877 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.445029 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.445205 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.461755 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.462880 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.463577 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.463816 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.464048 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.468717 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.470069 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.470686 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.470865 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.471048 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.488914 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.490048 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.490749 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.490955 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.491171 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.496372 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.497365 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.498028 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.498222 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.498401 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.506808 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.507910 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.508608 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.508762 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.508940 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.534850 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.536028 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.536769 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.536970 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.537176 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.546245 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.547370 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.548036 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.548230 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.548408 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.551609 28012 tablet_bootstrap.cc:492] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f: Bootstrap replayed 1/1 log segments. Stats: ops{read=216 overwritten=0 applied=216 ignored=0} inserts{seen=10650 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:15:51.552172 28012 tablet_bootstrap.cc:492] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f: Bootstrap complete.
I20240503 14:15:51.553355 28012 ts_tablet_manager.cc:1367] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f: Time spent bootstrapping tablet: real 0.697s user 0.618s sys 0.076s
I20240503 14:15:51.557658 28012 raft_consensus.cc:348] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d51e5a9f26244d9939afe6bcf6e193f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 46353 } }
I20240503 14:15:51.558388 28012 raft_consensus.cc:729] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d51e5a9f26244d9939afe6bcf6e193f, State: Initialized, Role: FOLLOWER
I20240503 14:15:51.559085 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.559085 28012 consensus_queue.cc:260] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 216, Last appended: 3.216, Last appended by leader: 216, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d51e5a9f26244d9939afe6bcf6e193f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 46353 } }
I20240503 14:15:51.559356 28012 raft_consensus.cc:388] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [term 3 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:15:51.559506 28012 raft_consensus.cc:482] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [term 3 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:15:51.559703 28012 raft_consensus.cc:3037] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [term 3 FOLLOWER]: Advancing to term 4
I20240503 14:15:51.560595 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.561287 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.561445 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.561604 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.563768 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.564822 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.564877 28012 raft_consensus.cc:504] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d51e5a9f26244d9939afe6bcf6e193f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 46353 } }
I20240503 14:15:51.565507 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.565472 28012 leader_election.cc:302] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3d51e5a9f26244d9939afe6bcf6e193f; no voters:
I20240503 14:15:51.565630 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
W20240503 14:15:51.565826 28102 tablet_copy_service.cc:478] P 3d51e5a9f26244d9939afe6bcf6e193f: Error handling TabletCopyService RPC request from {username='slave'} at 127.25.69.66:39469: Error beginning tablet copy session for tablet 1942c4894cbe441b86b6631dea870349: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 14:15:51.566149 28012 leader_election.cc:288] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [CANDIDATE]: Term 4 election: Requested vote from peers
I20240503 14:15:51.566295 28373 raft_consensus.cc:2781] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [term 4 FOLLOWER]: Leader election won for term 4
I20240503 14:15:51.567425 28373 raft_consensus.cc:686] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [term 4 LEADER]: Becoming Leader. State: Replica: 3d51e5a9f26244d9939afe6bcf6e193f, State: Running, Role: LEADER
I20240503 14:15:51.567724 28136 heartbeater.cc:503] Master 127.25.69.126:35521 was elected leader, sending a full tablet report...
I20240503 14:15:51.567929 28373 consensus_queue.cc:237] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 216, Committed index: 216, Last appended: 3.216, Last appended by leader: 216, Current term: 4, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d51e5a9f26244d9939afe6bcf6e193f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 46353 } }
I20240503 14:15:51.568430 28012 ts_tablet_manager.cc:1398] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
I20240503 14:15:51.571442 26274 catalog_manager.cc:5484] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f reported cstate change: term changed from 3 to 4. New cstate: current_term: 4 leader_uuid: "3d51e5a9f26244d9939afe6bcf6e193f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d51e5a9f26244d9939afe6bcf6e193f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 46353 } health_report { overall_health: HEALTHY } } }
I20240503 14:15:51.573462 27852 ts_tablet_manager.cc:902] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Initiating tablet copy from peer 3d51e5a9f26244d9939afe6bcf6e193f (127.25.69.65:46353)
I20240503 14:15:51.574621 27852 tablet_copy_client.cc:308] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:46353
I20240503 14:15:51.575229 28102 tablet_copy_service.cc:140] P 3d51e5a9f26244d9939afe6bcf6e193f: Received BeginTabletCopySession request for tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 ({username='slave'} at 127.25.69.66:39469)
I20240503 14:15:51.575342 28102 tablet_copy_service.cc:161] P 3d51e5a9f26244d9939afe6bcf6e193f: Beginning new tablet copy session on tablet 1942c4894cbe441b86b6631dea870349 from peer c5409ba5401b40849ce7da3266b26d98 at {username='slave'} at 127.25.69.66:39469: session id = c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349
I20240503 14:15:51.577139 28102 tablet_copy_source_session.cc:205] T 1942c4894cbe441b86b6631dea870349 P 3d51e5a9f26244d9939afe6bcf6e193f: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 14:15:51.582279 27852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1942c4894cbe441b86b6631dea870349. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:15:51.592389 27852 tablet_copy_client.cc:783] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Starting download of 0 data blocks...
I20240503 14:15:51.592738 27852 tablet_copy_client.cc:647] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Starting download of 1 WAL segments...
I20240503 14:15:51.597132 27852 tablet_copy_client.cc:523] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 14:15:51.600279 27852 tablet_bootstrap.cc:492] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Bootstrap starting.
I20240503 14:15:51.666438 27852 log.cc:824] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Log is configured to *not* fsync() on all Append() calls
I20240503 14:15:52.168349 27852 tablet_bootstrap.cc:492] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Bootstrap replayed 1/1 log segments. Stats: ops{read=217 overwritten=0 applied=217 ignored=0} inserts{seen=10650 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:15:52.168809 27852 tablet_bootstrap.cc:492] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Bootstrap complete.
I20240503 14:15:52.169364 27852 ts_tablet_manager.cc:1367] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Time spent bootstrapping tablet: real 0.569s user 0.536s sys 0.036s
I20240503 14:15:52.173475 27852 raft_consensus.cc:348] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98 [term 4 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d51e5a9f26244d9939afe6bcf6e193f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 46353 } }
I20240503 14:15:52.173857 27852 raft_consensus.cc:729] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98 [term 4 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: c5409ba5401b40849ce7da3266b26d98, State: Initialized, Role: NON_PARTICIPANT
I20240503 14:15:52.174453 27852 consensus_queue.cc:260] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 217, Last appended: 4.217, Last appended by leader: 217, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d51e5a9f26244d9939afe6bcf6e193f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 46353 } }
I20240503 14:15:52.175820 27852 ts_tablet_manager.cc:1398] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20240503 14:15:52.176800 28102 tablet_copy_service.cc:342] P 3d51e5a9f26244d9939afe6bcf6e193f: Request end of tablet copy session c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349 received from {username='slave'} at 127.25.69.66:39469
I20240503 14:15:52.176972 28102 tablet_copy_service.cc:433] P 3d51e5a9f26244d9939afe6bcf6e193f: ending tablet copy session c5409ba5401b40849ce7da3266b26d98-1942c4894cbe441b86b6631dea870349 on tablet 1942c4894cbe441b86b6631dea870349 with peer c5409ba5401b40849ce7da3266b26d98
W20240503 14:15:52.182767 27852 ts_tablet_manager.cc:701] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Tablet Copy: Invalid argument: Leader has replica of tablet 1942c4894cbe441b86b6631dea870349 with term 0, which is lower than last-logged term 4 on local replica. Rejecting tablet copy request
W20240503 14:15:52.186559 27852 ts_tablet_manager.cc:701] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Tablet Copy: Invalid argument: Leader has replica of tablet 1942c4894cbe441b86b6631dea870349 with term 0, which is lower than last-logged term 4 on local replica. Rejecting tablet copy request
W20240503 14:15:52.194960 27852 ts_tablet_manager.cc:701] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Tablet Copy: Invalid argument: Leader has replica of tablet 1942c4894cbe441b86b6631dea870349 with term 0, which is lower than last-logged term 4 on local replica. Rejecting tablet copy request
I20240503 14:15:52.196897 27774 tablet_service.cc:1514] Processing DeleteTablet for tablet 1942c4894cbe441b86b6631dea870349 with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:50408
I20240503 14:15:52.197503 28389 tablet_replica.cc:330] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: stopping tablet replica
I20240503 14:15:52.197819 28389 raft_consensus.cc:2229] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98 [term 4 NON_PARTICIPANT]: Raft consensus shutting down.
I20240503 14:15:52.198055 28389 raft_consensus.cc:2258] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98 [term 4 NON_PARTICIPANT]: Raft consensus is shut down!
I20240503 14:15:52.199117 28389 ts_tablet_manager.cc:1875] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Deleting tablet data with delete state TABLET_DATA_DELETED
I20240503 14:15:52.203155 28389 ts_tablet_manager.cc:1888] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 4.217
I20240503 14:15:52.203276 28389 log.cc:1196] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Deleting WAL directory at /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/wal/wals/1942c4894cbe441b86b6631dea870349
I20240503 14:15:52.203752 28389 ts_tablet_manager.cc:1909] T 1942c4894cbe441b86b6631dea870349 P c5409ba5401b40849ce7da3266b26d98: Deleting consensus metadata
I20240503 14:15:52.205154 25877 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu pid 27712
I20240503 14:15:52.205900 27834 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 14:15:52.303859 25877 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu with pid 27712
I20240503 14:15:52.323019 25877 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
/tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.69.66:39457
--local_ip_for_outbound_sockets=127.25.69.66
--tserver_master_addrs=127.25.69.126:35521
--webserver_port=45785
--webserver_interface=127.25.69.66
--builtin_ntp_servers=127.25.69.84:38153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240503 14:15:52.625738 28391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 14:15:52.626009 28391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 14:15:52.626173 28391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 14:15:52.632992 28391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 14:15:52.633226 28391 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.69.66
I20240503 14:15:52.641852 28391 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.69.84:38153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.69.66:39457
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.69.66
--webserver_port=45785
--tserver_master_addrs=127.25.69.126:35521
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.69.66
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 13:43:24 UTC on efd1337a2aa3
build id 107
ASAN enabled
I20240503 14:15:52.643111 28391 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 14:15:52.644778 28391 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:15:52.655936 28396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:15:52.656643 28399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:15:52.657335 28397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:15:52.658031 28391 server_base.cc:1034] running on GCE node
I20240503 14:15:52.658612 28391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 14:15:52.659461 28391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 14:15:52.660670 28391 hybrid_clock.cc:648] HybridClock initialized: now 1714745752660609 us; error 44 us; skew 500 ppm
I20240503 14:15:52.660962 28391 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:15:52.663081 28391 webserver.cc:460] Webserver started at http://127.25.69.66:45785/ using document root <none> and password file <none>
I20240503 14:15:52.663753 28391 fs_manager.cc:359] Metadata directory not provided
I20240503 14:15:52.663883 28391 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:15:52.668525 28391 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20240503 14:15:52.671053 28405 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:52.672237 28391 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240503 14:15:52.672392 28391 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/wal
uuid: "c5409ba5401b40849ce7da3266b26d98"
format_stamp: "Formatted at 2024-05-03 14:15:42 on dist-test-slave-0c7n"
I20240503 14:15:52.673161 28391 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:15:52.698385 28391 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:15:52.699082 28391 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 14:15:52.699332 28391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:15:52.700162 28391 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 14:15:52.701575 28391 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 14:15:52.701671 28391 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:52.701783 28391 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 14:15:52.701856 28391 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:52.731998 28391 rpc_server.cc:307] RPC server started. Bound to: 127.25.69.66:39457
I20240503 14:15:52.732062 28517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.69.66:39457 every 8 connection(s)
I20240503 14:15:52.733428 28391 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714745741318137-25877-0/minicluster-data/ts-1/data/info.pb
I20240503 14:15:52.738413 25877 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu as pid 28391
I20240503 14:15:52.738816 25877 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu pid 27851
I20240503 14:15:52.745646 28518 heartbeater.cc:347] Connected to a master server at 127.25.69.126:35521
I20240503 14:15:52.746001 28518 heartbeater.cc:464] Registering TS with master...
I20240503 14:15:52.746835 28518 heartbeater.cc:511] Master 127.25.69.126:35521 requested a full tablet report, sending...
I20240503 14:15:52.748109 26274 ts_manager.cc:194] Re-registered known tserver with Master: c5409ba5401b40849ce7da3266b26d98 (127.25.69.66:39457)
I20240503 14:15:52.748821 26274 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.69.66:57757
I20240503 14:15:52.751505 28126 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 14:15:52.847296 25877 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu with pid 27851
I20240503 14:15:52.865828 25877 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu pid 28391
I20240503 14:15:52.878899 28513 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 14:15:52.954169 25877 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu with pid 28391
I20240503 14:15:52.970742 25877 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu pid 26244
I20240503 14:15:52.971906 26306 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 14:15:53.072304 25877 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu with pid 26244
2024-05-03T14:15:53Z chronyd exiting
[ OK ] TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping (11728 ms)
[ RUN ] TabletCopyClientSessionITest.TestStartTabletCopy
2024-05-03T14:15:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-03T14:15:53Z Disabled control of system clock
I20240503 14:15:53.133114 25877 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
/tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.69.126:41619
--webserver_interface=127.25.69.126
--webserver_port=0
--builtin_ntp_servers=127.25.69.84:41335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.69.126:41619
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240503 14:15:53.433832 28531 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 14:15:53.434130 28531 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 14:15:53.434253 28531 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 14:15:53.441176 28531 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240503 14:15:53.441295 28531 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 14:15:53.441376 28531 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240503 14:15:53.441457 28531 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240503 14:15:53.449697 28531 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.69.84:41335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.25.69.126:41619
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.69.126:41619
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.69.126
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 13:43:24 UTC on efd1337a2aa3
build id 107
ASAN enabled
I20240503 14:15:53.450874 28531 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 14:15:53.452366 28531 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:15:53.462109 28537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:15:53.462646 28539 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:15:53.463325 28536 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:15:53.464313 28531 server_base.cc:1034] running on GCE node
I20240503 14:15:53.465014 28531 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 14:15:53.466359 28531 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 14:15:53.467564 28531 hybrid_clock.cc:648] HybridClock initialized: now 1714745753467516 us; error 29 us; skew 500 ppm
I20240503 14:15:53.467839 28531 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:15:53.469866 28531 webserver.cc:460] Webserver started at http://127.25.69.126:42023/ using document root <none> and password file <none>
I20240503 14:15:53.470492 28531 fs_manager.cc:359] Metadata directory not provided
I20240503 14:15:53.470604 28531 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:15:53.470889 28531 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 14:15:53.473260 28531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/master-0/data/instance:
uuid: "56b73d92976d44cc8d015d604993e0ed"
format_stamp: "Formatted at 2024-05-03 14:15:53 on dist-test-slave-0c7n"
I20240503 14:15:53.473992 28531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/master-0/wal/instance:
uuid: "56b73d92976d44cc8d015d604993e0ed"
format_stamp: "Formatted at 2024-05-03 14:15:53 on dist-test-slave-0c7n"
I20240503 14:15:53.478514 28531 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20240503 14:15:53.481463 28545 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:53.482702 28531 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20240503 14:15:53.482853 28531 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/master-0/data,/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/master-0/wal
uuid: "56b73d92976d44cc8d015d604993e0ed"
format_stamp: "Formatted at 2024-05-03 14:15:53 on dist-test-slave-0c7n"
I20240503 14:15:53.483019 28531 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:15:53.517364 28531 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:15:53.518180 28531 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 14:15:53.518460 28531 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:15:53.535626 28531 rpc_server.cc:307] RPC server started. Bound to: 127.25.69.126:41619
I20240503 14:15:53.535677 28596 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.69.126:41619 every 8 connection(s)
I20240503 14:15:53.536923 28531 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/master-0/data/info.pb
I20240503 14:15:53.538236 25877 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu as pid 28531
I20240503 14:15:53.538488 25877 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/master-0/wal/instance
I20240503 14:15:53.541857 28597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:15:53.552141 28597 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed: Bootstrap starting.
I20240503 14:15:53.555147 28597 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed: Neither blocks nor log segments found. Creating new log.
I20240503 14:15:53.556195 28597 log.cc:824] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed: Log is configured to *not* fsync() on all Append() calls
I20240503 14:15:53.558646 28597 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed: No bootstrap required, opened a new log
I20240503 14:15:53.564502 28597 raft_consensus.cc:348] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56b73d92976d44cc8d015d604993e0ed" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 41619 } }
I20240503 14:15:53.564808 28597 raft_consensus.cc:374] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:15:53.564884 28597 raft_consensus.cc:729] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b73d92976d44cc8d015d604993e0ed, State: Initialized, Role: FOLLOWER
I20240503 14:15:53.565459 28597 consensus_queue.cc:260] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56b73d92976d44cc8d015d604993e0ed" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 41619 } }
I20240503 14:15:53.565620 28597 raft_consensus.cc:388] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:15:53.565701 28597 raft_consensus.cc:482] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:15:53.565802 28597 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:15:53.567657 28597 raft_consensus.cc:504] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56b73d92976d44cc8d015d604993e0ed" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 41619 } }
I20240503 14:15:53.568048 28597 leader_election.cc:302] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 56b73d92976d44cc8d015d604993e0ed; no voters:
I20240503 14:15:53.568641 28597 leader_election.cc:288] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 14:15:53.568766 28602 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:15:53.569574 28602 raft_consensus.cc:686] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed [term 1 LEADER]: Becoming Leader. State: Replica: 56b73d92976d44cc8d015d604993e0ed, State: Running, Role: LEADER
I20240503 14:15:53.570045 28602 consensus_queue.cc:237] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56b73d92976d44cc8d015d604993e0ed" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 41619 } }
I20240503 14:15:53.570462 28597 sys_catalog.cc:564] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed [sys.catalog]: configured and running, proceeding with master startup.
I20240503 14:15:53.572474 28603 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "56b73d92976d44cc8d015d604993e0ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56b73d92976d44cc8d015d604993e0ed" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 41619 } } }
I20240503 14:15:53.572839 28603 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed [sys.catalog]: This master's current role is: LEADER
I20240503 14:15:53.573024 28604 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader 56b73d92976d44cc8d015d604993e0ed. Latest consensus state: current_term: 1 leader_uuid: "56b73d92976d44cc8d015d604993e0ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56b73d92976d44cc8d015d604993e0ed" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 41619 } } }
I20240503 14:15:53.573405 28604 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed [sys.catalog]: This master's current role is: LEADER
I20240503 14:15:53.574781 28610 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240503 14:15:53.579396 28610 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240503 14:15:53.587400 28610 catalog_manager.cc:1347] Generated new cluster ID: 76f70225ea744a15abd94622bd76a85b
I20240503 14:15:53.587503 28610 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240503 14:15:53.614205 28610 catalog_manager.cc:1370] Generated new certificate authority record
I20240503 14:15:53.615362 28610 catalog_manager.cc:1504] Loading token signing keys...
I20240503 14:15:53.631260 28610 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed: Generated new TSK 0
I20240503 14:15:53.632128 28610 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240503 14:15:53.641093 25877 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
/tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.69.65:0
--local_ip_for_outbound_sockets=127.25.69.65
--webserver_interface=127.25.69.65
--webserver_port=0
--tserver_master_addrs=127.25.69.126:41619
--builtin_ntp_servers=127.25.69.84:41335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240503 14:15:53.969175 28621 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 14:15:53.969485 28621 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 14:15:53.969578 28621 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 14:15:53.976533 28621 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 14:15:53.976707 28621 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.69.65
I20240503 14:15:53.985512 28621 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.69.84:41335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.69.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.69.65
--webserver_port=0
--tserver_master_addrs=127.25.69.126:41619
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.69.65
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 13:43:24 UTC on efd1337a2aa3
build id 107
ASAN enabled
I20240503 14:15:53.986670 28621 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 14:15:53.988209 28621 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:15:53.999210 28626 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:15:54.000015 28627 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:15:54.000685 28629 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:15:54.001513 28621 server_base.cc:1034] running on GCE node
I20240503 14:15:54.002018 28621 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 14:15:54.002804 28621 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 14:15:54.004007 28621 hybrid_clock.cc:648] HybridClock initialized: now 1714745754003950 us; error 28 us; skew 500 ppm
I20240503 14:15:54.004269 28621 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:15:54.006287 28621 webserver.cc:460] Webserver started at http://127.25.69.65:44509/ using document root <none> and password file <none>
I20240503 14:15:54.006932 28621 fs_manager.cc:359] Metadata directory not provided
I20240503 14:15:54.007038 28621 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:15:54.007306 28621 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 14:15:54.009586 28621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-0/data/instance:
uuid: "8d7f65aa1dde4b54803cb75dcafe6706"
format_stamp: "Formatted at 2024-05-03 14:15:54 on dist-test-slave-0c7n"
I20240503 14:15:54.010226 28621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-0/wal/instance:
uuid: "8d7f65aa1dde4b54803cb75dcafe6706"
format_stamp: "Formatted at 2024-05-03 14:15:54 on dist-test-slave-0c7n"
I20240503 14:15:54.014617 28621 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20240503 14:15:54.017479 28635 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:54.018585 28621 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20240503 14:15:54.018730 28621 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-0/wal
uuid: "8d7f65aa1dde4b54803cb75dcafe6706"
format_stamp: "Formatted at 2024-05-03 14:15:54 on dist-test-slave-0c7n"
I20240503 14:15:54.018900 28621 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:15:54.061975 28621 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:15:54.062757 28621 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 14:15:54.062999 28621 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:15:54.063915 28621 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 14:15:54.065385 28621 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 14:15:54.065459 28621 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:54.065577 28621 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 14:15:54.065629 28621 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:54.096381 28621 rpc_server.cc:307] RPC server started. Bound to: 127.25.69.65:33855
I20240503 14:15:54.096429 28747 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.69.65:33855 every 8 connection(s)
I20240503 14:15:54.097596 28621 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-0/data/info.pb
I20240503 14:15:54.100364 25877 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu as pid 28621
I20240503 14:15:54.100540 25877 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-0/wal/instance
I20240503 14:15:54.103652 25877 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
/tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.69.66:0
--local_ip_for_outbound_sockets=127.25.69.66
--webserver_interface=127.25.69.66
--webserver_port=0
--tserver_master_addrs=127.25.69.126:41619
--builtin_ntp_servers=127.25.69.84:41335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240503 14:15:54.110565 28748 heartbeater.cc:347] Connected to a master server at 127.25.69.126:41619
I20240503 14:15:54.110852 28748 heartbeater.cc:464] Registering TS with master...
I20240503 14:15:54.111627 28748 heartbeater.cc:511] Master 127.25.69.126:41619 requested a full tablet report, sending...
I20240503 14:15:54.113725 28562 ts_manager.cc:194] Registered new tserver with Master: 8d7f65aa1dde4b54803cb75dcafe6706 (127.25.69.65:33855)
I20240503 14:15:54.115944 28562 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.69.65:56901
W20240503 14:15:54.408326 28752 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 14:15:54.408588 28752 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 14:15:54.408672 28752 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 14:15:54.415740 28752 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 14:15:54.415901 28752 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.69.66
I20240503 14:15:54.424289 28752 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.69.84:41335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.69.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.69.66
--webserver_port=0
--tserver_master_addrs=127.25.69.126:41619
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.69.66
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 13:43:24 UTC on efd1337a2aa3
build id 107
ASAN enabled
I20240503 14:15:54.425498 28752 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 14:15:54.427094 28752 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:15:54.438593 28758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:15:54.439049 28760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:15:54.439766 28757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:15:54.440557 28752 server_base.cc:1034] running on GCE node
I20240503 14:15:54.441241 28752 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 14:15:54.442185 28752 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 14:15:54.443434 28752 hybrid_clock.cc:648] HybridClock initialized: now 1714745754443366 us; error 42 us; skew 500 ppm
I20240503 14:15:54.443706 28752 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:15:54.445935 28752 webserver.cc:460] Webserver started at http://127.25.69.66:41519/ using document root <none> and password file <none>
I20240503 14:15:54.446624 28752 fs_manager.cc:359] Metadata directory not provided
I20240503 14:15:54.446744 28752 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:15:54.447039 28752 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 14:15:54.449520 28752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-1/data/instance:
uuid: "62e1a40ea13d44e0ae9e5e5857db222b"
format_stamp: "Formatted at 2024-05-03 14:15:54 on dist-test-slave-0c7n"
I20240503 14:15:54.450273 28752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-1/wal/instance:
uuid: "62e1a40ea13d44e0ae9e5e5857db222b"
format_stamp: "Formatted at 2024-05-03 14:15:54 on dist-test-slave-0c7n"
I20240503 14:15:54.455173 28752 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20240503 14:15:54.458184 28766 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:54.459414 28752 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20240503 14:15:54.459560 28752 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-1/wal
uuid: "62e1a40ea13d44e0ae9e5e5857db222b"
format_stamp: "Formatted at 2024-05-03 14:15:54 on dist-test-slave-0c7n"
I20240503 14:15:54.459722 28752 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:15:54.483605 28752 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:15:54.484519 28752 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 14:15:54.484794 28752 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:15:54.485730 28752 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 14:15:54.487250 28752 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 14:15:54.487327 28752 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:54.487448 28752 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 14:15:54.487500 28752 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:54.517411 28752 rpc_server.cc:307] RPC server started. Bound to: 127.25.69.66:36187
I20240503 14:15:54.517452 28878 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.69.66:36187 every 8 connection(s)
I20240503 14:15:54.518616 28752 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-1/data/info.pb
I20240503 14:15:54.525040 25877 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu as pid 28752
I20240503 14:15:54.525251 25877 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-1/wal/instance
I20240503 14:15:54.530458 28879 heartbeater.cc:347] Connected to a master server at 127.25.69.126:41619
I20240503 14:15:54.530733 28879 heartbeater.cc:464] Registering TS with master...
I20240503 14:15:54.531486 28879 heartbeater.cc:511] Master 127.25.69.126:41619 requested a full tablet report, sending...
I20240503 14:15:54.532640 28562 ts_manager.cc:194] Registered new tserver with Master: 62e1a40ea13d44e0ae9e5e5857db222b (127.25.69.66:36187)
I20240503 14:15:54.533366 28562 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.69.66:39555
I20240503 14:15:54.540189 25877 external_mini_cluster.cc:930] 2 TS(s) registered with all masters
I20240503 14:15:54.554946 25877 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu pid 28752
I20240503 14:15:54.562721 28874 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 14:15:54.639222 25877 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu with pid 28752
I20240503 14:15:54.654556 25877 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu pid 28531
I20240503 14:15:54.655692 28592 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 14:15:54.749419 25877 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu with pid 28531
I20240503 14:15:54.768476 25877 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
/tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.69.126:41619
--webserver_interface=127.25.69.126
--webserver_port=42023
--builtin_ntp_servers=127.25.69.84:41335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.69.126:41619
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240503 14:15:55.085054 28891 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 14:15:55.085515 28891 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 14:15:55.085678 28891 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 14:15:55.093416 28891 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240503 14:15:55.093528 28891 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 14:15:55.093618 28891 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240503 14:15:55.093706 28891 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240503 14:15:55.105837 28891 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.69.84:41335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.25.69.126:41619
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.69.126:41619
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.69.126
--webserver_port=42023
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 13:43:24 UTC on efd1337a2aa3
build id 107
ASAN enabled
I20240503 14:15:55.107175 28891 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 14:15:55.109058 28891 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20240503 14:15:55.118664 28748 heartbeater.cc:503] Master 127.25.69.126:41619 was elected leader, sending a full tablet report...
W20240503 14:15:55.119632 28896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:15:55.120043 28748 heartbeater.cc:644] Failed to heartbeat to 127.25.69.126:41619 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.25.69.126:41619: connect: Connection refused (error 111)
W20240503 14:15:55.120481 28897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:15:55.121109 28899 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:15:55.121914 28891 server_base.cc:1034] running on GCE node
I20240503 14:15:55.122645 28891 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 14:15:55.124078 28891 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 14:15:55.125299 28891 hybrid_clock.cc:648] HybridClock initialized: now 1714745755125226 us; error 48 us; skew 500 ppm
I20240503 14:15:55.125605 28891 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:15:55.127797 28891 webserver.cc:460] Webserver started at http://127.25.69.126:42023/ using document root <none> and password file <none>
I20240503 14:15:55.128489 28891 fs_manager.cc:359] Metadata directory not provided
I20240503 14:15:55.128640 28891 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:15:55.133872 28891 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20240503 14:15:55.136613 28906 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:55.137895 28891 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240503 14:15:55.138056 28891 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/master-0/data,/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/master-0/wal
uuid: "56b73d92976d44cc8d015d604993e0ed"
format_stamp: "Formatted at 2024-05-03 14:15:53 on dist-test-slave-0c7n"
I20240503 14:15:55.138861 28891 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:15:55.151433 28891 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:15:55.152160 28891 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 14:15:55.152411 28891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:15:55.170194 28957 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.69.126:41619 every 8 connection(s)
I20240503 14:15:55.170190 28891 rpc_server.cc:307] RPC server started. Bound to: 127.25.69.126:41619
I20240503 14:15:55.171656 28891 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/master-0/data/info.pb
I20240503 14:15:55.175019 25877 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu as pid 28891
I20240503 14:15:55.179318 28958 sys_catalog.cc:263] Verifying existing consensus state
I20240503 14:15:55.182339 28958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed: Bootstrap starting.
I20240503 14:15:55.197659 28958 log.cc:824] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed: Log is configured to *not* fsync() on all Append() calls
I20240503 14:15:55.205154 28958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:15:55.205636 28958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed: Bootstrap complete.
I20240503 14:15:55.212004 28958 raft_consensus.cc:348] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56b73d92976d44cc8d015d604993e0ed" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 41619 } }
I20240503 14:15:55.212788 28958 raft_consensus.cc:729] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b73d92976d44cc8d015d604993e0ed, State: Initialized, Role: FOLLOWER
I20240503 14:15:55.213416 28958 consensus_queue.cc:260] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56b73d92976d44cc8d015d604993e0ed" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 41619 } }
I20240503 14:15:55.213650 28958 raft_consensus.cc:388] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:15:55.213766 28958 raft_consensus.cc:482] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:15:55.213924 28958 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:15:55.217170 28958 raft_consensus.cc:504] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56b73d92976d44cc8d015d604993e0ed" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 41619 } }
I20240503 14:15:55.217592 28958 leader_election.cc:302] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 56b73d92976d44cc8d015d604993e0ed; no voters:
I20240503 14:15:55.218132 28958 leader_election.cc:288] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 14:15:55.218290 28963 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:15:55.218962 28963 raft_consensus.cc:686] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed [term 2 LEADER]: Becoming Leader. State: Replica: 56b73d92976d44cc8d015d604993e0ed, State: Running, Role: LEADER
I20240503 14:15:55.219543 28963 consensus_queue.cc:237] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56b73d92976d44cc8d015d604993e0ed" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 41619 } }
I20240503 14:15:55.220029 28958 sys_catalog.cc:564] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed [sys.catalog]: configured and running, proceeding with master startup.
I20240503 14:15:55.221886 28964 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "56b73d92976d44cc8d015d604993e0ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56b73d92976d44cc8d015d604993e0ed" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 41619 } } }
I20240503 14:15:55.222316 28964 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed [sys.catalog]: This master's current role is: LEADER
I20240503 14:15:55.222920 28965 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader 56b73d92976d44cc8d015d604993e0ed. Latest consensus state: current_term: 2 leader_uuid: "56b73d92976d44cc8d015d604993e0ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56b73d92976d44cc8d015d604993e0ed" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 41619 } } }
I20240503 14:15:55.223145 28970 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240503 14:15:55.223165 28965 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed [sys.catalog]: This master's current role is: LEADER
I20240503 14:15:55.231877 28970 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240503 14:15:55.233273 28970 catalog_manager.cc:1259] Loaded cluster ID: 76f70225ea744a15abd94622bd76a85b
I20240503 14:15:55.233346 28970 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240503 14:15:55.235965 28970 catalog_manager.cc:1504] Loading token signing keys...
I20240503 14:15:55.237201 28970 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 56b73d92976d44cc8d015d604993e0ed: Loaded TSK: 0
I20240503 14:15:55.238382 28970 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240503 14:15:56.127002 28748 heartbeater.cc:347] Connected to a master server at 127.25.69.126:41619
I20240503 14:15:56.127200 28748 heartbeater.cc:503] Master 127.25.69.126:41619 was elected leader, sending a full tablet report...
I20240503 14:15:56.128919 28923 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "8d7f65aa1dde4b54803cb75dcafe6706" instance_seqno: 1714745754089379) as {username='slave'} at 127.25.69.65:51071; Asking this server to re-register.
I20240503 14:15:56.129599 28748 heartbeater.cc:464] Registering TS with master...
I20240503 14:15:56.129817 28748 heartbeater.cc:511] Master 127.25.69.126:41619 requested a full tablet report, sending...
I20240503 14:15:56.130854 28923 ts_manager.cc:194] Registered new tserver with Master: 8d7f65aa1dde4b54803cb75dcafe6706 (127.25.69.65:33855)
I20240503 14:15:56.133461 25877 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20240503 14:15:56.133598 25877 test_util.cc:268] Using random seed: 1538042063
I20240503 14:15:56.156240 28923 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42336:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20240503 14:15:56.181095 28683 tablet_service.cc:1467] Processing CreateTablet for tablet 2c81f86e59ff4613838c17a65c00bb25 (DEFAULT_TABLE table=test-workload [id=58e9b4deadc74bdd82cc178596dcf62a]), partition=RANGE (key) PARTITION UNBOUNDED
I20240503 14:15:56.182494 28683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c81f86e59ff4613838c17a65c00bb25. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:15:56.192075 28993 tablet_bootstrap.cc:492] T 2c81f86e59ff4613838c17a65c00bb25 P 8d7f65aa1dde4b54803cb75dcafe6706: Bootstrap starting.
I20240503 14:15:56.195210 28993 tablet_bootstrap.cc:654] T 2c81f86e59ff4613838c17a65c00bb25 P 8d7f65aa1dde4b54803cb75dcafe6706: Neither blocks nor log segments found. Creating new log.
I20240503 14:15:56.196183 28993 log.cc:824] T 2c81f86e59ff4613838c17a65c00bb25 P 8d7f65aa1dde4b54803cb75dcafe6706: Log is configured to *not* fsync() on all Append() calls
I20240503 14:15:56.198467 28993 tablet_bootstrap.cc:492] T 2c81f86e59ff4613838c17a65c00bb25 P 8d7f65aa1dde4b54803cb75dcafe6706: No bootstrap required, opened a new log
I20240503 14:15:56.198717 28993 ts_tablet_manager.cc:1367] T 2c81f86e59ff4613838c17a65c00bb25 P 8d7f65aa1dde4b54803cb75dcafe6706: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20240503 14:15:56.204372 28993 raft_consensus.cc:348] T 2c81f86e59ff4613838c17a65c00bb25 P 8d7f65aa1dde4b54803cb75dcafe6706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d7f65aa1dde4b54803cb75dcafe6706" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 33855 } }
I20240503 14:15:56.204663 28993 raft_consensus.cc:374] T 2c81f86e59ff4613838c17a65c00bb25 P 8d7f65aa1dde4b54803cb75dcafe6706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:15:56.204756 28993 raft_consensus.cc:729] T 2c81f86e59ff4613838c17a65c00bb25 P 8d7f65aa1dde4b54803cb75dcafe6706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d7f65aa1dde4b54803cb75dcafe6706, State: Initialized, Role: FOLLOWER
I20240503 14:15:56.205371 28993 consensus_queue.cc:260] T 2c81f86e59ff4613838c17a65c00bb25 P 8d7f65aa1dde4b54803cb75dcafe6706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d7f65aa1dde4b54803cb75dcafe6706" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 33855 } }
I20240503 14:15:56.205567 28993 raft_consensus.cc:388] T 2c81f86e59ff4613838c17a65c00bb25 P 8d7f65aa1dde4b54803cb75dcafe6706 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:15:56.205682 28993 raft_consensus.cc:482] T 2c81f86e59ff4613838c17a65c00bb25 P 8d7f65aa1dde4b54803cb75dcafe6706 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:15:56.205822 28993 raft_consensus.cc:3037] T 2c81f86e59ff4613838c17a65c00bb25 P 8d7f65aa1dde4b54803cb75dcafe6706 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:15:56.207629 28993 raft_consensus.cc:504] T 2c81f86e59ff4613838c17a65c00bb25 P 8d7f65aa1dde4b54803cb75dcafe6706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d7f65aa1dde4b54803cb75dcafe6706" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 33855 } }
I20240503 14:15:56.208112 28993 leader_election.cc:302] T 2c81f86e59ff4613838c17a65c00bb25 P 8d7f65aa1dde4b54803cb75dcafe6706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8d7f65aa1dde4b54803cb75dcafe6706; no voters:
I20240503 14:15:56.208747 28993 leader_election.cc:288] T 2c81f86e59ff4613838c17a65c00bb25 P 8d7f65aa1dde4b54803cb75dcafe6706 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 14:15:56.208914 28995 raft_consensus.cc:2781] T 2c81f86e59ff4613838c17a65c00bb25 P 8d7f65aa1dde4b54803cb75dcafe6706 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:15:56.209532 28995 raft_consensus.cc:686] T 2c81f86e59ff4613838c17a65c00bb25 P 8d7f65aa1dde4b54803cb75dcafe6706 [term 1 LEADER]: Becoming Leader. State: Replica: 8d7f65aa1dde4b54803cb75dcafe6706, State: Running, Role: LEADER
I20240503 14:15:56.210101 28995 consensus_queue.cc:237] T 2c81f86e59ff4613838c17a65c00bb25 P 8d7f65aa1dde4b54803cb75dcafe6706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d7f65aa1dde4b54803cb75dcafe6706" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 33855 } }
I20240503 14:15:56.210347 28993 ts_tablet_manager.cc:1398] T 2c81f86e59ff4613838c17a65c00bb25 P 8d7f65aa1dde4b54803cb75dcafe6706: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
I20240503 14:15:56.214929 28923 catalog_manager.cc:5484] T 2c81f86e59ff4613838c17a65c00bb25 P 8d7f65aa1dde4b54803cb75dcafe6706 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d7f65aa1dde4b54803cb75dcafe6706 (127.25.69.65). New cstate: current_term: 1 leader_uuid: "8d7f65aa1dde4b54803cb75dcafe6706" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d7f65aa1dde4b54803cb75dcafe6706" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 33855 } health_report { overall_health: HEALTHY } } }
I20240503 14:15:56.809438 25877 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
/tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.69.66:36187
--local_ip_for_outbound_sockets=127.25.69.66
--tserver_master_addrs=127.25.69.126:41619
--webserver_port=41519
--webserver_interface=127.25.69.66
--builtin_ntp_servers=127.25.69.84:41335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240503 14:15:57.111318 29012 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 14:15:57.111582 29012 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 14:15:57.111660 29012 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 14:15:57.118539 29012 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 14:15:57.118741 29012 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.69.66
I20240503 14:15:57.127171 29012 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.69.84:41335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.69.66:36187
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.69.66
--webserver_port=41519
--tserver_master_addrs=127.25.69.126:41619
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.69.66
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 13:43:24 UTC on efd1337a2aa3
build id 107
ASAN enabled
I20240503 14:15:57.128293 29012 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 14:15:57.129894 29012 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:15:57.140918 29017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:15:57.141619 29018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:15:57.142361 29020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:15:57.143164 29012 server_base.cc:1034] running on GCE node
I20240503 14:15:57.143671 29012 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 14:15:57.144601 29012 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 14:15:57.145805 29012 hybrid_clock.cc:648] HybridClock initialized: now 1714745757145745 us; error 40 us; skew 500 ppm
I20240503 14:15:57.146056 29012 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:15:57.148037 29012 webserver.cc:460] Webserver started at http://127.25.69.66:41519/ using document root <none> and password file <none>
I20240503 14:15:57.148680 29012 fs_manager.cc:359] Metadata directory not provided
I20240503 14:15:57.148816 29012 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:15:57.153261 29012 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20240503 14:15:57.155762 29026 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:57.156877 29012 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20240503 14:15:57.157008 29012 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-1/wal
uuid: "62e1a40ea13d44e0ae9e5e5857db222b"
format_stamp: "Formatted at 2024-05-03 14:15:54 on dist-test-slave-0c7n"
I20240503 14:15:57.157796 29012 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:15:57.175241 29012 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:15:57.176045 29012 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 14:15:57.176290 29012 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:15:57.177256 29012 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 14:15:57.178720 29012 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 14:15:57.178823 29012 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:57.178938 29012 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 14:15:57.179003 29012 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:57.209097 29012 rpc_server.cc:307] RPC server started. Bound to: 127.25.69.66:36187
I20240503 14:15:57.209156 29138 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.69.66:36187 every 8 connection(s)
I20240503 14:15:57.210474 29012 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-1/data/info.pb
I20240503 14:15:57.216603 25877 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu as pid 29012
I20240503 14:15:57.224300 29139 heartbeater.cc:347] Connected to a master server at 127.25.69.126:41619
I20240503 14:15:57.224572 29139 heartbeater.cc:464] Registering TS with master...
I20240503 14:15:57.225438 29139 heartbeater.cc:511] Master 127.25.69.126:41619 requested a full tablet report, sending...
I20240503 14:15:57.226799 28914 ts_manager.cc:194] Registered new tserver with Master: 62e1a40ea13d44e0ae9e5e5857db222b (127.25.69.66:36187)
I20240503 14:15:57.228224 28914 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.69.66:42871
I20240503 14:15:57.230057 29144 ts_tablet_manager.cc:902] T 2c81f86e59ff4613838c17a65c00bb25 P 62e1a40ea13d44e0ae9e5e5857db222b: Initiating tablet copy from peer 8d7f65aa1dde4b54803cb75dcafe6706 (127.25.69.65:33855)
I20240503 14:15:57.231613 29144 tablet_copy_client.cc:308] T 2c81f86e59ff4613838c17a65c00bb25 P 62e1a40ea13d44e0ae9e5e5857db222b: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:33855
I20240503 14:15:57.236384 28723 tablet_copy_service.cc:140] P 8d7f65aa1dde4b54803cb75dcafe6706: Received BeginTabletCopySession request for tablet 2c81f86e59ff4613838c17a65c00bb25 from peer 62e1a40ea13d44e0ae9e5e5857db222b ({username='slave'} at 127.25.69.66:60483)
I20240503 14:15:57.236578 28723 tablet_copy_service.cc:161] P 8d7f65aa1dde4b54803cb75dcafe6706: Beginning new tablet copy session on tablet 2c81f86e59ff4613838c17a65c00bb25 from peer 62e1a40ea13d44e0ae9e5e5857db222b at {username='slave'} at 127.25.69.66:60483: session id = 62e1a40ea13d44e0ae9e5e5857db222b-2c81f86e59ff4613838c17a65c00bb25
I20240503 14:15:57.238838 28723 tablet_copy_source_session.cc:205] T 2c81f86e59ff4613838c17a65c00bb25 P 8d7f65aa1dde4b54803cb75dcafe6706: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 14:15:57.242569 29144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c81f86e59ff4613838c17a65c00bb25. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:15:57.251937 29144 tablet_copy_client.cc:783] T 2c81f86e59ff4613838c17a65c00bb25 P 62e1a40ea13d44e0ae9e5e5857db222b: tablet copy: Starting download of 0 data blocks...
I20240503 14:15:57.252188 29144 tablet_copy_client.cc:647] T 2c81f86e59ff4613838c17a65c00bb25 P 62e1a40ea13d44e0ae9e5e5857db222b: tablet copy: Starting download of 1 WAL segments...
I20240503 14:15:57.256520 29144 tablet_copy_client.cc:523] T 2c81f86e59ff4613838c17a65c00bb25 P 62e1a40ea13d44e0ae9e5e5857db222b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 14:15:57.259210 29144 tablet_bootstrap.cc:492] T 2c81f86e59ff4613838c17a65c00bb25 P 62e1a40ea13d44e0ae9e5e5857db222b: Bootstrap starting.
I20240503 14:15:57.314800 29144 log.cc:824] T 2c81f86e59ff4613838c17a65c00bb25 P 62e1a40ea13d44e0ae9e5e5857db222b: Log is configured to *not* fsync() on all Append() calls
I20240503 14:15:57.783519 29144 tablet_bootstrap.cc:492] T 2c81f86e59ff4613838c17a65c00bb25 P 62e1a40ea13d44e0ae9e5e5857db222b: Bootstrap replayed 1/1 log segments. Stats: ops{read=214 overwritten=0 applied=214 ignored=0} inserts{seen=10650 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:15:57.783947 29144 tablet_bootstrap.cc:492] T 2c81f86e59ff4613838c17a65c00bb25 P 62e1a40ea13d44e0ae9e5e5857db222b: Bootstrap complete.
I20240503 14:15:57.784412 29144 ts_tablet_manager.cc:1367] T 2c81f86e59ff4613838c17a65c00bb25 P 62e1a40ea13d44e0ae9e5e5857db222b: Time spent bootstrapping tablet: real 0.525s user 0.504s sys 0.020s
I20240503 14:15:57.789168 29144 raft_consensus.cc:348] T 2c81f86e59ff4613838c17a65c00bb25 P 62e1a40ea13d44e0ae9e5e5857db222b [term 1 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d7f65aa1dde4b54803cb75dcafe6706" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 33855 } }
I20240503 14:15:57.789498 29144 raft_consensus.cc:729] T 2c81f86e59ff4613838c17a65c00bb25 P 62e1a40ea13d44e0ae9e5e5857db222b [term 1 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 62e1a40ea13d44e0ae9e5e5857db222b, State: Initialized, Role: NON_PARTICIPANT
I20240503 14:15:57.789894 29144 consensus_queue.cc:260] T 2c81f86e59ff4613838c17a65c00bb25 P 62e1a40ea13d44e0ae9e5e5857db222b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 214, Last appended: 1.214, Last appended by leader: 214, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d7f65aa1dde4b54803cb75dcafe6706" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 33855 } }
I20240503 14:15:57.790843 29139 heartbeater.cc:503] Master 127.25.69.126:41619 was elected leader, sending a full tablet report...
I20240503 14:15:57.791253 29144 ts_tablet_manager.cc:1398] T 2c81f86e59ff4613838c17a65c00bb25 P 62e1a40ea13d44e0ae9e5e5857db222b: Time spent starting tablet: real 0.007s user 0.005s sys 0.004s
I20240503 14:15:57.792282 28723 tablet_copy_service.cc:342] P 8d7f65aa1dde4b54803cb75dcafe6706: Request end of tablet copy session 62e1a40ea13d44e0ae9e5e5857db222b-2c81f86e59ff4613838c17a65c00bb25 received from {username='slave'} at 127.25.69.66:60483
I20240503 14:15:57.792425 28723 tablet_copy_service.cc:433] P 8d7f65aa1dde4b54803cb75dcafe6706: ending tablet copy session 62e1a40ea13d44e0ae9e5e5857db222b-2c81f86e59ff4613838c17a65c00bb25 on tablet 2c81f86e59ff4613838c17a65c00bb25 with peer 62e1a40ea13d44e0ae9e5e5857db222b
I20240503 14:15:57.799276 29074 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c81f86e59ff4613838c17a65c00bb25 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:41068
I20240503 14:15:57.799919 29151 tablet_replica.cc:330] T 2c81f86e59ff4613838c17a65c00bb25 P 62e1a40ea13d44e0ae9e5e5857db222b: stopping tablet replica
I20240503 14:15:57.800308 29151 raft_consensus.cc:2229] T 2c81f86e59ff4613838c17a65c00bb25 P 62e1a40ea13d44e0ae9e5e5857db222b [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20240503 14:15:57.800591 29151 raft_consensus.cc:2258] T 2c81f86e59ff4613838c17a65c00bb25 P 62e1a40ea13d44e0ae9e5e5857db222b [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20240503 14:15:57.801916 29151 ts_tablet_manager.cc:1875] T 2c81f86e59ff4613838c17a65c00bb25 P 62e1a40ea13d44e0ae9e5e5857db222b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 14:15:57.806097 29151 ts_tablet_manager.cc:1888] T 2c81f86e59ff4613838c17a65c00bb25 P 62e1a40ea13d44e0ae9e5e5857db222b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.214
I20240503 14:15:57.806223 29151 log.cc:1196] T 2c81f86e59ff4613838c17a65c00bb25 P 62e1a40ea13d44e0ae9e5e5857db222b: Deleting WAL directory at /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714745741318137-25877-0/minicluster-data/ts-1/wal/wals/2c81f86e59ff4613838c17a65c00bb25
I20240503 14:15:57.807840 29144 ts_tablet_manager.cc:902] T 2c81f86e59ff4613838c17a65c00bb25 P 62e1a40ea13d44e0ae9e5e5857db222b: Initiating tablet copy from peer 8d7f65aa1dde4b54803cb75dcafe6706 (127.25.69.65:33855)
I20240503 14:15:57.808961 29144 tablet_copy_client.cc:308] T 2c81f86e59ff4613838c17a65c00bb25 P 62e1a40ea13d44e0ae9e5e5857db222b: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:33855
I20240503 14:15:57.809607 28723 tablet_copy_service.cc:140] P 8d7f65aa1dde4b54803cb75dcafe6706: Received BeginTabletCopySession request for tablet 2c81f86e59ff4613838c17a65c00bb25 from peer 62e1a40ea13d44e0ae9e5e5857db222b ({username='slave'} at 127.25.69.66:60483)
I20240503 14:15:57.809751 28723 tablet_copy_service.cc:161] P 8d7f65aa1dde4b54803cb75dcafe6706: Beginning new tablet copy session on tablet 2c81f86e59ff4613838c17a65c00bb25 from peer 62e1a40ea13d44e0ae9e5e5857db222b at {username='slave'} at 127.25.69.66:60483: session id = 62e1a40ea13d44e0ae9e5e5857db222b-2c81f86e59ff4613838c17a65c00bb25
I20240503 14:15:57.811401 28723 tablet_copy_source_session.cc:205] T 2c81f86e59ff4613838c17a65c00bb25 P 8d7f65aa1dde4b54803cb75dcafe6706: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 14:15:57.812165 29144 ts_tablet_manager.cc:1875] T 2c81f86e59ff4613838c17a65c00bb25 P 62e1a40ea13d44e0ae9e5e5857db222b: Deleting tablet data with delete state TABLET_DATA_COPYING
I20240503 14:15:57.816113 29144 ts_tablet_manager.cc:1888] T 2c81f86e59ff4613838c17a65c00bb25 P 62e1a40ea13d44e0ae9e5e5857db222b: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.214
I20240503 14:15:57.816358 29144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c81f86e59ff4613838c17a65c00bb25. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:15:57.818354 29144 tablet_copy_client.cc:783] T 2c81f86e59ff4613838c17a65c00bb25 P 62e1a40ea13d44e0ae9e5e5857db222b: tablet copy: Starting download of 0 data blocks...
I20240503 14:15:57.818547 29144 tablet_copy_client.cc:647] T 2c81f86e59ff4613838c17a65c00bb25 P 62e1a40ea13d44e0ae9e5e5857db222b: tablet copy: Starting download of 1 WAL segments...
I20240503 14:15:57.822019 29144 tablet_copy_client.cc:523] T 2c81f86e59ff4613838c17a65c00bb25 P 62e1a40ea13d44e0ae9e5e5857db222b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 14:15:57.824080 29144 tablet_bootstrap.cc:492] T 2c81f86e59ff4613838c17a65c00bb25 P 62e1a40ea13d44e0ae9e5e5857db222b: Bootstrap starting.
I20240503 14:15:58.344796 29144 tablet_bootstrap.cc:492] T 2c81f86e59ff4613838c17a65c00bb25 P 62e1a40ea13d44e0ae9e5e5857db222b: Bootstrap replayed 1/1 log segments. Stats: ops{read=214 overwritten=0 applied=214 ignored=0} inserts{seen=10650 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:15:58.345247 29144 tablet_bootstrap.cc:492] T 2c81f86e59ff4613838c17a65c00bb25 P 62e1a40ea13d44e0ae9e5e5857db222b: Bootstrap complete.
I20240503 14:15:58.345640 29144 ts_tablet_manager.cc:1367] T 2c81f86e59ff4613838c17a65c00bb25 P 62e1a40ea13d44e0ae9e5e5857db222b: Time spent bootstrapping tablet: real 0.522s user 0.487s sys 0.036s
I20240503 14:15:58.346551 29144 raft_consensus.cc:348] T 2c81f86e59ff4613838c17a65c00bb25 P 62e1a40ea13d44e0ae9e5e5857db222b [term 1 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d7f65aa1dde4b54803cb75dcafe6706" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 33855 } }
I20240503 14:15:58.346706 29144 raft_consensus.cc:729] T 2c81f86e59ff4613838c17a65c00bb25 P 62e1a40ea13d44e0ae9e5e5857db222b [term 1 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 62e1a40ea13d44e0ae9e5e5857db222b, State: Initialized, Role: NON_PARTICIPANT
I20240503 14:15:58.346892 29144 consensus_queue.cc:260] T 2c81f86e59ff4613838c17a65c00bb25 P 62e1a40ea13d44e0ae9e5e5857db222b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 214, Last appended: 1.214, Last appended by leader: 214, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d7f65aa1dde4b54803cb75dcafe6706" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 33855 } }
I20240503 14:15:58.347544 29144 ts_tablet_manager.cc:1398] T 2c81f86e59ff4613838c17a65c00bb25 P 62e1a40ea13d44e0ae9e5e5857db222b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:15:58.348271 28723 tablet_copy_service.cc:342] P 8d7f65aa1dde4b54803cb75dcafe6706: Request end of tablet copy session 62e1a40ea13d44e0ae9e5e5857db222b-2c81f86e59ff4613838c17a65c00bb25 received from {username='slave'} at 127.25.69.66:60483
I20240503 14:15:58.348387 28723 tablet_copy_service.cc:433] P 8d7f65aa1dde4b54803cb75dcafe6706: ending tablet copy session 62e1a40ea13d44e0ae9e5e5857db222b-2c81f86e59ff4613838c17a65c00bb25 on tablet 2c81f86e59ff4613838c17a65c00bb25 with peer 62e1a40ea13d44e0ae9e5e5857db222b
I20240503 14:15:58.357720 25877 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu pid 28621
I20240503 14:15:58.358636 28743 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 14:15:58.452044 25877 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu with pid 28621
I20240503 14:15:58.470657 25877 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu pid 29012
I20240503 14:15:58.472919 29134 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 14:15:58.583981 25877 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu with pid 29012
I20240503 14:15:58.603546 25877 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu pid 28891
I20240503 14:15:58.604876 28953 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 14:15:58.713307 25877 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu with pid 28891
2024-05-03T14:15:58Z chronyd exiting
[ OK ] TabletCopyClientSessionITest.TestStartTabletCopy (5640 ms)
[ RUN ] TabletCopyClientSessionITest.TestCopyFromCrashedSource
2024-05-03T14:15:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-03T14:15:58Z Disabled control of system clock
I20240503 14:15:58.776906 25877 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
/tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.69.126:44207
--webserver_interface=127.25.69.126
--webserver_port=0
--builtin_ntp_servers=127.25.69.84:36225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.69.126:44207
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240503 14:15:59.082077 29164 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 14:15:59.082379 29164 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 14:15:59.082469 29164 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 14:15:59.089473 29164 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240503 14:15:59.089583 29164 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 14:15:59.089643 29164 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240503 14:15:59.089699 29164 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240503 14:15:59.098415 29164 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.69.84:36225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.25.69.126:44207
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.69.126:44207
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.69.126
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 13:43:24 UTC on efd1337a2aa3
build id 107
ASAN enabled
I20240503 14:15:59.099689 29164 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 14:15:59.101367 29164 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:15:59.111773 29169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:15:59.112546 29170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:15:59.113090 29172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:15:59.113971 29164 server_base.cc:1034] running on GCE node
I20240503 14:15:59.114787 29164 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 14:15:59.116099 29164 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 14:15:59.117316 29164 hybrid_clock.cc:648] HybridClock initialized: now 1714745759117252 us; error 37 us; skew 500 ppm
I20240503 14:15:59.117650 29164 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:15:59.125572 29164 webserver.cc:460] Webserver started at http://127.25.69.126:42111/ using document root <none> and password file <none>
I20240503 14:15:59.126262 29164 fs_manager.cc:359] Metadata directory not provided
I20240503 14:15:59.126397 29164 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:15:59.126696 29164 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 14:15:59.129310 29164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/master-0/data/instance:
uuid: "bc7397a74f9f4470acebc28e89ebed7b"
format_stamp: "Formatted at 2024-05-03 14:15:59 on dist-test-slave-0c7n"
I20240503 14:15:59.130079 29164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/master-0/wal/instance:
uuid: "bc7397a74f9f4470acebc28e89ebed7b"
format_stamp: "Formatted at 2024-05-03 14:15:59 on dist-test-slave-0c7n"
I20240503 14:15:59.135111 29164 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20240503 14:15:59.138178 29178 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:59.139411 29164 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.004s sys 0.000s
I20240503 14:15:59.139576 29164 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/master-0/data,/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/master-0/wal
uuid: "bc7397a74f9f4470acebc28e89ebed7b"
format_stamp: "Formatted at 2024-05-03 14:15:59 on dist-test-slave-0c7n"
I20240503 14:15:59.139766 29164 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:15:59.156112 29164 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:15:59.156850 29164 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 14:15:59.157122 29164 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:15:59.174880 29164 rpc_server.cc:307] RPC server started. Bound to: 127.25.69.126:44207
I20240503 14:15:59.174898 29229 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.69.126:44207 every 8 connection(s)
I20240503 14:15:59.176358 29164 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/master-0/data/info.pb
I20240503 14:15:59.180030 29230 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:15:59.183699 25877 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu as pid 29164
I20240503 14:15:59.183929 25877 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/master-0/wal/instance
I20240503 14:15:59.189366 29230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b: Bootstrap starting.
I20240503 14:15:59.192484 29230 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b: Neither blocks nor log segments found. Creating new log.
I20240503 14:15:59.193746 29230 log.cc:824] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b: Log is configured to *not* fsync() on all Append() calls
I20240503 14:15:59.196821 29230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b: No bootstrap required, opened a new log
I20240503 14:15:59.203020 29230 raft_consensus.cc:348] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc7397a74f9f4470acebc28e89ebed7b" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 44207 } }
I20240503 14:15:59.203343 29230 raft_consensus.cc:374] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:15:59.203438 29230 raft_consensus.cc:729] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc7397a74f9f4470acebc28e89ebed7b, State: Initialized, Role: FOLLOWER
I20240503 14:15:59.203975 29230 consensus_queue.cc:260] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc7397a74f9f4470acebc28e89ebed7b" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 44207 } }
I20240503 14:15:59.204142 29230 raft_consensus.cc:388] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:15:59.204267 29230 raft_consensus.cc:482] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:15:59.204438 29230 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:15:59.206760 29230 raft_consensus.cc:504] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc7397a74f9f4470acebc28e89ebed7b" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 44207 } }
I20240503 14:15:59.207191 29230 leader_election.cc:302] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bc7397a74f9f4470acebc28e89ebed7b; no voters:
I20240503 14:15:59.207706 29230 leader_election.cc:288] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 14:15:59.207826 29235 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:15:59.208415 29235 raft_consensus.cc:686] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b [term 1 LEADER]: Becoming Leader. State: Replica: bc7397a74f9f4470acebc28e89ebed7b, State: Running, Role: LEADER
I20240503 14:15:59.208885 29235 consensus_queue.cc:237] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc7397a74f9f4470acebc28e89ebed7b" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 44207 } }
I20240503 14:15:59.209501 29230 sys_catalog.cc:564] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b [sys.catalog]: configured and running, proceeding with master startup.
I20240503 14:15:59.211613 29236 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bc7397a74f9f4470acebc28e89ebed7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc7397a74f9f4470acebc28e89ebed7b" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 44207 } } }
I20240503 14:15:59.211666 29237 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b [sys.catalog]: SysCatalogTable state changed. Reason: New leader bc7397a74f9f4470acebc28e89ebed7b. Latest consensus state: current_term: 1 leader_uuid: "bc7397a74f9f4470acebc28e89ebed7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc7397a74f9f4470acebc28e89ebed7b" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 44207 } } }
I20240503 14:15:59.211946 29236 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b [sys.catalog]: This master's current role is: LEADER
I20240503 14:15:59.212040 29237 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b [sys.catalog]: This master's current role is: LEADER
I20240503 14:15:59.214213 29241 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240503 14:15:59.220868 29241 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240503 14:15:59.229604 29241 catalog_manager.cc:1347] Generated new cluster ID: e225ef3b9bd64ce28c0ad2e7aae7d11d
I20240503 14:15:59.229704 29241 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240503 14:15:59.249855 29241 catalog_manager.cc:1370] Generated new certificate authority record
I20240503 14:15:59.251502 29241 catalog_manager.cc:1504] Loading token signing keys...
I20240503 14:15:59.260617 29241 catalog_manager.cc:5857] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b: Generated new TSK 0
I20240503 14:15:59.261657 29241 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240503 14:15:59.278291 25877 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
/tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.69.65:0
--local_ip_for_outbound_sockets=127.25.69.65
--webserver_interface=127.25.69.65
--webserver_port=0
--tserver_master_addrs=127.25.69.126:44207
--builtin_ntp_servers=127.25.69.84:36225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240503 14:15:59.591288 29254 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 14:15:59.591578 29254 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 14:15:59.591720 29254 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 14:15:59.598762 29254 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 14:15:59.598968 29254 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.69.65
I20240503 14:15:59.607324 29254 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.69.84:36225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.69.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.69.65
--webserver_port=0
--tserver_master_addrs=127.25.69.126:44207
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.69.65
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 13:43:24 UTC on efd1337a2aa3
build id 107
ASAN enabled
I20240503 14:15:59.608536 29254 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 14:15:59.610126 29254 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:15:59.621444 29259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:15:59.621934 29262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:15:59.622792 29260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:15:59.623566 29254 server_base.cc:1034] running on GCE node
I20240503 14:15:59.624150 29254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 14:15:59.625075 29254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 14:15:59.626335 29254 hybrid_clock.cc:648] HybridClock initialized: now 1714745759626262 us; error 43 us; skew 500 ppm
I20240503 14:15:59.626627 29254 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:15:59.628782 29254 webserver.cc:460] Webserver started at http://127.25.69.65:40323/ using document root <none> and password file <none>
I20240503 14:15:59.629606 29254 fs_manager.cc:359] Metadata directory not provided
I20240503 14:15:59.629716 29254 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:15:59.630028 29254 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 14:15:59.632442 29254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-0/data/instance:
uuid: "3f2d731392064335a3f44b547ded659c"
format_stamp: "Formatted at 2024-05-03 14:15:59 on dist-test-slave-0c7n"
I20240503 14:15:59.633121 29254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-0/wal/instance:
uuid: "3f2d731392064335a3f44b547ded659c"
format_stamp: "Formatted at 2024-05-03 14:15:59 on dist-test-slave-0c7n"
I20240503 14:15:59.638142 29254 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.000s
I20240503 14:15:59.641496 29268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:59.642881 29254 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20240503 14:15:59.643023 29254 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-0/wal
uuid: "3f2d731392064335a3f44b547ded659c"
format_stamp: "Formatted at 2024-05-03 14:15:59 on dist-test-slave-0c7n"
I20240503 14:15:59.643203 29254 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:15:59.660105 29254 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:15:59.660885 29254 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 14:15:59.661167 29254 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:15:59.662017 29254 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 14:15:59.663396 29254 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 14:15:59.663463 29254 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:59.663549 29254 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 14:15:59.663587 29254 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 14:15:59.694485 29254 rpc_server.cc:307] RPC server started. Bound to: 127.25.69.65:42987
I20240503 14:15:59.694582 29380 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.69.65:42987 every 8 connection(s)
I20240503 14:15:59.696048 29254 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-0/data/info.pb
I20240503 14:15:59.698536 25877 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu as pid 29254
I20240503 14:15:59.698704 25877 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-0/wal/instance
I20240503 14:15:59.702091 25877 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
/tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.69.66:0
--local_ip_for_outbound_sockets=127.25.69.66
--webserver_interface=127.25.69.66
--webserver_port=0
--tserver_master_addrs=127.25.69.126:44207
--builtin_ntp_servers=127.25.69.84:36225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240503 14:15:59.709136 29381 heartbeater.cc:347] Connected to a master server at 127.25.69.126:44207
I20240503 14:15:59.709460 29381 heartbeater.cc:464] Registering TS with master...
I20240503 14:15:59.710412 29381 heartbeater.cc:511] Master 127.25.69.126:44207 requested a full tablet report, sending...
I20240503 14:15:59.712428 29195 ts_manager.cc:194] Registered new tserver with Master: 3f2d731392064335a3f44b547ded659c (127.25.69.65:42987)
I20240503 14:15:59.713958 29195 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.69.65:51709
W20240503 14:16:00.009706 29385 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 14:16:00.010076 29385 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 14:16:00.010195 29385 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 14:16:00.017473 29385 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 14:16:00.017711 29385 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.69.66
I20240503 14:16:00.026320 29385 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.69.84:36225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.69.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.69.66
--webserver_port=0
--tserver_master_addrs=127.25.69.126:44207
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.69.66
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 13:43:24 UTC on efd1337a2aa3
build id 107
ASAN enabled
I20240503 14:16:00.027526 29385 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 14:16:00.029176 29385 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:16:00.041307 29391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:16:00.041878 29390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:16:00.042794 29393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:16:00.043383 29385 server_base.cc:1034] running on GCE node
I20240503 14:16:00.043984 29385 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 14:16:00.044993 29385 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 14:16:00.046232 29385 hybrid_clock.cc:648] HybridClock initialized: now 1714745760046152 us; error 63 us; skew 500 ppm
I20240503 14:16:00.046561 29385 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:16:00.049026 29385 webserver.cc:460] Webserver started at http://127.25.69.66:42319/ using document root <none> and password file <none>
I20240503 14:16:00.049819 29385 fs_manager.cc:359] Metadata directory not provided
I20240503 14:16:00.049948 29385 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:16:00.050263 29385 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 14:16:00.052827 29385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-1/data/instance:
uuid: "b3a9f1311eaf42879cbdb42881ec5bf5"
format_stamp: "Formatted at 2024-05-03 14:16:00 on dist-test-slave-0c7n"
I20240503 14:16:00.053733 29385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-1/wal/instance:
uuid: "b3a9f1311eaf42879cbdb42881ec5bf5"
format_stamp: "Formatted at 2024-05-03 14:16:00 on dist-test-slave-0c7n"
I20240503 14:16:00.058912 29385 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20240503 14:16:00.062454 29399 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:16:00.063743 29385 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20240503 14:16:00.063907 29385 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-1/wal
uuid: "b3a9f1311eaf42879cbdb42881ec5bf5"
format_stamp: "Formatted at 2024-05-03 14:16:00 on dist-test-slave-0c7n"
I20240503 14:16:00.064081 29385 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:16:00.100734 29385 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:16:00.101830 29385 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 14:16:00.102128 29385 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:16:00.103111 29385 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 14:16:00.104578 29385 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 14:16:00.104653 29385 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 14:16:00.104769 29385 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 14:16:00.104823 29385 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 14:16:00.136909 29385 rpc_server.cc:307] RPC server started. Bound to: 127.25.69.66:32883
I20240503 14:16:00.136955 29511 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.69.66:32883 every 8 connection(s)
I20240503 14:16:00.138182 29385 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-1/data/info.pb
I20240503 14:16:00.141433 25877 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu as pid 29385
I20240503 14:16:00.141626 25877 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-1/wal/instance
I20240503 14:16:00.150875 29512 heartbeater.cc:347] Connected to a master server at 127.25.69.126:44207
I20240503 14:16:00.151158 29512 heartbeater.cc:464] Registering TS with master...
I20240503 14:16:00.151914 29512 heartbeater.cc:511] Master 127.25.69.126:44207 requested a full tablet report, sending...
I20240503 14:16:00.153223 29195 ts_manager.cc:194] Registered new tserver with Master: b3a9f1311eaf42879cbdb42881ec5bf5 (127.25.69.66:32883)
I20240503 14:16:00.153932 29195 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.69.66:46823
I20240503 14:16:00.157032 25877 external_mini_cluster.cc:930] 2 TS(s) registered with all masters
I20240503 14:16:00.170219 25877 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu pid 29385
I20240503 14:16:00.179168 29507 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 14:16:00.255316 25877 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu with pid 29385
I20240503 14:16:00.270248 25877 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu pid 29164
I20240503 14:16:00.271369 29225 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 14:16:00.365382 25877 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu with pid 29164
I20240503 14:16:00.385529 25877 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
/tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.69.126:44207
--webserver_interface=127.25.69.126
--webserver_port=42111
--builtin_ntp_servers=127.25.69.84:36225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.69.126:44207
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240503 14:16:00.693084 29524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 14:16:00.693420 29524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 14:16:00.693559 29524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 14:16:00.700541 29524 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240503 14:16:00.700629 29524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 14:16:00.700671 29524 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240503 14:16:00.700723 29524 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240503 14:16:00.709420 29524 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.69.84:36225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.25.69.126:44207
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.69.126:44207
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.69.126
--webserver_port=42111
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 13:43:24 UTC on efd1337a2aa3
build id 107
ASAN enabled
I20240503 14:16:00.710542 29524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 14:16:00.712054 29524 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20240503 14:16:00.717397 29381 heartbeater.cc:503] Master 127.25.69.126:44207 was elected leader, sending a full tablet report...
W20240503 14:16:00.718751 29381 heartbeater.cc:644] Failed to heartbeat to 127.25.69.126:44207 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.25.69.126:44207: connect: Connection refused (error 111)
W20240503 14:16:00.721799 29530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:16:00.722398 29529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:16:00.723276 29532 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:16:00.723976 29524 server_base.cc:1034] running on GCE node
I20240503 14:16:00.724701 29524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 14:16:00.726070 29524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 14:16:00.727288 29524 hybrid_clock.cc:648] HybridClock initialized: now 1714745760727225 us; error 37 us; skew 500 ppm
I20240503 14:16:00.727587 29524 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:16:00.729700 29524 webserver.cc:460] Webserver started at http://127.25.69.126:42111/ using document root <none> and password file <none>
I20240503 14:16:00.730374 29524 fs_manager.cc:359] Metadata directory not provided
I20240503 14:16:00.730515 29524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:16:00.735505 29524 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20240503 14:16:00.738425 29539 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:16:00.739665 29524 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20240503 14:16:00.739815 29524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/master-0/data,/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/master-0/wal
uuid: "bc7397a74f9f4470acebc28e89ebed7b"
format_stamp: "Formatted at 2024-05-03 14:15:59 on dist-test-slave-0c7n"
I20240503 14:16:00.740667 29524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:16:00.773804 29524 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:16:00.774714 29524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 14:16:00.775091 29524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:16:00.793884 29524 rpc_server.cc:307] RPC server started. Bound to: 127.25.69.126:44207
I20240503 14:16:00.793903 29590 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.69.126:44207 every 8 connection(s)
I20240503 14:16:00.795485 29524 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/master-0/data/info.pb
I20240503 14:16:00.801748 29591 sys_catalog.cc:263] Verifying existing consensus state
I20240503 14:16:00.802488 25877 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu as pid 29524
I20240503 14:16:00.805657 29591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b: Bootstrap starting.
I20240503 14:16:00.820885 29591 log.cc:824] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b: Log is configured to *not* fsync() on all Append() calls
I20240503 14:16:00.828513 29591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:16:00.829052 29591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b: Bootstrap complete.
I20240503 14:16:00.835851 29591 raft_consensus.cc:348] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc7397a74f9f4470acebc28e89ebed7b" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 44207 } }
I20240503 14:16:00.836603 29591 raft_consensus.cc:729] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc7397a74f9f4470acebc28e89ebed7b, State: Initialized, Role: FOLLOWER
I20240503 14:16:00.837168 29591 consensus_queue.cc:260] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc7397a74f9f4470acebc28e89ebed7b" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 44207 } }
I20240503 14:16:00.837409 29591 raft_consensus.cc:388] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:00.837515 29591 raft_consensus.cc:482] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:00.837684 29591 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:16:00.841295 29591 raft_consensus.cc:504] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc7397a74f9f4470acebc28e89ebed7b" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 44207 } }
I20240503 14:16:00.841769 29591 leader_election.cc:302] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bc7397a74f9f4470acebc28e89ebed7b; no voters:
I20240503 14:16:00.842300 29591 leader_election.cc:288] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 14:16:00.842425 29596 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:16:00.843039 29596 raft_consensus.cc:686] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b [term 2 LEADER]: Becoming Leader. State: Replica: bc7397a74f9f4470acebc28e89ebed7b, State: Running, Role: LEADER
I20240503 14:16:00.843534 29596 consensus_queue.cc:237] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc7397a74f9f4470acebc28e89ebed7b" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 44207 } }
I20240503 14:16:00.844134 29591 sys_catalog.cc:564] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b [sys.catalog]: configured and running, proceeding with master startup.
I20240503 14:16:00.845894 29597 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "bc7397a74f9f4470acebc28e89ebed7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc7397a74f9f4470acebc28e89ebed7b" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 44207 } } }
I20240503 14:16:00.846244 29597 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b [sys.catalog]: This master's current role is: LEADER
I20240503 14:16:00.845917 29598 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b [sys.catalog]: SysCatalogTable state changed. Reason: New leader bc7397a74f9f4470acebc28e89ebed7b. Latest consensus state: current_term: 2 leader_uuid: "bc7397a74f9f4470acebc28e89ebed7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc7397a74f9f4470acebc28e89ebed7b" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 44207 } } }
I20240503 14:16:00.846453 29598 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b [sys.catalog]: This master's current role is: LEADER
I20240503 14:16:00.853232 29602 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240503 14:16:00.858562 29602 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240503 14:16:00.859880 29602 catalog_manager.cc:1259] Loaded cluster ID: e225ef3b9bd64ce28c0ad2e7aae7d11d
I20240503 14:16:00.859988 29602 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240503 14:16:00.863894 29602 catalog_manager.cc:1504] Loading token signing keys...
I20240503 14:16:00.865389 29602 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bc7397a74f9f4470acebc28e89ebed7b: Loaded TSK: 0
I20240503 14:16:00.867015 29602 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240503 14:16:01.725677 29381 heartbeater.cc:347] Connected to a master server at 127.25.69.126:44207
I20240503 14:16:01.725899 29381 heartbeater.cc:503] Master 127.25.69.126:44207 was elected leader, sending a full tablet report...
I20240503 14:16:01.727490 29556 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "3f2d731392064335a3f44b547ded659c" instance_seqno: 1714745759686641) as {username='slave'} at 127.25.69.65:45495; Asking this server to re-register.
I20240503 14:16:01.728127 29381 heartbeater.cc:464] Registering TS with master...
I20240503 14:16:01.728318 29381 heartbeater.cc:511] Master 127.25.69.126:44207 requested a full tablet report, sending...
I20240503 14:16:01.729512 29556 ts_manager.cc:194] Registered new tserver with Master: 3f2d731392064335a3f44b547ded659c (127.25.69.65:42987)
I20240503 14:16:01.734972 25877 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20240503 14:16:01.735168 25877 test_util.cc:268] Using random seed: 1543643629
I20240503 14:16:01.755172 29556 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56060:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20240503 14:16:01.778030 29316 tablet_service.cc:1467] Processing CreateTablet for tablet 64bf07199c374bcfa7bbee17bada90a1 (DEFAULT_TABLE table=test-workload [id=8f1c5313277f4633a0ce56d348762c0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20240503 14:16:01.779261 29316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64bf07199c374bcfa7bbee17bada90a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:01.788703 29626 tablet_bootstrap.cc:492] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c: Bootstrap starting.
I20240503 14:16:01.791590 29626 tablet_bootstrap.cc:654] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c: Neither blocks nor log segments found. Creating new log.
I20240503 14:16:01.792587 29626 log.cc:824] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c: Log is configured to *not* fsync() on all Append() calls
I20240503 14:16:01.795225 29626 tablet_bootstrap.cc:492] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c: No bootstrap required, opened a new log
I20240503 14:16:01.795488 29626 ts_tablet_manager.cc:1367] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20240503 14:16:01.804271 29626 raft_consensus.cc:348] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f2d731392064335a3f44b547ded659c" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 42987 } }
I20240503 14:16:01.804680 29626 raft_consensus.cc:374] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:16:01.804800 29626 raft_consensus.cc:729] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2d731392064335a3f44b547ded659c, State: Initialized, Role: FOLLOWER
I20240503 14:16:01.805531 29626 consensus_queue.cc:260] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f2d731392064335a3f44b547ded659c" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 42987 } }
I20240503 14:16:01.805792 29626 raft_consensus.cc:388] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:01.805908 29626 raft_consensus.cc:482] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:01.806051 29626 raft_consensus.cc:3037] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:16:01.809074 29626 raft_consensus.cc:504] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f2d731392064335a3f44b547ded659c" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 42987 } }
I20240503 14:16:01.809638 29626 leader_election.cc:302] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f2d731392064335a3f44b547ded659c; no voters:
I20240503 14:16:01.810292 29626 leader_election.cc:288] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 14:16:01.810425 29628 raft_consensus.cc:2781] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:16:01.811926 29626 ts_tablet_manager.cc:1398] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c: Time spent starting tablet: real 0.016s user 0.017s sys 0.000s
I20240503 14:16:01.812425 29628 raft_consensus.cc:686] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c [term 1 LEADER]: Becoming Leader. State: Replica: 3f2d731392064335a3f44b547ded659c, State: Running, Role: LEADER
I20240503 14:16:01.812858 29628 consensus_queue.cc:237] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f2d731392064335a3f44b547ded659c" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 42987 } }
I20240503 14:16:01.818115 29556 catalog_manager.cc:5484] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f2d731392064335a3f44b547ded659c (127.25.69.65). New cstate: current_term: 1 leader_uuid: "3f2d731392064335a3f44b547ded659c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f2d731392064335a3f44b547ded659c" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 42987 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:02.403657 25877 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
/tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.69.66:32883
--local_ip_for_outbound_sockets=127.25.69.66
--tserver_master_addrs=127.25.69.126:44207
--webserver_port=42319
--webserver_interface=127.25.69.66
--builtin_ntp_servers=127.25.69.84:36225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240503 14:16:02.716884 29644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 14:16:02.717320 29644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 14:16:02.717474 29644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 14:16:02.725468 29644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 14:16:02.725636 29644 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.69.66
I20240503 14:16:02.734005 29644 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.69.84:36225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.69.66:32883
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.69.66
--webserver_port=42319
--tserver_master_addrs=127.25.69.126:44207
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.69.66
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 13:43:24 UTC on efd1337a2aa3
build id 107
ASAN enabled
I20240503 14:16:02.735309 29644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 14:16:02.737038 29644 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:16:02.749006 29649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:16:02.749586 29650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:16:02.751307 29652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:16:02.751328 29644 server_base.cc:1034] running on GCE node
I20240503 14:16:02.751964 29644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 14:16:02.752908 29644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 14:16:02.754153 29644 hybrid_clock.cc:648] HybridClock initialized: now 1714745762754086 us; error 36 us; skew 500 ppm
I20240503 14:16:02.754478 29644 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:16:02.756736 29644 webserver.cc:460] Webserver started at http://127.25.69.66:42319/ using document root <none> and password file <none>
I20240503 14:16:02.757449 29644 fs_manager.cc:359] Metadata directory not provided
I20240503 14:16:02.757582 29644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:16:02.762642 29644 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20240503 14:16:02.765226 29658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:16:02.766618 29644 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20240503 14:16:02.766791 29644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-1/wal
uuid: "b3a9f1311eaf42879cbdb42881ec5bf5"
format_stamp: "Formatted at 2024-05-03 14:16:00 on dist-test-slave-0c7n"
I20240503 14:16:02.767597 29644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:16:02.784564 29644 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:16:02.785396 29644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 14:16:02.785656 29644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:16:02.786548 29644 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 14:16:02.787966 29644 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 14:16:02.788057 29644 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 14:16:02.788167 29644 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 14:16:02.788236 29644 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 14:16:02.821559 29770 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.69.66:32883 every 8 connection(s)
I20240503 14:16:02.821590 29644 rpc_server.cc:307] RPC server started. Bound to: 127.25.69.66:32883
I20240503 14:16:02.823117 29644 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-1/data/info.pb
I20240503 14:16:02.831439 25877 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu as pid 29644
W20240503 14:16:02.836094 29376 generic_service.cc:139] {username='slave'} at 127.0.0.1:60870 forcing change of non-runtime-safe flag fault_crash_on_handle_tc_fetch_data
I20240503 14:16:02.836289 29376 generic_service.cc:175] {username='slave'} at 127.0.0.1:60870 changed flags via RPC: fault_crash_on_handle_tc_fetch_data from '0' to '1.0'
I20240503 14:16:02.838001 29771 heartbeater.cc:347] Connected to a master server at 127.25.69.126:44207
I20240503 14:16:02.838315 29771 heartbeater.cc:464] Registering TS with master...
I20240503 14:16:02.839162 29771 heartbeater.cc:511] Master 127.25.69.126:44207 requested a full tablet report, sending...
I20240503 14:16:02.840569 29554 ts_manager.cc:194] Registered new tserver with Master: b3a9f1311eaf42879cbdb42881ec5bf5 (127.25.69.66:32883)
I20240503 14:16:02.841872 29554 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.69.66:51229
I20240503 14:16:02.846470 29776 ts_tablet_manager.cc:902] T 64bf07199c374bcfa7bbee17bada90a1 P b3a9f1311eaf42879cbdb42881ec5bf5: Initiating tablet copy from peer 3f2d731392064335a3f44b547ded659c (127.25.69.65:42987)
I20240503 14:16:02.848253 29776 tablet_copy_client.cc:308] T 64bf07199c374bcfa7bbee17bada90a1 P b3a9f1311eaf42879cbdb42881ec5bf5: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:42987
I20240503 14:16:02.853514 29356 tablet_copy_service.cc:140] P 3f2d731392064335a3f44b547ded659c: Received BeginTabletCopySession request for tablet 64bf07199c374bcfa7bbee17bada90a1 from peer b3a9f1311eaf42879cbdb42881ec5bf5 ({username='slave'} at 127.25.69.66:41795)
I20240503 14:16:02.853690 29356 tablet_copy_service.cc:161] P 3f2d731392064335a3f44b547ded659c: Beginning new tablet copy session on tablet 64bf07199c374bcfa7bbee17bada90a1 from peer b3a9f1311eaf42879cbdb42881ec5bf5 at {username='slave'} at 127.25.69.66:41795: session id = b3a9f1311eaf42879cbdb42881ec5bf5-64bf07199c374bcfa7bbee17bada90a1
I20240503 14:16:02.856140 29356 tablet_copy_source_session.cc:205] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 14:16:02.860100 29776 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64bf07199c374bcfa7bbee17bada90a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:02.870250 29776 tablet_copy_client.cc:783] T 64bf07199c374bcfa7bbee17bada90a1 P b3a9f1311eaf42879cbdb42881ec5bf5: tablet copy: Starting download of 0 data blocks...
I20240503 14:16:02.870572 29776 tablet_copy_client.cc:647] T 64bf07199c374bcfa7bbee17bada90a1 P b3a9f1311eaf42879cbdb42881ec5bf5: tablet copy: Starting download of 1 WAL segments...
W20240503 14:16:02.872014 29356 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20240503 14:16:02.872119 29356 fault_injection.cc:44] THIS SERVER MAY CRASH!
E20240503 14:16:02.872182 29356 fault_injection.cc:59] injecting fault for kudu (pid 29254): FLAGS_fault_crash_on_handle_tc_fetch_data (process will exit)
W20240503 14:16:02.894490 29776 ts_tablet_manager.cc:980] T 64bf07199c374bcfa7bbee17bada90a1 P b3a9f1311eaf42879cbdb42881ec5bf5: Tablet Copy: Unable to fetch data from remote peer 3f2d731392064335a3f44b547ded659c (127.25.69.65:42987): Network error: Unable to download WAL segment with seq. number 1: unable to fetch data from remote: recv got EOF from 127.25.69.65:42987 (error 108)
I20240503 14:16:02.894713 29776 tablet_replica.cc:330] T 64bf07199c374bcfa7bbee17bada90a1 P b3a9f1311eaf42879cbdb42881ec5bf5: stopping tablet replica
I20240503 14:16:02.894971 29776 raft_consensus.cc:2229] T 64bf07199c374bcfa7bbee17bada90a1 P b3a9f1311eaf42879cbdb42881ec5bf5 [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20240503 14:16:02.895172 29776 raft_consensus.cc:2258] T 64bf07199c374bcfa7bbee17bada90a1 P b3a9f1311eaf42879cbdb42881ec5bf5 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
W20240503 14:16:02.896288 29776 tablet_copy_client.cc:1108] T 64bf07199c374bcfa7bbee17bada90a1 P b3a9f1311eaf42879cbdb42881ec5bf5: tablet copy: Unable to close tablet copy session: Network error: failure ending tablet copy session: Client connection negotiation failed: client connection to 127.25.69.65:42987: connect: Connection refused (error 111)
W20240503 14:16:02.896986 29776 tablet_metadata.cc:476] failed to load DataDirGroup from superblock: Already present: tried to load directory group for tablet 64bf07199c374bcfa7bbee17bada90a1 but one is already registered
I20240503 14:16:02.897241 29776 ts_tablet_manager.cc:1875] T 64bf07199c374bcfa7bbee17bada90a1 P b3a9f1311eaf42879cbdb42881ec5bf5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 14:16:02.901825 29776 ts_tablet_manager.cc:1888] T 64bf07199c374bcfa7bbee17bada90a1 P b3a9f1311eaf42879cbdb42881ec5bf5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.0
I20240503 14:16:02.901965 29776 log.cc:1196] T 64bf07199c374bcfa7bbee17bada90a1 P b3a9f1311eaf42879cbdb42881ec5bf5: Deleting WAL directory at /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-1/wal/wals/64bf07199c374bcfa7bbee17bada90a1
I20240503 14:16:02.907400 25877 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
/tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.69.65:42987
--local_ip_for_outbound_sockets=127.25.69.65
--tserver_master_addrs=127.25.69.126:44207
--webserver_port=40323
--webserver_interface=127.25.69.65
--builtin_ntp_servers=127.25.69.84:36225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240503 14:16:03.214599 29781 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 14:16:03.214907 29781 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 14:16:03.215049 29781 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 14:16:03.222065 29781 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 14:16:03.222297 29781 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.69.65
I20240503 14:16:03.230652 29781 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.69.84:36225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.69.65:42987
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.69.65
--webserver_port=40323
--tserver_master_addrs=127.25.69.126:44207
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.69.65
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 13:43:24 UTC on efd1337a2aa3
build id 107
ASAN enabled
I20240503 14:16:03.232012 29781 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 14:16:03.233686 29781 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:16:03.245102 29786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:16:03.245649 29789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:16:03.246474 29787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:16:03.247265 29781 server_base.cc:1034] running on GCE node
I20240503 14:16:03.247782 29781 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 14:16:03.248634 29781 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 14:16:03.249843 29781 hybrid_clock.cc:648] HybridClock initialized: now 1714745763249787 us; error 29 us; skew 500 ppm
I20240503 14:16:03.250124 29781 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:16:03.252315 29781 webserver.cc:460] Webserver started at http://127.25.69.65:40323/ using document root <none> and password file <none>
I20240503 14:16:03.252934 29781 fs_manager.cc:359] Metadata directory not provided
I20240503 14:16:03.253089 29781 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:16:03.257789 29781 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20240503 14:16:03.260419 29795 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:16:03.261706 29781 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20240503 14:16:03.261862 29781 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-0/wal
uuid: "3f2d731392064335a3f44b547ded659c"
format_stamp: "Formatted at 2024-05-03 14:15:59 on dist-test-slave-0c7n"
I20240503 14:16:03.262629 29781 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:16:03.287151 29781 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:16:03.288053 29781 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 14:16:03.288383 29781 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:16:03.289430 29781 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 14:16:03.291399 29802 ts_tablet_manager.cc:522] Loading tablet metadata (0/1 complete)
I20240503 14:16:03.296202 29781 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240503 14:16:03.296330 29781 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20240503 14:16:03.296444 29781 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240503 14:16:03.299145 29781 ts_tablet_manager.cc:590] Registered 1 tablets
I20240503 14:16:03.299237 29781 ts_tablet_manager.cc:569] Time spent register tablets: real 0.003s user 0.001s sys 0.000s
I20240503 14:16:03.299503 29802 tablet_bootstrap.cc:492] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c: Bootstrap starting.
I20240503 14:16:03.341667 29781 rpc_server.cc:307] RPC server started. Bound to: 127.25.69.65:42987
I20240503 14:16:03.341693 29908 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.69.65:42987 every 8 connection(s)
I20240503 14:16:03.343163 29781 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714745741318137-25877-0/minicluster-data/ts-0/data/info.pb
I20240503 14:16:03.346752 25877 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu as pid 29781
I20240503 14:16:03.395741 29909 heartbeater.cc:347] Connected to a master server at 127.25.69.126:44207
I20240503 14:16:03.396049 29909 heartbeater.cc:464] Registering TS with master...
I20240503 14:16:03.396937 29909 heartbeater.cc:511] Master 127.25.69.126:44207 requested a full tablet report, sending...
I20240503 14:16:03.399124 29554 ts_manager.cc:194] Re-registered known tserver with Master: 3f2d731392064335a3f44b547ded659c (127.25.69.65:42987)
I20240503 14:16:03.400130 29554 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.69.65:47875
I20240503 14:16:03.409878 29802 log.cc:824] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c: Log is configured to *not* fsync() on all Append() calls
I20240503 14:16:03.844918 29771 heartbeater.cc:503] Master 127.25.69.126:44207 was elected leader, sending a full tablet report...
W20240503 14:16:03.846937 29554 catalog_manager.cc:5397] Tablet 64bf07199c374bcfa7bbee17bada90a1 (table test-workload [id=8f1c5313277f4633a0ce56d348762c0d]) has failed on TS b3a9f1311eaf42879cbdb42881ec5bf5 (127.25.69.66:32883): Network error: Unable to download WAL segment with seq. number 1: unable to fetch data from remote: recv got EOF from 127.25.69.65:42987 (error 108)
I20240503 14:16:03.875113 29802 tablet_bootstrap.cc:492] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c: Bootstrap replayed 1/1 log segments. Stats: ops{read=209 overwritten=0 applied=209 ignored=0} inserts{seen=10400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:16:03.875639 29802 tablet_bootstrap.cc:492] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c: Bootstrap complete.
I20240503 14:16:03.876839 29802 ts_tablet_manager.cc:1367] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c: Time spent bootstrapping tablet: real 0.578s user 0.500s sys 0.072s
I20240503 14:16:03.881714 29802 raft_consensus.cc:348] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f2d731392064335a3f44b547ded659c" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 42987 } }
I20240503 14:16:03.882452 29802 raft_consensus.cc:729] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2d731392064335a3f44b547ded659c, State: Initialized, Role: FOLLOWER
I20240503 14:16:03.883008 29802 consensus_queue.cc:260] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 209, Last appended: 1.209, Last appended by leader: 209, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f2d731392064335a3f44b547ded659c" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 42987 } }
I20240503 14:16:03.883180 29802 raft_consensus.cc:388] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:03.883271 29802 raft_consensus.cc:482] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:03.883399 29802 raft_consensus.cc:3037] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:16:03.886770 29802 raft_consensus.cc:504] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f2d731392064335a3f44b547ded659c" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 42987 } }
I20240503 14:16:03.887255 29802 leader_election.cc:302] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f2d731392064335a3f44b547ded659c; no voters:
I20240503 14:16:03.887740 29802 leader_election.cc:288] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 14:16:03.887887 29916 raft_consensus.cc:2781] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:16:03.888561 29916 raft_consensus.cc:686] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c [term 2 LEADER]: Becoming Leader. State: Replica: 3f2d731392064335a3f44b547ded659c, State: Running, Role: LEADER
I20240503 14:16:03.888870 29909 heartbeater.cc:503] Master 127.25.69.126:44207 was elected leader, sending a full tablet report...
I20240503 14:16:03.889449 29802 ts_tablet_manager.cc:1398] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c: Time spent starting tablet: real 0.012s user 0.015s sys 0.001s
I20240503 14:16:03.889537 29916 consensus_queue.cc:237] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 209, Committed index: 209, Last appended: 1.209, Last appended by leader: 209, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f2d731392064335a3f44b547ded659c" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 42987 } }
I20240503 14:16:03.893157 29554 catalog_manager.cc:5484] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "3f2d731392064335a3f44b547ded659c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f2d731392064335a3f44b547ded659c" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 42987 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:03.893790 29921 ts_tablet_manager.cc:902] T 64bf07199c374bcfa7bbee17bada90a1 P b3a9f1311eaf42879cbdb42881ec5bf5: Initiating tablet copy from peer 3f2d731392064335a3f44b547ded659c (127.25.69.65:42987)
I20240503 14:16:03.896363 29921 tablet_copy_client.cc:308] T 64bf07199c374bcfa7bbee17bada90a1 P b3a9f1311eaf42879cbdb42881ec5bf5: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:42987
I20240503 14:16:03.902922 29884 tablet_copy_service.cc:140] P 3f2d731392064335a3f44b547ded659c: Received BeginTabletCopySession request for tablet 64bf07199c374bcfa7bbee17bada90a1 from peer b3a9f1311eaf42879cbdb42881ec5bf5 ({username='slave'} at 127.25.69.66:55553)
I20240503 14:16:03.903143 29884 tablet_copy_service.cc:161] P 3f2d731392064335a3f44b547ded659c: Beginning new tablet copy session on tablet 64bf07199c374bcfa7bbee17bada90a1 from peer b3a9f1311eaf42879cbdb42881ec5bf5 at {username='slave'} at 127.25.69.66:55553: session id = b3a9f1311eaf42879cbdb42881ec5bf5-64bf07199c374bcfa7bbee17bada90a1
I20240503 14:16:03.905651 29884 tablet_copy_source_session.cc:205] T 64bf07199c374bcfa7bbee17bada90a1 P 3f2d731392064335a3f44b547ded659c: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 14:16:03.907071 29921 ts_tablet_manager.cc:1875] T 64bf07199c374bcfa7bbee17bada90a1 P b3a9f1311eaf42879cbdb42881ec5bf5: Deleting tablet data with delete state TABLET_DATA_COPYING
I20240503 14:16:03.911360 29921 ts_tablet_manager.cc:1888] T 64bf07199c374bcfa7bbee17bada90a1 P b3a9f1311eaf42879cbdb42881ec5bf5: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.0
I20240503 14:16:03.911612 29921 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64bf07199c374bcfa7bbee17bada90a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:03.913754 29921 tablet_copy_client.cc:783] T 64bf07199c374bcfa7bbee17bada90a1 P b3a9f1311eaf42879cbdb42881ec5bf5: tablet copy: Starting download of 0 data blocks...
I20240503 14:16:03.913997 29921 tablet_copy_client.cc:647] T 64bf07199c374bcfa7bbee17bada90a1 P b3a9f1311eaf42879cbdb42881ec5bf5: tablet copy: Starting download of 1 WAL segments...
I20240503 14:16:03.918032 29921 tablet_copy_client.cc:523] T 64bf07199c374bcfa7bbee17bada90a1 P b3a9f1311eaf42879cbdb42881ec5bf5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 14:16:03.920382 29921 tablet_bootstrap.cc:492] T 64bf07199c374bcfa7bbee17bada90a1 P b3a9f1311eaf42879cbdb42881ec5bf5: Bootstrap starting.
I20240503 14:16:03.982267 29921 log.cc:824] T 64bf07199c374bcfa7bbee17bada90a1 P b3a9f1311eaf42879cbdb42881ec5bf5: Log is configured to *not* fsync() on all Append() calls
I20240503 14:16:04.449095 29921 tablet_bootstrap.cc:492] T 64bf07199c374bcfa7bbee17bada90a1 P b3a9f1311eaf42879cbdb42881ec5bf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=210 overwritten=0 applied=210 ignored=0} inserts{seen=10400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:16:04.449576 29921 tablet_bootstrap.cc:492] T 64bf07199c374bcfa7bbee17bada90a1 P b3a9f1311eaf42879cbdb42881ec5bf5: Bootstrap complete.
I20240503 14:16:04.450073 29921 ts_tablet_manager.cc:1367] T 64bf07199c374bcfa7bbee17bada90a1 P b3a9f1311eaf42879cbdb42881ec5bf5: Time spent bootstrapping tablet: real 0.530s user 0.478s sys 0.053s
I20240503 14:16:04.454746 29921 raft_consensus.cc:348] T 64bf07199c374bcfa7bbee17bada90a1 P b3a9f1311eaf42879cbdb42881ec5bf5 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f2d731392064335a3f44b547ded659c" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 42987 } }
I20240503 14:16:04.455037 29921 raft_consensus.cc:729] T 64bf07199c374bcfa7bbee17bada90a1 P b3a9f1311eaf42879cbdb42881ec5bf5 [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: b3a9f1311eaf42879cbdb42881ec5bf5, State: Initialized, Role: NON_PARTICIPANT
I20240503 14:16:04.455524 29921 consensus_queue.cc:260] T 64bf07199c374bcfa7bbee17bada90a1 P b3a9f1311eaf42879cbdb42881ec5bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 210, Last appended: 2.210, Last appended by leader: 210, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f2d731392064335a3f44b547ded659c" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 42987 } }
I20240503 14:16:04.456997 29921 ts_tablet_manager.cc:1398] T 64bf07199c374bcfa7bbee17bada90a1 P b3a9f1311eaf42879cbdb42881ec5bf5: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20240503 14:16:04.457918 29884 tablet_copy_service.cc:342] P 3f2d731392064335a3f44b547ded659c: Request end of tablet copy session b3a9f1311eaf42879cbdb42881ec5bf5-64bf07199c374bcfa7bbee17bada90a1 received from {username='slave'} at 127.25.69.66:55553
I20240503 14:16:04.458091 29884 tablet_copy_service.cc:433] P 3f2d731392064335a3f44b547ded659c: ending tablet copy session b3a9f1311eaf42879cbdb42881ec5bf5-64bf07199c374bcfa7bbee17bada90a1 on tablet 64bf07199c374bcfa7bbee17bada90a1 with peer b3a9f1311eaf42879cbdb42881ec5bf5
I20240503 14:16:04.466082 25877 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu pid 29781
I20240503 14:16:04.467165 29904 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 14:16:04.569787 25877 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu with pid 29781
I20240503 14:16:04.588374 25877 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu pid 29644
I20240503 14:16:04.589485 29766 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 14:16:04.688630 25877 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu with pid 29644
I20240503 14:16:04.706951 25877 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu pid 29524
I20240503 14:16:04.708088 29586 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 14:16:04.809553 25877 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu with pid 29524
2024-05-03T14:16:04Z chronyd exiting
[ OK ] TabletCopyClientSessionITest.TestCopyFromCrashedSource (6097 ms)
[ RUN ] TabletCopyClientSessionITest.TestTabletCopyWithBusySource
2024-05-03T14:16:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-03T14:16:04Z Disabled control of system clock
I20240503 14:16:04.876016 25877 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
/tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.69.126:46605
--webserver_interface=127.25.69.126
--webserver_port=0
--builtin_ntp_servers=127.25.69.84:40469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.69.126:46605
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240503 14:16:05.196398 29940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 14:16:05.196679 29940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 14:16:05.196767 29940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 14:16:05.203945 29940 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240503 14:16:05.204046 29940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 14:16:05.204085 29940 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240503 14:16:05.204138 29940 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240503 14:16:05.212721 29940 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.69.84:40469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.25.69.126:46605
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.69.126:46605
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.69.126
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 13:43:24 UTC on efd1337a2aa3
build id 107
ASAN enabled
I20240503 14:16:05.213917 29940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 14:16:05.215571 29940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:16:05.226080 29945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:16:05.226562 29946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:16:05.227097 29948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:16:05.227677 29940 server_base.cc:1034] running on GCE node
I20240503 14:16:05.228327 29940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 14:16:05.229679 29940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 14:16:05.230906 29940 hybrid_clock.cc:648] HybridClock initialized: now 1714745765230851 us; error 31 us; skew 500 ppm
I20240503 14:16:05.231206 29940 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:16:05.233402 29940 webserver.cc:460] Webserver started at http://127.25.69.126:40873/ using document root <none> and password file <none>
I20240503 14:16:05.234086 29940 fs_manager.cc:359] Metadata directory not provided
I20240503 14:16:05.234234 29940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:16:05.234527 29940 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 14:16:05.236980 29940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/master-0/data/instance:
uuid: "da308cd0ccd040fb8b4c2aa9b6fd0da0"
format_stamp: "Formatted at 2024-05-03 14:16:05 on dist-test-slave-0c7n"
I20240503 14:16:05.237704 29940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/master-0/wal/instance:
uuid: "da308cd0ccd040fb8b4c2aa9b6fd0da0"
format_stamp: "Formatted at 2024-05-03 14:16:05 on dist-test-slave-0c7n"
I20240503 14:16:05.242784 29940 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20240503 14:16:05.245981 29954 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:16:05.247337 29940 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20240503 14:16:05.247488 29940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/master-0/data,/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/master-0/wal
uuid: "da308cd0ccd040fb8b4c2aa9b6fd0da0"
format_stamp: "Formatted at 2024-05-03 14:16:05 on dist-test-slave-0c7n"
I20240503 14:16:05.247656 29940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:16:05.267953 29940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:16:05.268803 29940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 14:16:05.269078 29940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:16:05.286401 29940 rpc_server.cc:307] RPC server started. Bound to: 127.25.69.126:46605
I20240503 14:16:05.286424 30005 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.69.126:46605 every 8 connection(s)
I20240503 14:16:05.287775 29940 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/master-0/data/info.pb
I20240503 14:16:05.291460 30006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:05.293877 25877 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu as pid 29940
I20240503 14:16:05.294082 25877 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/master-0/wal/instance
I20240503 14:16:05.301986 30006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0: Bootstrap starting.
I20240503 14:16:05.304991 30006 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0: Neither blocks nor log segments found. Creating new log.
I20240503 14:16:05.306339 30006 log.cc:824] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0: Log is configured to *not* fsync() on all Append() calls
I20240503 14:16:05.308987 30006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0: No bootstrap required, opened a new log
I20240503 14:16:05.314695 30006 raft_consensus.cc:348] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da308cd0ccd040fb8b4c2aa9b6fd0da0" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 46605 } }
I20240503 14:16:05.315014 30006 raft_consensus.cc:374] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:16:05.315088 30006 raft_consensus.cc:729] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da308cd0ccd040fb8b4c2aa9b6fd0da0, State: Initialized, Role: FOLLOWER
I20240503 14:16:05.315635 30006 consensus_queue.cc:260] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da308cd0ccd040fb8b4c2aa9b6fd0da0" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 46605 } }
I20240503 14:16:05.315853 30006 raft_consensus.cc:388] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:05.315994 30006 raft_consensus.cc:482] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:05.316183 30006 raft_consensus.cc:3037] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:16:05.318034 30006 raft_consensus.cc:504] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da308cd0ccd040fb8b4c2aa9b6fd0da0" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 46605 } }
I20240503 14:16:05.318410 30006 leader_election.cc:302] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: da308cd0ccd040fb8b4c2aa9b6fd0da0; no voters:
I20240503 14:16:05.318854 30006 leader_election.cc:288] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 14:16:05.319005 30011 raft_consensus.cc:2781] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:16:05.319557 30011 raft_consensus.cc:686] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0 [term 1 LEADER]: Becoming Leader. State: Replica: da308cd0ccd040fb8b4c2aa9b6fd0da0, State: Running, Role: LEADER
I20240503 14:16:05.320050 30011 consensus_queue.cc:237] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da308cd0ccd040fb8b4c2aa9b6fd0da0" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 46605 } }
I20240503 14:16:05.320585 30006 sys_catalog.cc:564] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0 [sys.catalog]: configured and running, proceeding with master startup.
I20240503 14:16:05.322947 30013 sys_catalog.cc:455] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader da308cd0ccd040fb8b4c2aa9b6fd0da0. Latest consensus state: current_term: 1 leader_uuid: "da308cd0ccd040fb8b4c2aa9b6fd0da0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da308cd0ccd040fb8b4c2aa9b6fd0da0" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 46605 } } }
I20240503 14:16:05.323278 30013 sys_catalog.cc:458] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0 [sys.catalog]: This master's current role is: LEADER
I20240503 14:16:05.322922 30012 sys_catalog.cc:455] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "da308cd0ccd040fb8b4c2aa9b6fd0da0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da308cd0ccd040fb8b4c2aa9b6fd0da0" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 46605 } } }
I20240503 14:16:05.323729 30012 sys_catalog.cc:458] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0 [sys.catalog]: This master's current role is: LEADER
I20240503 14:16:05.324683 30017 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240503 14:16:05.329540 30017 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240503 14:16:05.338014 30017 catalog_manager.cc:1347] Generated new cluster ID: dfa07272b4a746218091d182882b708d
I20240503 14:16:05.338114 30017 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240503 14:16:05.360833 30017 catalog_manager.cc:1370] Generated new certificate authority record
I20240503 14:16:05.362066 30017 catalog_manager.cc:1504] Loading token signing keys...
I20240503 14:16:05.374603 30017 catalog_manager.cc:5857] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0: Generated new TSK 0
I20240503 14:16:05.375710 30017 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240503 14:16:05.387462 25877 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
/tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.69.65:0
--local_ip_for_outbound_sockets=127.25.69.65
--webserver_interface=127.25.69.65
--webserver_port=0
--tserver_master_addrs=127.25.69.126:46605
--builtin_ntp_servers=127.25.69.84:40469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=20 with env {}
W20240503 14:16:05.707618 30030 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 14:16:05.707950 30030 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 14:16:05.708122 30030 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 14:16:05.715615 30030 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 14:16:05.715849 30030 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.69.65
I20240503 14:16:05.724834 30030 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.69.84:40469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.69.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.69.65
--webserver_port=0
--tserver_master_addrs=127.25.69.126:46605
--num_tablets_to_copy_simultaneously=20
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.69.65
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 13:43:24 UTC on efd1337a2aa3
build id 107
ASAN enabled
I20240503 14:16:05.726290 30030 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 14:16:05.728010 30030 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:16:05.739984 30035 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:16:05.740520 30038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:16:05.741241 30036 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:16:05.741904 30030 server_base.cc:1034] running on GCE node
I20240503 14:16:05.742527 30030 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 14:16:05.743508 30030 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 14:16:05.744760 30030 hybrid_clock.cc:648] HybridClock initialized: now 1714745765744694 us; error 38 us; skew 500 ppm
I20240503 14:16:05.745091 30030 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:16:05.747439 30030 webserver.cc:460] Webserver started at http://127.25.69.65:43021/ using document root <none> and password file <none>
I20240503 14:16:05.748128 30030 fs_manager.cc:359] Metadata directory not provided
I20240503 14:16:05.748246 30030 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:16:05.748507 30030 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 14:16:05.751080 30030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-0/data/instance:
uuid: "9923003d760c40969bbf265fceed3d7f"
format_stamp: "Formatted at 2024-05-03 14:16:05 on dist-test-slave-0c7n"
I20240503 14:16:05.751879 30030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-0/wal/instance:
uuid: "9923003d760c40969bbf265fceed3d7f"
format_stamp: "Formatted at 2024-05-03 14:16:05 on dist-test-slave-0c7n"
I20240503 14:16:05.757017 30030 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20240503 14:16:05.760411 30044 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:16:05.761780 30030 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240503 14:16:05.761938 30030 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-0/wal
uuid: "9923003d760c40969bbf265fceed3d7f"
format_stamp: "Formatted at 2024-05-03 14:16:05 on dist-test-slave-0c7n"
I20240503 14:16:05.762110 30030 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:16:05.819165 30030 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:16:05.820045 30030 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 14:16:05.820353 30030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:16:05.821465 30030 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 14:16:05.823107 30030 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 14:16:05.823184 30030 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 14:16:05.823325 30030 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 14:16:05.823380 30030 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 14:16:05.855223 30030 rpc_server.cc:307] RPC server started. Bound to: 127.25.69.65:40957
I20240503 14:16:05.855275 30156 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.69.65:40957 every 8 connection(s)
I20240503 14:16:05.856554 30030 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-0/data/info.pb
I20240503 14:16:05.857676 25877 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu as pid 30030
I20240503 14:16:05.857872 25877 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-0/wal/instance
I20240503 14:16:05.861614 25877 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
/tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.69.66:0
--local_ip_for_outbound_sockets=127.25.69.66
--webserver_interface=127.25.69.66
--webserver_port=0
--tserver_master_addrs=127.25.69.126:46605
--builtin_ntp_servers=127.25.69.84:40469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=20 with env {}
I20240503 14:16:05.870955 30157 heartbeater.cc:347] Connected to a master server at 127.25.69.126:46605
I20240503 14:16:05.871235 30157 heartbeater.cc:464] Registering TS with master...
I20240503 14:16:05.872031 30157 heartbeater.cc:511] Master 127.25.69.126:46605 requested a full tablet report, sending...
I20240503 14:16:05.873946 29971 ts_manager.cc:194] Registered new tserver with Master: 9923003d760c40969bbf265fceed3d7f (127.25.69.65:40957)
I20240503 14:16:05.875541 29971 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.69.65:42633
W20240503 14:16:06.183758 30161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 14:16:06.184047 30161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 14:16:06.184170 30161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 14:16:06.191552 30161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 14:16:06.191820 30161 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.69.66
I20240503 14:16:06.201001 30161 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.69.84:40469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.69.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.69.66
--webserver_port=0
--tserver_master_addrs=127.25.69.126:46605
--num_tablets_to_copy_simultaneously=20
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.69.66
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 13:43:24 UTC on efd1337a2aa3
build id 107
ASAN enabled
I20240503 14:16:06.202353 30161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 14:16:06.204031 30161 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:16:06.215898 30166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:16:06.216456 30167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:16:06.216914 30169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:16:06.217552 30161 server_base.cc:1034] running on GCE node
I20240503 14:16:06.218128 30161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 14:16:06.219053 30161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 14:16:06.220312 30161 hybrid_clock.cc:648] HybridClock initialized: now 1714745766220214 us; error 47 us; skew 500 ppm
I20240503 14:16:06.220635 30161 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:16:06.223106 30161 webserver.cc:460] Webserver started at http://127.25.69.66:35111/ using document root <none> and password file <none>
I20240503 14:16:06.223791 30161 fs_manager.cc:359] Metadata directory not provided
I20240503 14:16:06.223919 30161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:16:06.224220 30161 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 14:16:06.226821 30161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-1/data/instance:
uuid: "a84338b8d24e453faa8e3e7567a2214b"
format_stamp: "Formatted at 2024-05-03 14:16:06 on dist-test-slave-0c7n"
I20240503 14:16:06.227545 30161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-1/wal/instance:
uuid: "a84338b8d24e453faa8e3e7567a2214b"
format_stamp: "Formatted at 2024-05-03 14:16:06 on dist-test-slave-0c7n"
I20240503 14:16:06.232456 30161 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20240503 14:16:06.235819 30175 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:16:06.237138 30161 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20240503 14:16:06.237332 30161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-1/wal
uuid: "a84338b8d24e453faa8e3e7567a2214b"
format_stamp: "Formatted at 2024-05-03 14:16:06 on dist-test-slave-0c7n"
I20240503 14:16:06.237504 30161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:16:06.262878 30161 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:16:06.263710 30161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 14:16:06.263965 30161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:16:06.264921 30161 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 14:16:06.266660 30161 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 14:16:06.266746 30161 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 14:16:06.266847 30161 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 14:16:06.266897 30161 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 14:16:06.302881 30161 rpc_server.cc:307] RPC server started. Bound to: 127.25.69.66:37477
I20240503 14:16:06.302910 30287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.69.66:37477 every 8 connection(s)
I20240503 14:16:06.304148 30161 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-1/data/info.pb
I20240503 14:16:06.314148 25877 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu as pid 30161
I20240503 14:16:06.314347 25877 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-1/wal/instance
I20240503 14:16:06.315757 30288 heartbeater.cc:347] Connected to a master server at 127.25.69.126:46605
I20240503 14:16:06.316038 30288 heartbeater.cc:464] Registering TS with master...
I20240503 14:16:06.316882 30288 heartbeater.cc:511] Master 127.25.69.126:46605 requested a full tablet report, sending...
I20240503 14:16:06.318181 29971 ts_manager.cc:194] Registered new tserver with Master: a84338b8d24e453faa8e3e7567a2214b (127.25.69.66:37477)
I20240503 14:16:06.318890 29971 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.69.66:44141
I20240503 14:16:06.329447 25877 external_mini_cluster.cc:930] 2 TS(s) registered with all masters
I20240503 14:16:06.342924 25877 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu pid 30161
I20240503 14:16:06.350755 30283 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 14:16:06.431243 25877 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu with pid 30161
I20240503 14:16:06.446975 25877 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu pid 29940
I20240503 14:16:06.448174 30001 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 14:16:06.549831 25877 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu with pid 29940
I20240503 14:16:06.570144 25877 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
/tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.69.126:46605
--webserver_interface=127.25.69.126
--webserver_port=40873
--builtin_ntp_servers=127.25.69.84:40469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.69.126:46605
--master_tombstone_evicted_tablet_replicas=false with env {}
I20240503 14:16:06.878384 30157 heartbeater.cc:503] Master 127.25.69.126:46605 was elected leader, sending a full tablet report...
W20240503 14:16:06.880115 30157 heartbeater.cc:644] Failed to heartbeat to 127.25.69.126:46605 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.25.69.126:46605: connect: Connection refused (error 111)
W20240503 14:16:06.888267 30300 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 14:16:06.888594 30300 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 14:16:06.888731 30300 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 14:16:06.896080 30300 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240503 14:16:06.896191 30300 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 14:16:06.896286 30300 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240503 14:16:06.896382 30300 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240503 14:16:06.905407 30300 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.69.84:40469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.25.69.126:46605
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.69.126:46605
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.69.126
--webserver_port=40873
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 13:43:24 UTC on efd1337a2aa3
build id 107
ASAN enabled
I20240503 14:16:06.906724 30300 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 14:16:06.908535 30300 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:16:06.919166 30306 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:16:06.919633 30307 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:16:06.920307 30309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:16:06.920864 30300 server_base.cc:1034] running on GCE node
I20240503 14:16:06.921605 30300 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 14:16:06.922883 30300 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 14:16:06.924105 30300 hybrid_clock.cc:648] HybridClock initialized: now 1714745766924042 us; error 43 us; skew 500 ppm
I20240503 14:16:06.924415 30300 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:16:06.926561 30300 webserver.cc:460] Webserver started at http://127.25.69.126:40873/ using document root <none> and password file <none>
I20240503 14:16:06.927242 30300 fs_manager.cc:359] Metadata directory not provided
I20240503 14:16:06.927397 30300 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:16:06.932178 30300 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20240503 14:16:06.934931 30315 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:16:06.936182 30300 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20240503 14:16:06.936337 30300 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/master-0/data,/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/master-0/wal
uuid: "da308cd0ccd040fb8b4c2aa9b6fd0da0"
format_stamp: "Formatted at 2024-05-03 14:16:05 on dist-test-slave-0c7n"
I20240503 14:16:06.937103 30300 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:16:06.961104 30300 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:16:06.961967 30300 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 14:16:06.962234 30300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:16:06.979274 30300 rpc_server.cc:307] RPC server started. Bound to: 127.25.69.126:46605
I20240503 14:16:06.979319 30366 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.69.126:46605 every 8 connection(s)
I20240503 14:16:06.980691 30300 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/master-0/data/info.pb
I20240503 14:16:06.986842 30367 sys_catalog.cc:263] Verifying existing consensus state
I20240503 14:16:06.989023 25877 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu as pid 30300
I20240503 14:16:06.989661 30367 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0: Bootstrap starting.
I20240503 14:16:07.005573 30367 log.cc:824] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0: Log is configured to *not* fsync() on all Append() calls
I20240503 14:16:07.013077 30367 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:16:07.013648 30367 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0: Bootstrap complete.
I20240503 14:16:07.020597 30367 raft_consensus.cc:348] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da308cd0ccd040fb8b4c2aa9b6fd0da0" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 46605 } }
I20240503 14:16:07.021399 30367 raft_consensus.cc:729] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: da308cd0ccd040fb8b4c2aa9b6fd0da0, State: Initialized, Role: FOLLOWER
I20240503 14:16:07.022040 30367 consensus_queue.cc:260] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da308cd0ccd040fb8b4c2aa9b6fd0da0" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 46605 } }
I20240503 14:16:07.022264 30367 raft_consensus.cc:388] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:07.022368 30367 raft_consensus.cc:482] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:07.022519 30367 raft_consensus.cc:3037] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:16:07.025794 30367 raft_consensus.cc:504] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da308cd0ccd040fb8b4c2aa9b6fd0da0" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 46605 } }
I20240503 14:16:07.026306 30367 leader_election.cc:302] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: da308cd0ccd040fb8b4c2aa9b6fd0da0; no voters:
I20240503 14:16:07.027029 30367 leader_election.cc:288] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 14:16:07.027170 30372 raft_consensus.cc:2781] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:16:07.028299 30372 raft_consensus.cc:686] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0 [term 2 LEADER]: Becoming Leader. State: Replica: da308cd0ccd040fb8b4c2aa9b6fd0da0, State: Running, Role: LEADER
I20240503 14:16:07.028892 30372 consensus_queue.cc:237] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da308cd0ccd040fb8b4c2aa9b6fd0da0" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 46605 } }
I20240503 14:16:07.029465 30367 sys_catalog.cc:564] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0 [sys.catalog]: configured and running, proceeding with master startup.
I20240503 14:16:07.031217 30374 sys_catalog.cc:455] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader da308cd0ccd040fb8b4c2aa9b6fd0da0. Latest consensus state: current_term: 2 leader_uuid: "da308cd0ccd040fb8b4c2aa9b6fd0da0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da308cd0ccd040fb8b4c2aa9b6fd0da0" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 46605 } } }
I20240503 14:16:07.031311 30373 sys_catalog.cc:455] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "da308cd0ccd040fb8b4c2aa9b6fd0da0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da308cd0ccd040fb8b4c2aa9b6fd0da0" member_type: VOTER last_known_addr { host: "127.25.69.126" port: 46605 } } }
I20240503 14:16:07.032012 30373 sys_catalog.cc:458] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0 [sys.catalog]: This master's current role is: LEADER
I20240503 14:16:07.032152 30374 sys_catalog.cc:458] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0 [sys.catalog]: This master's current role is: LEADER
I20240503 14:16:07.037910 30380 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240503 14:16:07.044790 30380 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240503 14:16:07.046391 30380 catalog_manager.cc:1259] Loaded cluster ID: dfa07272b4a746218091d182882b708d
I20240503 14:16:07.046492 30380 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240503 14:16:07.050421 30380 catalog_manager.cc:1504] Loading token signing keys...
I20240503 14:16:07.051709 30380 catalog_manager.cc:5868] T 00000000000000000000000000000000 P da308cd0ccd040fb8b4c2aa9b6fd0da0: Loaded TSK: 0
I20240503 14:16:07.052912 30380 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240503 14:16:07.887233 30157 heartbeater.cc:347] Connected to a master server at 127.25.69.126:46605
I20240503 14:16:07.887435 30157 heartbeater.cc:503] Master 127.25.69.126:46605 was elected leader, sending a full tablet report...
I20240503 14:16:07.889523 30332 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "9923003d760c40969bbf265fceed3d7f" instance_seqno: 1714745765847574) as {username='slave'} at 127.25.69.65:35617; Asking this server to re-register.
I20240503 14:16:07.890192 30157 heartbeater.cc:464] Registering TS with master...
I20240503 14:16:07.890410 30157 heartbeater.cc:511] Master 127.25.69.126:46605 requested a full tablet report, sending...
I20240503 14:16:07.891583 30332 ts_manager.cc:194] Registered new tserver with Master: 9923003d760c40969bbf265fceed3d7f (127.25.69.65:40957)
I20240503 14:16:07.895967 25877 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20240503 14:16:07.896140 25877 test_util.cc:268] Using random seed: 1549804604
I20240503 14:16:07.915021 30332 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38632:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "<redacted>""\004\001\000fff\006\004\001\000\314\314\314\014\004\001\000233\023\004\001\000\230\231\231\031\004\001\000\376\377\377\037\004\001\000dff&\004\001\000\312\314\314,\004\001\0000333\004\001\000\226\231\2319\004\001\000\374\377\377?\004\001\000bffF\004\001\000\310\314\314L\004\001\000.33S\004\001\000\224\231\231Y\004\001\000\372\377\377_\004\001\000`fff\004\001\000\306\314\314l\004\001\000,33s\004\001\000\222\231\231y"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20240503 14:16:07.949393 30087 tablet_service.cc:1467] Processing CreateTablet for tablet 2bb95df8a92a4322ae312e90bd9d2bd9 (DEFAULT_TABLE table=test-workload [id=ba38be51e79e4addb8f1e3f5698e02bb]), partition=RANGE (key) PARTITION 536870910 <= VALUES < 644245092
I20240503 14:16:07.949095 30086 tablet_service.cc:1467] Processing CreateTablet for tablet 3233e361d51948b8afbf3aa9ec70cad1 (DEFAULT_TABLE table=test-workload [id=ba38be51e79e4addb8f1e3f5698e02bb]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 751619274
I20240503 14:16:07.948136 30089 tablet_service.cc:1467] Processing CreateTablet for tablet 132d1335591e4170b1030c93fba9a79f (DEFAULT_TABLE table=test-workload [id=ba38be51e79e4addb8f1e3f5698e02bb]), partition=RANGE (key) PARTITION 322122546 <= VALUES < 429496728
I20240503 14:16:07.949672 30081 tablet_service.cc:1467] Processing CreateTablet for tablet c4dba4295ef04b1faa3a453df4615413 (DEFAULT_TABLE table=test-workload [id=ba38be51e79e4addb8f1e3f5698e02bb]), partition=RANGE (key) PARTITION 1181116002 <= VALUES < 1288490184
I20240503 14:16:07.950871 30092 tablet_service.cc:1467] Processing CreateTablet for tablet c65ec6569c1541218bb6d7b5d3def67a (DEFAULT_TABLE table=test-workload [id=ba38be51e79e4addb8f1e3f5698e02bb]), partition=RANGE (key) PARTITION VALUES < 107374182
I20240503 14:16:07.951110 30075 tablet_service.cc:1467] Processing CreateTablet for tablet 7916cb46d6864e47a4b7ac2db4ac847c (DEFAULT_TABLE table=test-workload [id=ba38be51e79e4addb8f1e3f5698e02bb]), partition=RANGE (key) PARTITION 1825361094 <= VALUES < 1932735276
I20240503 14:16:07.949672 30090 tablet_service.cc:1467] Processing CreateTablet for tablet ac007594566a4b60b0c496e31c78c623 (DEFAULT_TABLE table=test-workload [id=ba38be51e79e4addb8f1e3f5698e02bb]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 322122546
I20240503 14:16:07.949051 30084 tablet_service.cc:1467] Processing CreateTablet for tablet 82359eb6be094060bdcab46c04d27fc6 (DEFAULT_TABLE table=test-workload [id=ba38be51e79e4addb8f1e3f5698e02bb]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 966367638
I20240503 14:16:07.952642 30089 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 132d1335591e4170b1030c93fba9a79f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:07.951773 30085 tablet_service.cc:1467] Processing CreateTablet for tablet 9b85b747e67f4aa0bb0421ea5c8182b7 (DEFAULT_TABLE table=test-workload [id=ba38be51e79e4addb8f1e3f5698e02bb]), partition=RANGE (key) PARTITION 751619274 <= VALUES < 858993456
I20240503 14:16:07.952581 30083 tablet_service.cc:1467] Processing CreateTablet for tablet 8b77fcd79c314d7783cbd9950f793f9e (DEFAULT_TABLE table=test-workload [id=ba38be51e79e4addb8f1e3f5698e02bb]), partition=RANGE (key) PARTITION 966367638 <= VALUES < 1073741820
I20240503 14:16:07.953287 30087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bb95df8a92a4322ae312e90bd9d2bd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:07.953258 30078 tablet_service.cc:1467] Processing CreateTablet for tablet 9dac678dce1f463fbdcd3f0802522e88 (DEFAULT_TABLE table=test-workload [id=ba38be51e79e4addb8f1e3f5698e02bb]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1610612730
I20240503 14:16:07.952836 30079 tablet_service.cc:1467] Processing CreateTablet for tablet 859f3c3c03b4471d9b8cf7515b4e42ca (DEFAULT_TABLE table=test-workload [id=ba38be51e79e4addb8f1e3f5698e02bb]), partition=RANGE (key) PARTITION 1395864366 <= VALUES < 1503238548
I20240503 14:16:07.952610 30080 tablet_service.cc:1467] Processing CreateTablet for tablet 6426b3d51deb401d9c1641609bc8abe6 (DEFAULT_TABLE table=test-workload [id=ba38be51e79e4addb8f1e3f5698e02bb]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1395864366
I20240503 14:16:07.953891 30088 tablet_service.cc:1467] Processing CreateTablet for tablet defc186d26e44d2e90c230792d147414 (DEFAULT_TABLE table=test-workload [id=ba38be51e79e4addb8f1e3f5698e02bb]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 536870910
I20240503 14:16:07.954536 30076 tablet_service.cc:1467] Processing CreateTablet for tablet be28321e9c1e4f1c964e3c3e115c88c3 (DEFAULT_TABLE table=test-workload [id=ba38be51e79e4addb8f1e3f5698e02bb]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1825361094
I20240503 14:16:07.953948 30091 tablet_service.cc:1467] Processing CreateTablet for tablet aabea09945a4430bb29f4faa49c2375b (DEFAULT_TABLE table=test-workload [id=ba38be51e79e4addb8f1e3f5698e02bb]), partition=RANGE (key) PARTITION 107374182 <= VALUES < 214748364
I20240503 14:16:07.955636 30082 tablet_service.cc:1467] Processing CreateTablet for tablet 63af60166b2c48d187f28a9fa6b2de77 (DEFAULT_TABLE table=test-workload [id=ba38be51e79e4addb8f1e3f5698e02bb]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1181116002
I20240503 14:16:07.955751 30077 tablet_service.cc:1467] Processing CreateTablet for tablet 1b11f4b5593548918661202d9f11b821 (DEFAULT_TABLE table=test-workload [id=ba38be51e79e4addb8f1e3f5698e02bb]), partition=RANGE (key) PARTITION 1610612730 <= VALUES < 1717986912
I20240503 14:16:07.954608 30073 tablet_service.cc:1467] Processing CreateTablet for tablet ae7995ab6cab4473936176bd918cd089 (DEFAULT_TABLE table=test-workload [id=ba38be51e79e4addb8f1e3f5698e02bb]), partition=RANGE (key) PARTITION 2040109458 <= VALUES
I20240503 14:16:07.955009 30074 tablet_service.cc:1467] Processing CreateTablet for tablet 246be68db54741e1b119082f95aa1596 (DEFAULT_TABLE table=test-workload [id=ba38be51e79e4addb8f1e3f5698e02bb]), partition=RANGE (key) PARTITION 1932735276 <= VALUES < 2040109458
I20240503 14:16:07.954973 30086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3233e361d51948b8afbf3aa9ec70cad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:07.956912 30088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet defc186d26e44d2e90c230792d147414. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:07.957162 30081 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4dba4295ef04b1faa3a453df4615413. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:07.958001 30082 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63af60166b2c48d187f28a9fa6b2de77. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:07.958281 30077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b11f4b5593548918661202d9f11b821. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:07.958540 30083 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b77fcd79c314d7783cbd9950f793f9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:07.958781 30074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 246be68db54741e1b119082f95aa1596. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:07.959030 30079 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 859f3c3c03b4471d9b8cf7515b4e42ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:07.959231 30073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae7995ab6cab4473936176bd918cd089. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:07.959928 30085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b85b747e67f4aa0bb0421ea5c8182b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:07.960623 30091 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aabea09945a4430bb29f4faa49c2375b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:07.966208 30078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9dac678dce1f463fbdcd3f0802522e88. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:07.968322 30080 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6426b3d51deb401d9c1641609bc8abe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:07.970340 30092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c65ec6569c1541218bb6d7b5d3def67a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:07.971355 30075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7916cb46d6864e47a4b7ac2db4ac847c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:07.972358 30090 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac007594566a4b60b0c496e31c78c623. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:07.974649 30084 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82359eb6be094060bdcab46c04d27fc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:07.974844 30076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be28321e9c1e4f1c964e3c3e115c88c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:08.008167 30402 tablet_bootstrap.cc:492] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:08.014667 30402 tablet_bootstrap.cc:654] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f: Neither blocks nor log segments found. Creating new log.
I20240503 14:16:08.022797 30402 log.cc:824] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f: Log is configured to *not* fsync() on all Append() calls
I20240503 14:16:08.025061 30402 tablet_bootstrap.cc:492] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f: No bootstrap required, opened a new log
I20240503 14:16:08.025334 30402 ts_tablet_manager.cc:1367] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.003s
I20240503 14:16:08.030902 30402 raft_consensus.cc:348] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.031177 30402 raft_consensus.cc:374] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:16:08.031266 30402 raft_consensus.cc:729] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:08.031778 30402 consensus_queue.cc:260] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.031939 30402 raft_consensus.cc:388] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:08.032065 30402 raft_consensus.cc:482] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:08.032199 30402 raft_consensus.cc:3037] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:16:08.033911 30402 raft_consensus.cc:504] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.034349 30402 leader_election.cc:302] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:08.034885 30402 leader_election.cc:288] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 14:16:08.035079 30404 raft_consensus.cc:2781] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:16:08.035686 30404 raft_consensus.cc:686] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f [term 1 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:08.036473 30402 ts_tablet_manager.cc:1398] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20240503 14:16:08.036548 30404 consensus_queue.cc:237] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.036808 30402 tablet_bootstrap.cc:492] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:08.038168 30402 tablet_bootstrap.cc:654] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f: Neither blocks nor log segments found. Creating new log.
I20240503 14:16:08.040191 30402 tablet_bootstrap.cc:492] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f: No bootstrap required, opened a new log
I20240503 14:16:08.040333 30402 ts_tablet_manager.cc:1367] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240503 14:16:08.041147 30402 raft_consensus.cc:348] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.041365 30402 raft_consensus.cc:374] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:16:08.041464 30402 raft_consensus.cc:729] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:08.041687 30402 consensus_queue.cc:260] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.041864 30402 raft_consensus.cc:388] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:08.041949 30402 raft_consensus.cc:482] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:08.042048 30402 raft_consensus.cc:3037] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:16:08.042574 30332 catalog_manager.cc:5484] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9923003d760c40969bbf265fceed3d7f (127.25.69.65). New cstate: current_term: 1 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:08.044227 30402 raft_consensus.cc:504] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.044420 30402 leader_election.cc:302] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:08.044596 30402 leader_election.cc:288] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 14:16:08.044664 30404 raft_consensus.cc:2781] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:16:08.044896 30404 raft_consensus.cc:686] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f [term 1 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:08.045075 30402 ts_tablet_manager.cc:1398] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.005s user 0.001s sys 0.004s
I20240503 14:16:08.045147 30404 consensus_queue.cc:237] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.045414 30402 tablet_bootstrap.cc:492] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:08.047077 30402 tablet_bootstrap.cc:654] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f: Neither blocks nor log segments found. Creating new log.
I20240503 14:16:08.048475 30332 catalog_manager.cc:5484] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9923003d760c40969bbf265fceed3d7f (127.25.69.65). New cstate: current_term: 1 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:08.048671 30402 tablet_bootstrap.cc:492] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f: No bootstrap required, opened a new log
I20240503 14:16:08.048794 30402 ts_tablet_manager.cc:1367] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20240503 14:16:08.049377 30402 raft_consensus.cc:348] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.049495 30402 raft_consensus.cc:374] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:16:08.049553 30402 raft_consensus.cc:729] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:08.049736 30402 consensus_queue.cc:260] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.049893 30402 raft_consensus.cc:388] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:08.050004 30402 raft_consensus.cc:482] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:08.050129 30402 raft_consensus.cc:3037] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:16:08.051939 30402 raft_consensus.cc:504] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.052145 30402 leader_election.cc:302] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:08.052316 30402 leader_election.cc:288] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 14:16:08.052351 30404 raft_consensus.cc:2781] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:16:08.052496 30404 raft_consensus.cc:686] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f [term 1 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:08.052721 30404 consensus_queue.cc:237] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.052836 30402 ts_tablet_manager.cc:1398] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 14:16:08.053072 30402 tablet_bootstrap.cc:492] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:08.054702 30331 catalog_manager.cc:5484] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9923003d760c40969bbf265fceed3d7f (127.25.69.65). New cstate: current_term: 1 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:08.054942 30402 tablet_bootstrap.cc:654] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f: Neither blocks nor log segments found. Creating new log.
I20240503 14:16:08.056443 30402 tablet_bootstrap.cc:492] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f: No bootstrap required, opened a new log
I20240503 14:16:08.056565 30402 ts_tablet_manager.cc:1367] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240503 14:16:08.057171 30402 raft_consensus.cc:348] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.057368 30402 raft_consensus.cc:374] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:16:08.057474 30402 raft_consensus.cc:729] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:08.057682 30402 consensus_queue.cc:260] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.057818 30402 raft_consensus.cc:388] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:08.057897 30402 raft_consensus.cc:482] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:08.058007 30402 raft_consensus.cc:3037] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:16:08.059760 30402 raft_consensus.cc:504] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.059947 30402 leader_election.cc:302] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:08.060071 30402 leader_election.cc:288] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 14:16:08.060163 30404 raft_consensus.cc:2781] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:16:08.060302 30404 raft_consensus.cc:686] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f [term 1 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:08.060503 30402 ts_tablet_manager.cc:1398] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20240503 14:16:08.060529 30404 consensus_queue.cc:237] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.060737 30402 tablet_bootstrap.cc:492] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:08.062312 30402 tablet_bootstrap.cc:654] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f: Neither blocks nor log segments found. Creating new log.
I20240503 14:16:08.062669 30331 catalog_manager.cc:5484] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9923003d760c40969bbf265fceed3d7f (127.25.69.65). New cstate: current_term: 1 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:08.063912 30402 tablet_bootstrap.cc:492] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f: No bootstrap required, opened a new log
I20240503 14:16:08.064065 30402 ts_tablet_manager.cc:1367] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240503 14:16:08.064750 30402 raft_consensus.cc:348] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.064937 30402 raft_consensus.cc:374] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:16:08.065012 30402 raft_consensus.cc:729] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:08.065304 30402 consensus_queue.cc:260] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.065444 30402 raft_consensus.cc:388] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:08.065552 30402 raft_consensus.cc:482] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:08.065660 30402 raft_consensus.cc:3037] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:16:08.067559 30402 raft_consensus.cc:504] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.067741 30402 leader_election.cc:302] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:08.067919 30402 leader_election.cc:288] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 14:16:08.067961 30404 raft_consensus.cc:2781] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:16:08.068168 30404 raft_consensus.cc:686] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f [term 1 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:08.068339 30402 ts_tablet_manager.cc:1398] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240503 14:16:08.068408 30404 consensus_queue.cc:237] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.068593 30402 tablet_bootstrap.cc:492] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:08.070144 30402 tablet_bootstrap.cc:654] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f: Neither blocks nor log segments found. Creating new log.
I20240503 14:16:08.070355 30331 catalog_manager.cc:5484] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9923003d760c40969bbf265fceed3d7f (127.25.69.65). New cstate: current_term: 1 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:08.071638 30402 tablet_bootstrap.cc:492] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f: No bootstrap required, opened a new log
I20240503 14:16:08.071738 30402 ts_tablet_manager.cc:1367] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240503 14:16:08.072350 30402 raft_consensus.cc:348] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.072468 30402 raft_consensus.cc:374] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:16:08.072544 30402 raft_consensus.cc:729] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:08.072731 30402 consensus_queue.cc:260] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.072870 30402 raft_consensus.cc:388] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:08.072948 30402 raft_consensus.cc:482] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:08.073055 30402 raft_consensus.cc:3037] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:16:08.075063 30402 raft_consensus.cc:504] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.075320 30402 leader_election.cc:302] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:08.075479 30402 leader_election.cc:288] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 14:16:08.075532 30404 raft_consensus.cc:2781] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:16:08.075768 30404 raft_consensus.cc:686] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f [term 1 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:08.075973 30402 ts_tablet_manager.cc:1398] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20240503 14:16:08.076020 30404 consensus_queue.cc:237] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.076205 30402 tablet_bootstrap.cc:492] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:08.077679 30402 tablet_bootstrap.cc:654] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f: Neither blocks nor log segments found. Creating new log.
I20240503 14:16:08.077944 30331 catalog_manager.cc:5484] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9923003d760c40969bbf265fceed3d7f (127.25.69.65). New cstate: current_term: 1 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:08.079157 30402 tablet_bootstrap.cc:492] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f: No bootstrap required, opened a new log
I20240503 14:16:08.079299 30402 ts_tablet_manager.cc:1367] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240503 14:16:08.079859 30402 raft_consensus.cc:348] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.080051 30402 raft_consensus.cc:374] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:16:08.080142 30402 raft_consensus.cc:729] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:08.080353 30402 consensus_queue.cc:260] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.080489 30402 raft_consensus.cc:388] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:08.080580 30402 raft_consensus.cc:482] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:08.080672 30402 raft_consensus.cc:3037] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:16:08.082733 30402 raft_consensus.cc:504] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.082914 30402 leader_election.cc:302] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:08.083103 30402 leader_election.cc:288] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 14:16:08.083139 30404 raft_consensus.cc:2781] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:16:08.083262 30404 raft_consensus.cc:686] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f [term 1 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:08.083472 30404 consensus_queue.cc:237] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.083562 30402 ts_tablet_manager.cc:1398] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.004s user 0.001s sys 0.004s
I20240503 14:16:08.083804 30402 tablet_bootstrap.cc:492] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:08.085829 30402 tablet_bootstrap.cc:654] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f: Neither blocks nor log segments found. Creating new log.
I20240503 14:16:08.087924 30402 tablet_bootstrap.cc:492] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f: No bootstrap required, opened a new log
I20240503 14:16:08.088078 30402 ts_tablet_manager.cc:1367] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240503 14:16:08.088688 30402 raft_consensus.cc:348] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.088810 30402 raft_consensus.cc:374] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:16:08.088903 30402 raft_consensus.cc:729] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:08.089136 30402 consensus_queue.cc:260] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.089351 30402 raft_consensus.cc:388] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:08.089428 30402 raft_consensus.cc:482] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:08.089522 30402 raft_consensus.cc:3037] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:16:08.089713 30331 catalog_manager.cc:5484] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9923003d760c40969bbf265fceed3d7f (127.25.69.65). New cstate: current_term: 1 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:08.091343 30402 raft_consensus.cc:504] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.091559 30402 leader_election.cc:302] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:08.091754 30402 leader_election.cc:288] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 14:16:08.091885 30404 raft_consensus.cc:2781] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:16:08.092074 30404 raft_consensus.cc:686] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f [term 1 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:08.092139 30402 ts_tablet_manager.cc:1398] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240503 14:16:08.092379 30402 tablet_bootstrap.cc:492] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:08.092284 30404 consensus_queue.cc:237] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.093883 30402 tablet_bootstrap.cc:654] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f: Neither blocks nor log segments found. Creating new log.
I20240503 14:16:08.094259 30331 catalog_manager.cc:5484] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9923003d760c40969bbf265fceed3d7f (127.25.69.65). New cstate: current_term: 1 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:08.095536 30402 tablet_bootstrap.cc:492] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f: No bootstrap required, opened a new log
I20240503 14:16:08.095659 30402 ts_tablet_manager.cc:1367] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240503 14:16:08.096273 30402 raft_consensus.cc:348] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.096496 30402 raft_consensus.cc:374] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:16:08.096593 30402 raft_consensus.cc:729] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:08.096843 30402 consensus_queue.cc:260] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.097018 30402 raft_consensus.cc:388] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:08.097128 30402 raft_consensus.cc:482] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:08.097234 30402 raft_consensus.cc:3037] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:16:08.098825 30402 raft_consensus.cc:504] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.098996 30402 leader_election.cc:302] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:08.099154 30402 leader_election.cc:288] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 14:16:08.099222 30404 raft_consensus.cc:2781] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:16:08.099372 30404 raft_consensus.cc:686] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f [term 1 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:08.099524 30402 ts_tablet_manager.cc:1398] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240503 14:16:08.099586 30404 consensus_queue.cc:237] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.099764 30402 tablet_bootstrap.cc:492] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:08.101323 30402 tablet_bootstrap.cc:654] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f: Neither blocks nor log segments found. Creating new log.
I20240503 14:16:08.101687 30331 catalog_manager.cc:5484] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9923003d760c40969bbf265fceed3d7f (127.25.69.65). New cstate: current_term: 1 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:08.102905 30402 tablet_bootstrap.cc:492] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f: No bootstrap required, opened a new log
I20240503 14:16:08.103034 30402 ts_tablet_manager.cc:1367] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240503 14:16:08.103576 30402 raft_consensus.cc:348] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.103724 30402 raft_consensus.cc:374] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:16:08.103816 30402 raft_consensus.cc:729] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:08.104005 30402 consensus_queue.cc:260] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.104127 30402 raft_consensus.cc:388] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:08.104197 30402 raft_consensus.cc:482] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:08.104296 30402 raft_consensus.cc:3037] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:16:08.106299 30402 raft_consensus.cc:504] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.106519 30402 leader_election.cc:302] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:08.106648 30402 leader_election.cc:288] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 14:16:08.106729 30404 raft_consensus.cc:2781] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:16:08.106894 30404 raft_consensus.cc:686] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f [term 1 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:08.107056 30402 ts_tablet_manager.cc:1398] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20240503 14:16:08.107088 30404 consensus_queue.cc:237] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.107299 30402 tablet_bootstrap.cc:492] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:08.108616 30402 tablet_bootstrap.cc:654] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f: Neither blocks nor log segments found. Creating new log.
I20240503 14:16:08.108963 30331 catalog_manager.cc:5484] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9923003d760c40969bbf265fceed3d7f (127.25.69.65). New cstate: current_term: 1 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:08.110216 30402 tablet_bootstrap.cc:492] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f: No bootstrap required, opened a new log
I20240503 14:16:08.110359 30402 ts_tablet_manager.cc:1367] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240503 14:16:08.111037 30402 raft_consensus.cc:348] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.111199 30402 raft_consensus.cc:374] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:16:08.111284 30402 raft_consensus.cc:729] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:08.111522 30402 consensus_queue.cc:260] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.111690 30402 raft_consensus.cc:388] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:08.111799 30402 raft_consensus.cc:482] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:08.111891 30402 raft_consensus.cc:3037] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:16:08.113797 30402 raft_consensus.cc:504] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.113970 30402 leader_election.cc:302] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:08.114101 30402 leader_election.cc:288] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 14:16:08.114176 30404 raft_consensus.cc:2781] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:16:08.114343 30404 raft_consensus.cc:686] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f [term 1 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:08.114519 30402 ts_tablet_manager.cc:1398] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20240503 14:16:08.114562 30404 consensus_queue.cc:237] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.114789 30402 tablet_bootstrap.cc:492] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:08.116202 30402 tablet_bootstrap.cc:654] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f: Neither blocks nor log segments found. Creating new log.
I20240503 14:16:08.116776 30331 catalog_manager.cc:5484] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9923003d760c40969bbf265fceed3d7f (127.25.69.65). New cstate: current_term: 1 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:08.117641 30402 tablet_bootstrap.cc:492] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f: No bootstrap required, opened a new log
I20240503 14:16:08.117748 30402 ts_tablet_manager.cc:1367] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20240503 14:16:08.118166 30402 raft_consensus.cc:348] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.118271 30402 raft_consensus.cc:374] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:16:08.118321 30402 raft_consensus.cc:729] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:08.118505 30402 consensus_queue.cc:260] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.118677 30402 raft_consensus.cc:388] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:08.118755 30402 raft_consensus.cc:482] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:08.118871 30402 raft_consensus.cc:3037] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:16:08.120807 30402 raft_consensus.cc:504] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.121096 30402 leader_election.cc:302] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:08.121457 30402 leader_election.cc:288] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 14:16:08.121728 30405 raft_consensus.cc:2781] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:16:08.121930 30402 ts_tablet_manager.cc:1398] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 14:16:08.121897 30405 raft_consensus.cc:686] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f [term 1 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:08.122188 30402 tablet_bootstrap.cc:492] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:08.122189 30405 consensus_queue.cc:237] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.123984 30402 tablet_bootstrap.cc:654] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f: Neither blocks nor log segments found. Creating new log.
I20240503 14:16:08.124886 30331 catalog_manager.cc:5484] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9923003d760c40969bbf265fceed3d7f (127.25.69.65). New cstate: current_term: 1 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:08.125638 30402 tablet_bootstrap.cc:492] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f: No bootstrap required, opened a new log
I20240503 14:16:08.125789 30402 ts_tablet_manager.cc:1367] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20240503 14:16:08.126463 30402 raft_consensus.cc:348] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.126616 30402 raft_consensus.cc:374] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:16:08.126691 30402 raft_consensus.cc:729] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:08.126931 30402 consensus_queue.cc:260] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.127101 30402 raft_consensus.cc:388] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:08.127195 30402 raft_consensus.cc:482] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:08.127300 30402 raft_consensus.cc:3037] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:16:08.129140 30402 raft_consensus.cc:504] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.129381 30402 leader_election.cc:302] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:08.129547 30402 leader_election.cc:288] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 14:16:08.129575 30405 raft_consensus.cc:2781] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:16:08.129810 30405 raft_consensus.cc:686] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f [term 1 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:08.130012 30402 ts_tablet_manager.cc:1398] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 14:16:08.130051 30405 consensus_queue.cc:237] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.130241 30402 tablet_bootstrap.cc:492] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:08.131669 30402 tablet_bootstrap.cc:654] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f: Neither blocks nor log segments found. Creating new log.
I20240503 14:16:08.131994 30331 catalog_manager.cc:5484] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9923003d760c40969bbf265fceed3d7f (127.25.69.65). New cstate: current_term: 1 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:08.133407 30402 tablet_bootstrap.cc:492] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f: No bootstrap required, opened a new log
I20240503 14:16:08.133520 30402 ts_tablet_manager.cc:1367] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240503 14:16:08.134002 30402 raft_consensus.cc:348] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.134121 30402 raft_consensus.cc:374] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:16:08.134214 30402 raft_consensus.cc:729] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:08.134443 30402 consensus_queue.cc:260] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.134598 30402 raft_consensus.cc:388] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:08.134683 30402 raft_consensus.cc:482] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:08.134788 30402 raft_consensus.cc:3037] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:16:08.136759 30402 raft_consensus.cc:504] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.136947 30402 leader_election.cc:302] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:08.137094 30402 leader_election.cc:288] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 14:16:08.137164 30405 raft_consensus.cc:2781] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:16:08.137295 30405 raft_consensus.cc:686] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f [term 1 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:08.137559 30402 ts_tablet_manager.cc:1398] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 14:16:08.137506 30405 consensus_queue.cc:237] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.137807 30402 tablet_bootstrap.cc:492] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:08.139106 30402 tablet_bootstrap.cc:654] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f: Neither blocks nor log segments found. Creating new log.
I20240503 14:16:08.139683 30331 catalog_manager.cc:5484] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9923003d760c40969bbf265fceed3d7f (127.25.69.65). New cstate: current_term: 1 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:08.140825 30402 tablet_bootstrap.cc:492] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f: No bootstrap required, opened a new log
I20240503 14:16:08.141041 30402 ts_tablet_manager.cc:1367] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20240503 14:16:08.141728 30402 raft_consensus.cc:348] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.141922 30402 raft_consensus.cc:374] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:16:08.142019 30402 raft_consensus.cc:729] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:08.142257 30402 consensus_queue.cc:260] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.142408 30402 raft_consensus.cc:388] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:08.142496 30402 raft_consensus.cc:482] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:08.142575 30402 raft_consensus.cc:3037] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:16:08.144548 30402 raft_consensus.cc:504] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.144704 30402 leader_election.cc:302] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:08.144886 30402 leader_election.cc:288] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 14:16:08.144918 30405 raft_consensus.cc:2781] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:16:08.145095 30405 raft_consensus.cc:686] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f [term 1 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:08.145457 30402 ts_tablet_manager.cc:1398] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20240503 14:16:08.145391 30405 consensus_queue.cc:237] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.145704 30402 tablet_bootstrap.cc:492] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:08.147250 30402 tablet_bootstrap.cc:654] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f: Neither blocks nor log segments found. Creating new log.
I20240503 14:16:08.147675 30331 catalog_manager.cc:5484] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9923003d760c40969bbf265fceed3d7f (127.25.69.65). New cstate: current_term: 1 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:08.148691 30402 tablet_bootstrap.cc:492] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f: No bootstrap required, opened a new log
I20240503 14:16:08.148816 30402 ts_tablet_manager.cc:1367] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20240503 14:16:08.149456 30402 raft_consensus.cc:348] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.149601 30402 raft_consensus.cc:374] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:16:08.149691 30402 raft_consensus.cc:729] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:08.149895 30402 consensus_queue.cc:260] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.150070 30402 raft_consensus.cc:388] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:08.150169 30402 raft_consensus.cc:482] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:08.150249 30402 raft_consensus.cc:3037] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:16:08.152400 30402 raft_consensus.cc:504] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.152554 30402 leader_election.cc:302] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:08.152665 30402 leader_election.cc:288] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 14:16:08.152753 30405 raft_consensus.cc:2781] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:16:08.153043 30402 ts_tablet_manager.cc:1398] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20240503 14:16:08.153076 30405 raft_consensus.cc:686] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f [term 1 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:08.153301 30402 tablet_bootstrap.cc:492] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:08.153321 30405 consensus_queue.cc:237] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.155342 30331 catalog_manager.cc:5484] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9923003d760c40969bbf265fceed3d7f (127.25.69.65). New cstate: current_term: 1 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:08.177363 30402 tablet_bootstrap.cc:654] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f: Neither blocks nor log segments found. Creating new log.
I20240503 14:16:08.179075 30402 tablet_bootstrap.cc:492] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f: No bootstrap required, opened a new log
I20240503 14:16:08.179219 30402 ts_tablet_manager.cc:1367] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.000s
I20240503 14:16:08.179837 30402 raft_consensus.cc:348] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.180009 30402 raft_consensus.cc:374] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:16:08.180054 30402 raft_consensus.cc:729] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:08.180279 30402 consensus_queue.cc:260] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.180418 30402 raft_consensus.cc:388] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:08.180487 30402 raft_consensus.cc:482] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:08.180554 30402 raft_consensus.cc:3037] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:16:08.182400 30402 raft_consensus.cc:504] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.182587 30402 leader_election.cc:302] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:08.182735 30402 leader_election.cc:288] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 14:16:08.182857 30405 raft_consensus.cc:2781] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:16:08.182996 30405 raft_consensus.cc:686] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f [term 1 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:08.183172 30402 ts_tablet_manager.cc:1398] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20240503 14:16:08.183380 30405 consensus_queue.cc:237] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.183598 30402 tablet_bootstrap.cc:492] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:08.185395 30402 tablet_bootstrap.cc:654] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f: Neither blocks nor log segments found. Creating new log.
I20240503 14:16:08.186205 30331 catalog_manager.cc:5484] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9923003d760c40969bbf265fceed3d7f (127.25.69.65). New cstate: current_term: 1 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:08.186935 30402 tablet_bootstrap.cc:492] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f: No bootstrap required, opened a new log
I20240503 14:16:08.187057 30402 ts_tablet_manager.cc:1367] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20240503 14:16:08.187553 30402 raft_consensus.cc:348] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.187685 30402 raft_consensus.cc:374] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:16:08.187772 30402 raft_consensus.cc:729] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:08.187970 30402 consensus_queue.cc:260] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.188148 30402 raft_consensus.cc:388] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:08.188220 30402 raft_consensus.cc:482] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:08.188346 30402 raft_consensus.cc:3037] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:16:08.190249 30402 raft_consensus.cc:504] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.190459 30402 leader_election.cc:302] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:08.190639 30402 leader_election.cc:288] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 14:16:08.190729 30405 raft_consensus.cc:2781] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:16:08.190862 30405 raft_consensus.cc:686] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f [term 1 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:08.191104 30402 ts_tablet_manager.cc:1398] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.004s user 0.003s sys 0.001s
I20240503 14:16:08.191123 30405 consensus_queue.cc:237] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.191413 30402 tablet_bootstrap.cc:492] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:08.192615 30402 tablet_bootstrap.cc:654] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f: Neither blocks nor log segments found. Creating new log.
I20240503 14:16:08.193780 30331 catalog_manager.cc:5484] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9923003d760c40969bbf265fceed3d7f (127.25.69.65). New cstate: current_term: 1 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:08.194450 30402 tablet_bootstrap.cc:492] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f: No bootstrap required, opened a new log
I20240503 14:16:08.194600 30402 ts_tablet_manager.cc:1367] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240503 14:16:08.195283 30402 raft_consensus.cc:348] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.195420 30402 raft_consensus.cc:374] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:16:08.195490 30402 raft_consensus.cc:729] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:08.195729 30402 consensus_queue.cc:260] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.195909 30402 raft_consensus.cc:388] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:08.196012 30402 raft_consensus.cc:482] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:08.196103 30402 raft_consensus.cc:3037] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:16:08.198091 30402 raft_consensus.cc:504] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.198271 30402 leader_election.cc:302] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:08.198422 30402 leader_election.cc:288] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 14:16:08.198509 30405 raft_consensus.cc:2781] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:16:08.198684 30405 raft_consensus.cc:686] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f [term 1 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:08.198931 30405 consensus_queue.cc:237] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.199230 30402 ts_tablet_manager.cc:1398] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20240503 14:16:08.199556 30402 tablet_bootstrap.cc:492] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:08.201304 30402 tablet_bootstrap.cc:654] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f: Neither blocks nor log segments found. Creating new log.
I20240503 14:16:08.202201 30331 catalog_manager.cc:5484] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9923003d760c40969bbf265fceed3d7f (127.25.69.65). New cstate: current_term: 1 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:08.203091 30402 tablet_bootstrap.cc:492] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f: No bootstrap required, opened a new log
I20240503 14:16:08.203199 30402 ts_tablet_manager.cc:1367] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.002s
I20240503 14:16:08.203742 30402 raft_consensus.cc:348] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.203895 30402 raft_consensus.cc:374] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:16:08.203995 30402 raft_consensus.cc:729] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:08.204188 30402 consensus_queue.cc:260] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.204365 30402 raft_consensus.cc:388] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:08.204439 30402 raft_consensus.cc:482] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:08.204540 30402 raft_consensus.cc:3037] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:16:08.207077 30402 raft_consensus.cc:504] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.207496 30402 leader_election.cc:302] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:08.207684 30402 leader_election.cc:288] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 14:16:08.207775 30405 raft_consensus.cc:2781] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:16:08.208011 30405 raft_consensus.cc:686] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f [term 1 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:08.208268 30402 ts_tablet_manager.cc:1398] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.005s user 0.003s sys 0.002s
I20240503 14:16:08.208226 30405 consensus_queue.cc:237] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:08.210206 30331 catalog_manager.cc:5484] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9923003d760c40969bbf265fceed3d7f (127.25.69.65). New cstate: current_term: 1 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:11.668068 25877 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
/tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.69.66:37477
--local_ip_for_outbound_sockets=127.25.69.66
--tserver_master_addrs=127.25.69.126:46605
--webserver_port=35111
--webserver_interface=127.25.69.66
--builtin_ntp_servers=127.25.69.84:40469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=20 with env {}
W20240503 14:16:11.980032 30509 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 14:16:11.980320 30509 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 14:16:11.980473 30509 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 14:16:11.987715 30509 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 14:16:11.987918 30509 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.69.66
I20240503 14:16:11.996047 30509 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.69.84:40469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.69.66:37477
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.69.66
--webserver_port=35111
--tserver_master_addrs=127.25.69.126:46605
--num_tablets_to_copy_simultaneously=20
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.69.66
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 13:43:24 UTC on efd1337a2aa3
build id 107
ASAN enabled
I20240503 14:16:11.997388 30509 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 14:16:11.999054 30509 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:16:12.010244 30514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:16:12.010818 30515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:16:12.011446 30517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:16:12.012030 30509 server_base.cc:1034] running on GCE node
I20240503 14:16:12.012509 30509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 14:16:12.013316 30509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 14:16:12.014513 30509 hybrid_clock.cc:648] HybridClock initialized: now 1714745772014453 us; error 42 us; skew 500 ppm
I20240503 14:16:12.014786 30509 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:16:12.016880 30509 webserver.cc:460] Webserver started at http://127.25.69.66:35111/ using document root <none> and password file <none>
I20240503 14:16:12.017580 30509 fs_manager.cc:359] Metadata directory not provided
I20240503 14:16:12.017709 30509 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:16:12.022579 30509 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20240503 14:16:12.025161 30523 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:16:12.026422 30509 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20240503 14:16:12.026578 30509 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-1/wal
uuid: "a84338b8d24e453faa8e3e7567a2214b"
format_stamp: "Formatted at 2024-05-03 14:16:06 on dist-test-slave-0c7n"
I20240503 14:16:12.027657 30509 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:16:12.050048 30509 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:16:12.050879 30509 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 14:16:12.051153 30509 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:16:12.052075 30509 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 14:16:12.053506 30509 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 14:16:12.053604 30509 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 14:16:12.053719 30509 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 14:16:12.053791 30509 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 14:16:12.085922 30509 rpc_server.cc:307] RPC server started. Bound to: 127.25.69.66:37477
I20240503 14:16:12.085951 30635 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.69.66:37477 every 8 connection(s)
I20240503 14:16:12.087426 30509 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-1/data/info.pb
I20240503 14:16:12.088579 25877 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu as pid 30509
I20240503 14:16:12.090371 25877 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu pid 30030
I20240503 14:16:12.091895 30152 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 14:16:12.103375 30636 heartbeater.cc:347] Connected to a master server at 127.25.69.126:46605
I20240503 14:16:12.103647 30636 heartbeater.cc:464] Registering TS with master...
I20240503 14:16:12.104400 30636 heartbeater.cc:511] Master 127.25.69.126:46605 requested a full tablet report, sending...
I20240503 14:16:12.105875 30324 ts_manager.cc:194] Registered new tserver with Master: a84338b8d24e453faa8e3e7567a2214b (127.25.69.66:37477)
I20240503 14:16:12.107538 30324 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.69.66:34085
I20240503 14:16:12.302127 25877 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu with pid 30030
I20240503 14:16:12.334733 25877 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
/tmp/dist-test-tasktnqDBK/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.69.65:40957
--local_ip_for_outbound_sockets=127.25.69.65
--tserver_master_addrs=127.25.69.126:46605
--webserver_port=43021
--webserver_interface=127.25.69.65
--builtin_ntp_servers=127.25.69.84:40469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=20
--rpc_service_queue_length=1
--rpc_num_service_threads=1 with env {}
W20240503 14:16:12.659961 30641 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 14:16:12.660288 30641 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 14:16:12.660470 30641 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 14:16:12.668126 30641 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 14:16:12.668366 30641 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.69.65
I20240503 14:16:12.677523 30641 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.69.84:40469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.69.65:40957
--rpc_num_service_threads=1
--rpc_server_allow_ephemeral_ports=true
--rpc_service_queue_length=1
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.69.65
--webserver_port=43021
--tserver_master_addrs=127.25.69.126:46605
--num_tablets_to_copy_simultaneously=20
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.69.65
--log_dir=/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 13:43:24 UTC on efd1337a2aa3
build id 107
ASAN enabled
I20240503 14:16:12.678817 30641 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 14:16:12.680572 30641 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:16:12.692473 30647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:16:12.692925 30646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:16:12.693493 30649 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:16:12.694098 30641 server_base.cc:1034] running on GCE node
I20240503 14:16:12.694658 30641 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 14:16:12.695513 30641 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 14:16:12.696802 30641 hybrid_clock.cc:648] HybridClock initialized: now 1714745772696707 us; error 51 us; skew 500 ppm
I20240503 14:16:12.697073 30641 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:16:12.699131 30641 webserver.cc:460] Webserver started at http://127.25.69.65:43021/ using document root <none> and password file <none>
I20240503 14:16:12.699748 30641 fs_manager.cc:359] Metadata directory not provided
I20240503 14:16:12.699877 30641 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:16:12.704592 30641 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20240503 14:16:12.709070 30655 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:16:12.710351 30641 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20240503 14:16:12.710501 30641 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-0/wal
uuid: "9923003d760c40969bbf265fceed3d7f"
format_stamp: "Formatted at 2024-05-03 14:16:05 on dist-test-slave-0c7n"
I20240503 14:16:12.711313 30641 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:16:12.738389 30641 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:16:12.739224 30641 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 14:16:12.739506 30641 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:16:12.740375 30641 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 14:16:12.742533 30662 ts_tablet_manager.cc:522] Loading tablet metadata (0/20 complete)
I20240503 14:16:12.779940 30641 ts_tablet_manager.cc:559] Loaded tablet metadata (20 total tablets, 20 live tablets)
I20240503 14:16:12.780110 30641 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.038s user 0.002s sys 0.000s
I20240503 14:16:12.780230 30641 ts_tablet_manager.cc:574] Registering tablets (0/20 complete)
I20240503 14:16:12.783866 30662 tablet_bootstrap.cc:492] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:12.813629 30641 ts_tablet_manager.cc:590] Registered 20 tablets
I20240503 14:16:12.813727 30641 ts_tablet_manager.cc:569] Time spent register tablets: real 0.034s user 0.026s sys 0.007s
I20240503 14:16:12.819708 30662 log.cc:824] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f: Log is configured to *not* fsync() on all Append() calls
I20240503 14:16:12.822775 30641 rpc_server.cc:307] RPC server started. Bound to: 127.25.69.65:40957
I20240503 14:16:12.822796 30674 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.69.65:40957 every 8 connection(s)
I20240503 14:16:12.824120 30641 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktnqDBK/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714745741318137-25877-0/minicluster-data/ts-0/data/info.pb
I20240503 14:16:12.827026 25877 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktnqDBK/build/asan/bin/kudu as pid 30641
I20240503 14:16:12.852316 30675 heartbeater.cc:347] Connected to a master server at 127.25.69.126:46605
I20240503 14:16:12.852636 30675 heartbeater.cc:464] Registering TS with master...
I20240503 14:16:12.853524 30675 heartbeater.cc:511] Master 127.25.69.126:46605 requested a full tablet report, sending...
I20240503 14:16:12.856168 30324 ts_manager.cc:194] Re-registered known tserver with Master: 9923003d760c40969bbf265fceed3d7f (127.25.69.65:40957)
I20240503 14:16:12.860788 30324 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.69.65:56891
I20240503 14:16:12.983251 30662 tablet_bootstrap.cc:492] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f: Bootstrap replayed 1/1 log segments. Stats: ops{read=185 overwritten=0 applied=185 ignored=0} inserts{seen=492 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:16:12.984084 30662 tablet_bootstrap.cc:492] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f: Bootstrap complete.
I20240503 14:16:12.985605 30662 ts_tablet_manager.cc:1367] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.202s user 0.179s sys 0.020s
I20240503 14:16:12.992372 30662 raft_consensus.cc:348] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:12.993088 30662 raft_consensus.cc:729] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:12.993729 30662 consensus_queue.cc:260] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 185, Last appended: 1.185, Last appended by leader: 185, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:12.993932 30662 raft_consensus.cc:388] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:12.994045 30662 raft_consensus.cc:482] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:12.994231 30662 raft_consensus.cc:3037] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:16:12.997593 30662 raft_consensus.cc:504] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:12.998034 30662 leader_election.cc:302] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:12.998574 30662 leader_election.cc:288] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 14:16:12.998708 30681 raft_consensus.cc:2781] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:16:12.999692 30675 heartbeater.cc:503] Master 127.25.69.126:46605 was elected leader, sending a full tablet report...
I20240503 14:16:12.999780 30681 raft_consensus.cc:686] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f [term 2 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:13.000056 30662 ts_tablet_manager.cc:1398] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
I20240503 14:16:13.000252 30681 consensus_queue.cc:237] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 185, Committed index: 185, Last appended: 1.185, Last appended by leader: 185, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:13.000427 30662 tablet_bootstrap.cc:492] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:13.006441 30324 catalog_manager.cc:5484] T 2bb95df8a92a4322ae312e90bd9d2bd9 P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:13.110308 30636 heartbeater.cc:503] Master 127.25.69.126:46605 was elected leader, sending a full tablet report...
I20240503 14:16:13.177837 30662 tablet_bootstrap.cc:492] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f: Bootstrap replayed 1/1 log segments. Stats: ops{read=191 overwritten=0 applied=191 ignored=0} inserts{seen=534 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:16:13.178318 30662 tablet_bootstrap.cc:492] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f: Bootstrap complete.
I20240503 14:16:13.179226 30662 ts_tablet_manager.cc:1367] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.179s user 0.161s sys 0.016s
I20240503 14:16:13.179999 30662 raft_consensus.cc:348] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:13.180147 30662 raft_consensus.cc:729] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:13.180383 30662 consensus_queue.cc:260] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 191, Last appended: 1.191, Last appended by leader: 191, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:13.180531 30662 raft_consensus.cc:388] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:13.180650 30662 raft_consensus.cc:482] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:13.180728 30662 raft_consensus.cc:3037] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:16:13.182566 30662 raft_consensus.cc:504] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:13.182761 30662 leader_election.cc:302] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:13.182952 30662 leader_election.cc:288] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 14:16:13.183072 30681 raft_consensus.cc:2781] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:16:13.183348 30662 ts_tablet_manager.cc:1398] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 14:16:13.183601 30681 raft_consensus.cc:686] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f [term 2 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:13.183627 30662 tablet_bootstrap.cc:492] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:13.183900 30681 consensus_queue.cc:237] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 191, Committed index: 191, Last appended: 1.191, Last appended by leader: 191, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:13.186563 30324 catalog_manager.cc:5484] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:13.349608 30662 tablet_bootstrap.cc:492] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f: Bootstrap replayed 1/1 log segments. Stats: ops{read=189 overwritten=0 applied=189 ignored=0} inserts{seen=527 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:16:13.350147 30662 tablet_bootstrap.cc:492] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f: Bootstrap complete.
I20240503 14:16:13.351354 30662 ts_tablet_manager.cc:1367] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.168s user 0.150s sys 0.016s
I20240503 14:16:13.352260 30662 raft_consensus.cc:348] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:13.352468 30662 raft_consensus.cc:729] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:13.352718 30662 consensus_queue.cc:260] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 189, Last appended: 1.189, Last appended by leader: 189, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:13.352852 30662 raft_consensus.cc:388] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:13.352929 30662 raft_consensus.cc:482] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:13.353034 30662 raft_consensus.cc:3037] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:16:13.354789 30662 raft_consensus.cc:504] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:13.354987 30662 leader_election.cc:302] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:13.355170 30662 leader_election.cc:288] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 14:16:13.355257 30681 raft_consensus.cc:2781] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:16:13.355402 30681 raft_consensus.cc:686] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f [term 2 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:13.355739 30662 ts_tablet_manager.cc:1398] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 14:16:13.355688 30681 consensus_queue.cc:237] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 189, Committed index: 189, Last appended: 1.189, Last appended by leader: 189, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:13.355981 30662 tablet_bootstrap.cc:492] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:13.357831 30324 catalog_manager.cc:5484] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:13.536492 30662 tablet_bootstrap.cc:492] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f: Bootstrap replayed 1/1 log segments. Stats: ops{read=197 overwritten=0 applied=197 ignored=0} inserts{seen=528 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:16:13.536954 30662 tablet_bootstrap.cc:492] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f: Bootstrap complete.
I20240503 14:16:13.537870 30662 ts_tablet_manager.cc:1367] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.182s user 0.165s sys 0.016s
I20240503 14:16:13.538467 30662 raft_consensus.cc:348] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:13.538609 30662 raft_consensus.cc:729] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:13.538837 30662 consensus_queue.cc:260] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 197, Last appended: 1.197, Last appended by leader: 197, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:13.538959 30662 raft_consensus.cc:388] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:13.539024 30662 raft_consensus.cc:482] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:13.539109 30662 raft_consensus.cc:3037] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:16:13.540853 30662 raft_consensus.cc:504] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:13.541081 30662 leader_election.cc:302] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:13.541291 30662 leader_election.cc:288] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 14:16:13.541337 30681 raft_consensus.cc:2781] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:16:13.541543 30681 raft_consensus.cc:686] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f [term 2 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:13.541749 30662 ts_tablet_manager.cc:1398] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 14:16:13.541777 30681 consensus_queue.cc:237] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 197, Committed index: 197, Last appended: 1.197, Last appended by leader: 197, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:13.541993 30662 tablet_bootstrap.cc:492] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:13.544184 30324 catalog_manager.cc:5484] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:13.713388 30662 tablet_bootstrap.cc:492] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f: Bootstrap replayed 1/1 log segments. Stats: ops{read=188 overwritten=0 applied=188 ignored=0} inserts{seen=510 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:16:13.713811 30662 tablet_bootstrap.cc:492] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f: Bootstrap complete.
I20240503 14:16:13.714722 30662 ts_tablet_manager.cc:1367] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.173s user 0.159s sys 0.012s
I20240503 14:16:13.715442 30662 raft_consensus.cc:348] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:13.715745 30662 raft_consensus.cc:729] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:13.715945 30662 consensus_queue.cc:260] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 188, Last appended: 1.188, Last appended by leader: 188, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:13.716116 30662 raft_consensus.cc:388] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:13.716234 30662 raft_consensus.cc:482] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:13.716339 30662 raft_consensus.cc:3037] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:16:13.718062 30662 raft_consensus.cc:504] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:13.718364 30662 leader_election.cc:302] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:13.718554 30662 leader_election.cc:288] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 14:16:13.718633 30681 raft_consensus.cc:2781] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:16:13.718807 30681 raft_consensus.cc:686] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f [term 2 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:13.719012 30662 ts_tablet_manager.cc:1398] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 14:16:13.719053 30681 consensus_queue.cc:237] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 188, Committed index: 188, Last appended: 1.188, Last appended by leader: 188, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:13.719233 30662 tablet_bootstrap.cc:492] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:13.721518 30324 catalog_manager.cc:5484] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:13.887415 30662 tablet_bootstrap.cc:492] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f: Bootstrap replayed 1/1 log segments. Stats: ops{read=185 overwritten=0 applied=185 ignored=0} inserts{seen=475 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:16:13.887892 30662 tablet_bootstrap.cc:492] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f: Bootstrap complete.
I20240503 14:16:13.888797 30662 ts_tablet_manager.cc:1367] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.170s user 0.146s sys 0.020s
I20240503 14:16:13.889456 30662 raft_consensus.cc:348] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:13.889611 30662 raft_consensus.cc:729] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:13.889837 30662 consensus_queue.cc:260] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 185, Last appended: 1.185, Last appended by leader: 185, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:13.889979 30662 raft_consensus.cc:388] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:13.890079 30662 raft_consensus.cc:482] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:13.890175 30662 raft_consensus.cc:3037] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:16:13.892011 30662 raft_consensus.cc:504] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:13.892212 30662 leader_election.cc:302] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:13.892388 30662 leader_election.cc:288] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 14:16:13.892431 30681 raft_consensus.cc:2781] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:16:13.892606 30681 raft_consensus.cc:686] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f [term 2 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:13.892772 30662 ts_tablet_manager.cc:1398] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20240503 14:16:13.892856 30681 consensus_queue.cc:237] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 185, Committed index: 185, Last appended: 1.185, Last appended by leader: 185, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:13.892997 30662 tablet_bootstrap.cc:492] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:13.895252 30324 catalog_manager.cc:5484] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:14.061246 30662 tablet_bootstrap.cc:492] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f: Bootstrap replayed 1/1 log segments. Stats: ops{read=186 overwritten=0 applied=186 ignored=0} inserts{seen=503 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:16:14.061739 30662 tablet_bootstrap.cc:492] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f: Bootstrap complete.
I20240503 14:16:14.062747 30662 ts_tablet_manager.cc:1367] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.170s user 0.156s sys 0.012s
I20240503 14:16:14.063553 30662 raft_consensus.cc:348] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:14.063704 30662 raft_consensus.cc:729] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:14.063910 30662 consensus_queue.cc:260] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 186, Last appended: 1.186, Last appended by leader: 186, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:14.064052 30662 raft_consensus.cc:388] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:14.064131 30662 raft_consensus.cc:482] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:14.064235 30662 raft_consensus.cc:3037] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:16:14.065982 30662 raft_consensus.cc:504] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:14.066183 30662 leader_election.cc:302] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:14.066362 30662 leader_election.cc:288] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 14:16:14.066457 30681 raft_consensus.cc:2781] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:16:14.066668 30681 raft_consensus.cc:686] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f [term 2 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:14.066807 30662 ts_tablet_manager.cc:1398] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 14:16:14.066915 30681 consensus_queue.cc:237] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 186, Committed index: 186, Last appended: 1.186, Last appended by leader: 186, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:14.067054 30662 tablet_bootstrap.cc:492] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:14.069103 30324 catalog_manager.cc:5484] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:14.244149 30662 tablet_bootstrap.cc:492] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f: Bootstrap replayed 1/1 log segments. Stats: ops{read=183 overwritten=0 applied=183 ignored=0} inserts{seen=490 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:16:14.244658 30662 tablet_bootstrap.cc:492] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f: Bootstrap complete.
I20240503 14:16:14.245649 30662 ts_tablet_manager.cc:1367] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.179s user 0.154s sys 0.024s
I20240503 14:16:14.246381 30662 raft_consensus.cc:348] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:14.246554 30662 raft_consensus.cc:729] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:14.246840 30662 consensus_queue.cc:260] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 183, Last appended: 1.183, Last appended by leader: 183, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:14.247035 30662 raft_consensus.cc:388] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:14.247143 30662 raft_consensus.cc:482] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:14.247254 30662 raft_consensus.cc:3037] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:16:14.249068 30662 raft_consensus.cc:504] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:14.249305 30662 leader_election.cc:302] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:14.249562 30662 leader_election.cc:288] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 14:16:14.249644 30681 raft_consensus.cc:2781] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:16:14.249888 30681 raft_consensus.cc:686] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f [term 2 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:14.250113 30662 ts_tablet_manager.cc:1398] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 14:16:14.250106 30681 consensus_queue.cc:237] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 183, Committed index: 183, Last appended: 1.183, Last appended by leader: 183, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:14.250463 30662 tablet_bootstrap.cc:492] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:14.252346 30324 catalog_manager.cc:5484] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:14.420536 30662 tablet_bootstrap.cc:492] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f: Bootstrap replayed 1/1 log segments. Stats: ops{read=192 overwritten=0 applied=192 ignored=0} inserts{seen=537 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:16:14.420976 30662 tablet_bootstrap.cc:492] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f: Bootstrap complete.
I20240503 14:16:14.422019 30662 ts_tablet_manager.cc:1367] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.172s user 0.151s sys 0.020s
I20240503 14:16:14.422621 30662 raft_consensus.cc:348] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:14.422787 30662 raft_consensus.cc:729] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:14.422997 30662 consensus_queue.cc:260] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 192, Last appended: 1.192, Last appended by leader: 192, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:14.423166 30662 raft_consensus.cc:388] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:14.423234 30662 raft_consensus.cc:482] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:14.423346 30662 raft_consensus.cc:3037] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:16:14.425179 30662 raft_consensus.cc:504] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:14.425462 30662 leader_election.cc:302] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:14.425647 30662 leader_election.cc:288] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 14:16:14.425758 30681 raft_consensus.cc:2781] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:16:14.425936 30681 raft_consensus.cc:686] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f [term 2 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:14.426113 30662 ts_tablet_manager.cc:1398] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 14:16:14.426192 30681 consensus_queue.cc:237] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 192, Committed index: 192, Last appended: 1.192, Last appended by leader: 192, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:14.426334 30662 tablet_bootstrap.cc:492] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:14.429085 30324 catalog_manager.cc:5484] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:14.596418 30662 tablet_bootstrap.cc:492] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f: Bootstrap replayed 1/1 log segments. Stats: ops{read=195 overwritten=0 applied=195 ignored=0} inserts{seen=555 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:16:14.596889 30662 tablet_bootstrap.cc:492] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f: Bootstrap complete.
I20240503 14:16:14.597816 30662 ts_tablet_manager.cc:1367] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.172s user 0.159s sys 0.012s
I20240503 14:16:14.598412 30662 raft_consensus.cc:348] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:14.598549 30662 raft_consensus.cc:729] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:14.598793 30662 consensus_queue.cc:260] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:14.598922 30662 raft_consensus.cc:388] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:14.599004 30662 raft_consensus.cc:482] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:14.599085 30662 raft_consensus.cc:3037] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:16:14.600641 30662 raft_consensus.cc:504] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:14.600829 30662 leader_election.cc:302] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:14.601045 30662 leader_election.cc:288] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 14:16:14.601121 30681 raft_consensus.cc:2781] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:16:14.601374 30681 raft_consensus.cc:686] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f [term 2 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:14.601516 30662 ts_tablet_manager.cc:1398] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 14:16:14.601594 30681 consensus_queue.cc:237] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 195, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:14.601766 30662 tablet_bootstrap.cc:492] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:14.603946 30324 catalog_manager.cc:5484] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:14.762053 30662 tablet_bootstrap.cc:492] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f: Bootstrap replayed 1/1 log segments. Stats: ops{read=179 overwritten=0 applied=179 ignored=0} inserts{seen=491 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:16:14.762495 30662 tablet_bootstrap.cc:492] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f: Bootstrap complete.
I20240503 14:16:14.763394 30662 ts_tablet_manager.cc:1367] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.162s user 0.127s sys 0.032s
I20240503 14:16:14.763988 30662 raft_consensus.cc:348] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:14.764159 30662 raft_consensus.cc:729] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:14.764379 30662 consensus_queue.cc:260] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 179, Last appended: 1.179, Last appended by leader: 179, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:14.764525 30662 raft_consensus.cc:388] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:14.764591 30662 raft_consensus.cc:482] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:14.764665 30662 raft_consensus.cc:3037] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:16:14.766379 30662 raft_consensus.cc:504] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:14.766569 30662 leader_election.cc:302] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:14.766721 30662 leader_election.cc:288] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 14:16:14.766835 30681 raft_consensus.cc:2781] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:16:14.767292 30662 ts_tablet_manager.cc:1398] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.004s user 0.006s sys 0.000s
I20240503 14:16:14.767380 30681 raft_consensus.cc:686] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f [term 2 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:14.767541 30662 tablet_bootstrap.cc:492] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:14.767634 30681 consensus_queue.cc:237] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 179, Committed index: 179, Last appended: 1.179, Last appended by leader: 179, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:14.770318 30324 catalog_manager.cc:5484] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:14.931540 30662 tablet_bootstrap.cc:492] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f: Bootstrap replayed 1/1 log segments. Stats: ops{read=185 overwritten=0 applied=185 ignored=0} inserts{seen=456 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:16:14.932082 30662 tablet_bootstrap.cc:492] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f: Bootstrap complete.
I20240503 14:16:14.933223 30662 ts_tablet_manager.cc:1367] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.166s user 0.138s sys 0.024s
I20240503 14:16:14.933887 30662 raft_consensus.cc:348] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:14.934021 30662 raft_consensus.cc:729] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:14.934185 30662 consensus_queue.cc:260] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 185, Last appended: 1.185, Last appended by leader: 185, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:14.934303 30662 raft_consensus.cc:388] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:14.934365 30662 raft_consensus.cc:482] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:14.934448 30662 raft_consensus.cc:3037] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:16:14.936136 30662 raft_consensus.cc:504] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:14.936313 30662 leader_election.cc:302] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:14.936479 30662 leader_election.cc:288] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 14:16:14.936537 30681 raft_consensus.cc:2781] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:16:14.936689 30681 raft_consensus.cc:686] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f [term 2 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:14.936945 30662 ts_tablet_manager.cc:1398] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.004s user 0.000s sys 0.000s
I20240503 14:16:14.936926 30681 consensus_queue.cc:237] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 185, Committed index: 185, Last appended: 1.185, Last appended by leader: 185, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:14.937299 30662 tablet_bootstrap.cc:492] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:14.939304 30324 catalog_manager.cc:5484] T 63af60166b2c48d187f28a9fa6b2de77 P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:15.102329 30662 tablet_bootstrap.cc:492] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f: Bootstrap replayed 1/1 log segments. Stats: ops{read=183 overwritten=0 applied=183 ignored=0} inserts{seen=501 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:16:15.102766 30662 tablet_bootstrap.cc:492] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f: Bootstrap complete.
I20240503 14:16:15.103628 30662 ts_tablet_manager.cc:1367] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.166s user 0.148s sys 0.016s
I20240503 14:16:15.104224 30662 raft_consensus.cc:348] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:15.104384 30662 raft_consensus.cc:729] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:15.104598 30662 consensus_queue.cc:260] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 183, Last appended: 1.183, Last appended by leader: 183, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:15.104763 30662 raft_consensus.cc:388] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:15.104853 30662 raft_consensus.cc:482] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:15.104956 30662 raft_consensus.cc:3037] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:16:15.106693 30662 raft_consensus.cc:504] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:15.106911 30662 leader_election.cc:302] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:15.107107 30662 leader_election.cc:288] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 14:16:15.107190 30681 raft_consensus.cc:2781] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:16:15.107343 30681 raft_consensus.cc:686] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f [term 2 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:15.107565 30662 ts_tablet_manager.cc:1398] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 14:16:15.107592 30681 consensus_queue.cc:237] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 183, Committed index: 183, Last appended: 1.183, Last appended by leader: 183, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:15.107807 30662 tablet_bootstrap.cc:492] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:15.109972 30324 catalog_manager.cc:5484] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:15.288246 30662 tablet_bootstrap.cc:492] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f: Bootstrap replayed 1/1 log segments. Stats: ops{read=189 overwritten=0 applied=189 ignored=0} inserts{seen=500 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:16:15.288699 30662 tablet_bootstrap.cc:492] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f: Bootstrap complete.
I20240503 14:16:15.289757 30662 ts_tablet_manager.cc:1367] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.182s user 0.157s sys 0.024s
I20240503 14:16:15.290364 30662 raft_consensus.cc:348] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:15.290505 30662 raft_consensus.cc:729] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:15.290690 30662 consensus_queue.cc:260] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 189, Last appended: 1.189, Last appended by leader: 189, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:15.290800 30662 raft_consensus.cc:388] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:15.290870 30662 raft_consensus.cc:482] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:15.290932 30662 raft_consensus.cc:3037] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:16:15.292577 30662 raft_consensus.cc:504] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:15.292739 30662 leader_election.cc:302] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:15.292882 30662 leader_election.cc:288] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 14:16:15.292975 30681 raft_consensus.cc:2781] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:16:15.293398 30662 ts_tablet_manager.cc:1398] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 14:16:15.293556 30681 raft_consensus.cc:686] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f [term 2 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:15.293644 30662 tablet_bootstrap.cc:492] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:15.293774 30681 consensus_queue.cc:237] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 189, Committed index: 189, Last appended: 1.189, Last appended by leader: 189, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:15.296066 30331 catalog_manager.cc:5484] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:15.468273 30662 tablet_bootstrap.cc:492] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f: Bootstrap replayed 1/1 log segments. Stats: ops{read=197 overwritten=0 applied=197 ignored=0} inserts{seen=547 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:16:15.468727 30662 tablet_bootstrap.cc:492] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f: Bootstrap complete.
I20240503 14:16:15.469635 30662 ts_tablet_manager.cc:1367] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.176s user 0.151s sys 0.024s
I20240503 14:16:15.470180 30662 raft_consensus.cc:348] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:15.470336 30662 raft_consensus.cc:729] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:15.470563 30662 consensus_queue.cc:260] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 197, Last appended: 1.197, Last appended by leader: 197, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:15.470719 30662 raft_consensus.cc:388] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:15.470795 30662 raft_consensus.cc:482] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:15.470882 30662 raft_consensus.cc:3037] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:16:15.472549 30662 raft_consensus.cc:504] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:15.472738 30662 leader_election.cc:302] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:15.472941 30662 leader_election.cc:288] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 14:16:15.473047 30681 raft_consensus.cc:2781] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:16:15.473237 30681 raft_consensus.cc:686] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f [term 2 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:15.473377 30662 ts_tablet_manager.cc:1398] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 14:16:15.473507 30681 consensus_queue.cc:237] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 197, Committed index: 197, Last appended: 1.197, Last appended by leader: 197, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:15.473619 30662 tablet_bootstrap.cc:492] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:15.475688 30331 catalog_manager.cc:5484] T 9dac678dce1f463fbdcd3f0802522e88 P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:15.668067 30662 tablet_bootstrap.cc:492] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f: Bootstrap replayed 1/1 log segments. Stats: ops{read=186 overwritten=0 applied=186 ignored=0} inserts{seen=527 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:16:15.668521 30662 tablet_bootstrap.cc:492] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f: Bootstrap complete.
I20240503 14:16:15.669458 30662 ts_tablet_manager.cc:1367] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.196s user 0.152s sys 0.016s
I20240503 14:16:15.670078 30662 raft_consensus.cc:348] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:15.670223 30662 raft_consensus.cc:729] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:15.670445 30662 consensus_queue.cc:260] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 186, Last appended: 1.186, Last appended by leader: 186, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:15.670570 30662 raft_consensus.cc:388] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:15.670637 30662 raft_consensus.cc:482] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:15.670701 30662 raft_consensus.cc:3037] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:16:15.672384 30662 raft_consensus.cc:504] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:15.672550 30662 leader_election.cc:302] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:15.672744 30662 leader_election.cc:288] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 14:16:15.672813 30681 raft_consensus.cc:2781] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:16:15.673169 30662 ts_tablet_manager.cc:1398] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.004s user 0.000s sys 0.000s
I20240503 14:16:15.673432 30662 tablet_bootstrap.cc:492] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:15.673385 30681 raft_consensus.cc:686] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f [term 2 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:15.673660 30681 consensus_queue.cc:237] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 186, Committed index: 186, Last appended: 1.186, Last appended by leader: 186, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:15.676507 30331 catalog_manager.cc:5484] T 246be68db54741e1b119082f95aa1596 P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:15.841459 30662 tablet_bootstrap.cc:492] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f: Bootstrap replayed 1/1 log segments. Stats: ops{read=186 overwritten=0 applied=186 ignored=0} inserts{seen=474 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:16:15.842031 30662 tablet_bootstrap.cc:492] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f: Bootstrap complete.
I20240503 14:16:15.843044 30662 ts_tablet_manager.cc:1367] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.170s user 0.152s sys 0.016s
I20240503 14:16:15.843678 30662 raft_consensus.cc:348] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:15.843850 30662 raft_consensus.cc:729] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:15.844069 30662 consensus_queue.cc:260] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 186, Last appended: 1.186, Last appended by leader: 186, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:15.844246 30662 raft_consensus.cc:388] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:15.844329 30662 raft_consensus.cc:482] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:15.844449 30662 raft_consensus.cc:3037] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:16:15.846450 30662 raft_consensus.cc:504] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:15.846666 30662 leader_election.cc:302] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:15.846870 30662 leader_election.cc:288] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 14:16:15.846956 30681 raft_consensus.cc:2781] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:16:15.847162 30681 raft_consensus.cc:686] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f [term 2 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:15.847373 30662 ts_tablet_manager.cc:1398] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 14:16:15.847414 30681 consensus_queue.cc:237] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 186, Committed index: 186, Last appended: 1.186, Last appended by leader: 186, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:15.847579 30662 tablet_bootstrap.cc:492] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:15.852388 30331 catalog_manager.cc:5484] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:16.013715 30662 tablet_bootstrap.cc:492] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f: Bootstrap replayed 1/1 log segments. Stats: ops{read=185 overwritten=0 applied=185 ignored=0} inserts{seen=531 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:16:16.014226 30662 tablet_bootstrap.cc:492] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f: Bootstrap complete.
I20240503 14:16:16.015241 30662 ts_tablet_manager.cc:1367] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.168s user 0.153s sys 0.012s
I20240503 14:16:16.016011 30662 raft_consensus.cc:348] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:16.016196 30662 raft_consensus.cc:729] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:16.016444 30662 consensus_queue.cc:260] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 185, Last appended: 1.185, Last appended by leader: 185, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:16.016584 30662 raft_consensus.cc:388] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:16.016678 30662 raft_consensus.cc:482] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:16.016772 30662 raft_consensus.cc:3037] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:16:16.018625 30662 raft_consensus.cc:504] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:16.018842 30662 leader_election.cc:302] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:16.019026 30662 leader_election.cc:288] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 14:16:16.019079 30681 raft_consensus.cc:2781] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:16:16.019264 30681 raft_consensus.cc:686] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f [term 2 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:16.019425 30662 ts_tablet_manager.cc:1398] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 14:16:16.019492 30681 consensus_queue.cc:237] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 185, Committed index: 185, Last appended: 1.185, Last appended by leader: 185, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:16.019685 30662 tablet_bootstrap.cc:492] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:16.022276 30331 catalog_manager.cc:5484] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:16.195569 30662 tablet_bootstrap.cc:492] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f: Bootstrap replayed 1/1 log segments. Stats: ops{read=193 overwritten=0 applied=193 ignored=0} inserts{seen=540 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:16:16.195993 30662 tablet_bootstrap.cc:492] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f: Bootstrap complete.
I20240503 14:16:16.196913 30662 ts_tablet_manager.cc:1367] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.177s user 0.162s sys 0.012s
I20240503 14:16:16.197546 30662 raft_consensus.cc:348] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:16.197698 30662 raft_consensus.cc:729] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:16.197891 30662 consensus_queue.cc:260] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 193, Last appended: 1.193, Last appended by leader: 193, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:16.198033 30662 raft_consensus.cc:388] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:16.198086 30662 raft_consensus.cc:482] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:16.198159 30662 raft_consensus.cc:3037] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:16:16.199831 30662 raft_consensus.cc:504] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:16.200030 30662 leader_election.cc:302] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:16.200176 30662 leader_election.cc:288] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 14:16:16.200269 30681 raft_consensus.cc:2781] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:16:16.200436 30681 raft_consensus.cc:686] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f [term 2 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:16.200671 30662 ts_tablet_manager.cc:1398] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 14:16:16.200672 30681 consensus_queue.cc:237] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 193, Committed index: 193, Last appended: 1.193, Last appended by leader: 193, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:16.200913 30662 tablet_bootstrap.cc:492] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f: Bootstrap starting.
I20240503 14:16:16.203501 30331 catalog_manager.cc:5484] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:16.364882 30662 tablet_bootstrap.cc:492] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f: Bootstrap replayed 1/1 log segments. Stats: ops{read=194 overwritten=0 applied=194 ignored=0} inserts{seen=482 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:16:16.365370 30662 tablet_bootstrap.cc:492] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f: Bootstrap complete.
I20240503 14:16:16.366261 30662 ts_tablet_manager.cc:1367] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f: Time spent bootstrapping tablet: real 0.165s user 0.145s sys 0.020s
I20240503 14:16:16.366839 30662 raft_consensus.cc:348] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:16.366984 30662 raft_consensus.cc:729] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Initialized, Role: FOLLOWER
I20240503 14:16:16.367211 30662 consensus_queue.cc:260] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 194, Last appended: 1.194, Last appended by leader: 194, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:16.367347 30662 raft_consensus.cc:388] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:16:16.367417 30662 raft_consensus.cc:482] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:16:16.367478 30662 raft_consensus.cc:3037] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:16:16.369062 30662 raft_consensus.cc:504] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:16.369262 30662 leader_election.cc:302] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9923003d760c40969bbf265fceed3d7f; no voters:
I20240503 14:16:16.369428 30662 leader_election.cc:288] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 14:16:16.369486 30681 raft_consensus.cc:2781] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:16:16.369674 30681 raft_consensus.cc:686] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f [term 2 LEADER]: Becoming Leader. State: Replica: 9923003d760c40969bbf265fceed3d7f, State: Running, Role: LEADER
I20240503 14:16:16.369819 30662 ts_tablet_manager.cc:1398] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20240503 14:16:16.369896 30681 consensus_queue.cc:237] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 194, Committed index: 194, Last appended: 1.194, Last appended by leader: 194, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } }
I20240503 14:16:16.371981 30331 catalog_manager.cc:5484] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "9923003d760c40969bbf265fceed3d7f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9923003d760c40969bbf265fceed3d7f" member_type: VOTER last_known_addr { host: "127.25.69.65" port: 40957 } health_report { overall_health: HEALTHY } } }
I20240503 14:16:16.401852 30756 ts_tablet_manager.cc:902] T 132d1335591e4170b1030c93fba9a79f P a84338b8d24e453faa8e3e7567a2214b: Initiating tablet copy from peer 9923003d760c40969bbf265fceed3d7f (127.25.69.65:40957)
I20240503 14:16:16.403410 30754 ts_tablet_manager.cc:902] T ae7995ab6cab4473936176bd918cd089 P a84338b8d24e453faa8e3e7567a2214b: Initiating tablet copy from peer 9923003d760c40969bbf265fceed3d7f (127.25.69.65:40957)
I20240503 14:16:16.414965 30754 tablet_copy_client.cc:308] T ae7995ab6cab4473936176bd918cd089 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:40957
I20240503 14:16:16.429821 30770 ts_tablet_manager.cc:902] T 6426b3d51deb401d9c1641609bc8abe6 P a84338b8d24e453faa8e3e7567a2214b: Initiating tablet copy from peer 9923003d760c40969bbf265fceed3d7f (127.25.69.65:40957)
I20240503 14:16:16.431388 30756 tablet_copy_client.cc:308] T 132d1335591e4170b1030c93fba9a79f P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:40957
I20240503 14:16:16.431639 30768 ts_tablet_manager.cc:902] T c4dba4295ef04b1faa3a453df4615413 P a84338b8d24e453faa8e3e7567a2214b: Initiating tablet copy from peer 9923003d760c40969bbf265fceed3d7f (127.25.69.65:40957)
I20240503 14:16:16.432917 30766 ts_tablet_manager.cc:902] T 82359eb6be094060bdcab46c04d27fc6 P a84338b8d24e453faa8e3e7567a2214b: Initiating tablet copy from peer 9923003d760c40969bbf265fceed3d7f (127.25.69.65:40957)
I20240503 14:16:16.441902 30752 ts_tablet_manager.cc:902] T 3233e361d51948b8afbf3aa9ec70cad1 P a84338b8d24e453faa8e3e7567a2214b: Initiating tablet copy from peer 9923003d760c40969bbf265fceed3d7f (127.25.69.65:40957)
I20240503 14:16:16.449981 30765 ts_tablet_manager.cc:902] T aabea09945a4430bb29f4faa49c2375b P a84338b8d24e453faa8e3e7567a2214b: Initiating tablet copy from peer 9923003d760c40969bbf265fceed3d7f (127.25.69.65:40957)
I20240503 14:16:16.451079 30767 ts_tablet_manager.cc:902] T 8b77fcd79c314d7783cbd9950f793f9e P a84338b8d24e453faa8e3e7567a2214b: Initiating tablet copy from peer 9923003d760c40969bbf265fceed3d7f (127.25.69.65:40957)
I20240503 14:16:16.451923 30761 ts_tablet_manager.cc:902] T 1b11f4b5593548918661202d9f11b821 P a84338b8d24e453faa8e3e7567a2214b: Initiating tablet copy from peer 9923003d760c40969bbf265fceed3d7f (127.25.69.65:40957)
I20240503 14:16:16.452958 30762 ts_tablet_manager.cc:902] T 7916cb46d6864e47a4b7ac2db4ac847c P a84338b8d24e453faa8e3e7567a2214b: Initiating tablet copy from peer 9923003d760c40969bbf265fceed3d7f (127.25.69.65:40957)
I20240503 14:16:16.453996 30763 ts_tablet_manager.cc:902] T c65ec6569c1541218bb6d7b5d3def67a P a84338b8d24e453faa8e3e7567a2214b: Initiating tablet copy from peer 9923003d760c40969bbf265fceed3d7f (127.25.69.65:40957)
I20240503 14:16:16.459751 30763 tablet_copy_client.cc:308] T c65ec6569c1541218bb6d7b5d3def67a P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:40957
I20240503 14:16:16.461874 30767 tablet_copy_client.cc:308] T 8b77fcd79c314d7783cbd9950f793f9e P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:40957
I20240503 14:16:16.471134 30770 tablet_copy_client.cc:308] T 6426b3d51deb401d9c1641609bc8abe6 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:40957
I20240503 14:16:16.476182 30668 tablet_copy_service.cc:140] P 9923003d760c40969bbf265fceed3d7f: Received BeginTabletCopySession request for tablet ae7995ab6cab4473936176bd918cd089 from peer a84338b8d24e453faa8e3e7567a2214b ({username='slave'} at 127.25.69.66:55411)
I20240503 14:16:16.476513 30668 tablet_copy_service.cc:161] P 9923003d760c40969bbf265fceed3d7f: Beginning new tablet copy session on tablet ae7995ab6cab4473936176bd918cd089 from peer a84338b8d24e453faa8e3e7567a2214b at {username='slave'} at 127.25.69.66:55411: session id = a84338b8d24e453faa8e3e7567a2214b-ae7995ab6cab4473936176bd918cd089
I20240503 14:16:16.478935 30766 tablet_copy_client.cc:308] T 82359eb6be094060bdcab46c04d27fc6 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:40957
I20240503 14:16:16.480074 30768 tablet_copy_client.cc:308] T c4dba4295ef04b1faa3a453df4615413 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:40957
I20240503 14:16:16.481019 30668 tablet_copy_source_session.cc:205] T ae7995ab6cab4473936176bd918cd089 P 9923003d760c40969bbf265fceed3d7f: Tablet Copy: opened 0 blocks and 1 log segments
W20240503 14:16:16.483690 30658 service_pool.cc:135] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items.
I20240503 14:16:16.484294 30658 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.25.69.66:55411 (request call id 2)
I20240503 14:16:16.483979 30668 tablet_copy_service.cc:140] P 9923003d760c40969bbf265fceed3d7f: Received BeginTabletCopySession request for tablet 132d1335591e4170b1030c93fba9a79f from peer a84338b8d24e453faa8e3e7567a2214b ({username='slave'} at 127.25.69.66:55411)
I20240503 14:16:16.484778 30668 tablet_copy_service.cc:161] P 9923003d760c40969bbf265fceed3d7f: Beginning new tablet copy session on tablet 132d1335591e4170b1030c93fba9a79f from peer a84338b8d24e453faa8e3e7567a2214b at {username='slave'} at 127.25.69.66:55411: session id = a84338b8d24e453faa8e3e7567a2214b-132d1335591e4170b1030c93fba9a79f
I20240503 14:16:16.487991 30752 tablet_copy_client.cc:308] T 3233e361d51948b8afbf3aa9ec70cad1 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:40957
I20240503 14:16:16.488723 30761 tablet_copy_client.cc:308] T 1b11f4b5593548918661202d9f11b821 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:40957
I20240503 14:16:16.489414 30762 tablet_copy_client.cc:308] T 7916cb46d6864e47a4b7ac2db4ac847c P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:40957
I20240503 14:16:16.493641 30765 tablet_copy_client.cc:308] T aabea09945a4430bb29f4faa49c2375b P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:40957
I20240503 14:16:16.496455 30658 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.25.69.66:55411 (request call id 2)
I20240503 14:16:16.497025 30658 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.25.69.66:55411 (request call id 2)
I20240503 14:16:16.497622 30658 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.25.69.66:55411 (request call id 2)
I20240503 14:16:16.497972 30658 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.25.69.66:55411 (request call id 2)
I20240503 14:16:16.499925 30764 ts_tablet_manager.cc:902] T 859f3c3c03b4471d9b8cf7515b4e42ca P a84338b8d24e453faa8e3e7567a2214b: Initiating tablet copy from peer 9923003d760c40969bbf265fceed3d7f (127.25.69.65:40957)
I20240503 14:16:16.500979 30769 ts_tablet_manager.cc:902] T defc186d26e44d2e90c230792d147414 P a84338b8d24e453faa8e3e7567a2214b: Initiating tablet copy from peer 9923003d760c40969bbf265fceed3d7f (127.25.69.65:40957)
I20240503 14:16:16.502039 30759 ts_tablet_manager.cc:902] T ac007594566a4b60b0c496e31c78c623 P a84338b8d24e453faa8e3e7567a2214b: Initiating tablet copy from peer 9923003d760c40969bbf265fceed3d7f (127.25.69.65:40957)
I20240503 14:16:16.503124 30757 ts_tablet_manager.cc:902] T 9b85b747e67f4aa0bb0421ea5c8182b7 P a84338b8d24e453faa8e3e7567a2214b: Initiating tablet copy from peer 9923003d760c40969bbf265fceed3d7f (127.25.69.65:40957)
I20240503 14:16:16.504182 30758 ts_tablet_manager.cc:902] T be28321e9c1e4f1c964e3c3e115c88c3 P a84338b8d24e453faa8e3e7567a2214b: Initiating tablet copy from peer 9923003d760c40969bbf265fceed3d7f (127.25.69.65:40957)
I20240503 14:16:16.505367 30772 ts_tablet_manager.cc:902] T 63af60166b2c48d187f28a9fa6b2de77 P a84338b8d24e453faa8e3e7567a2214b: Initiating tablet copy from peer 9923003d760c40969bbf265fceed3d7f (127.25.69.65:40957)
F20240503 14:16:16.505836 30772 trace_metrics.cc:68] Check failed: g_intern_map->size() < 100 (100 vs. 100) Too many interned strings: (MaintenanceMgr.queue_time_us, MaintenanceMgr.queue_time_us) (MaintenanceMgr.run_cpu_time_us, MaintenanceMgr.run_cpu_time_us) (MaintenanceMgr.run_wall_time_us, MaintenanceMgr.run_wall_time_us) (apply.queue_time_us, apply.queue_time_us) (apply.run_cpu_time_us, apply.run_cpu_time_us) (apply.run_wall_time_us, apply.run_wall_time_us) (client-negotiator.queue_time_us, client-negotiator.queue_time_us) (client-negotiator.run_cpu_time_us, client-negotiator.run_cpu_time_us) (client-negotiator.run_wall_time_us, client-negotiator.run_wall_time_us) (compiler_manager_pool.queue_time_us, compiler_manager_pool.queue_time_us) (compiler_manager_pool.run_cpu_time_us, compiler_manager_pool.run_cpu_time_us) (compiler_manager_pool.run_wall_time_us, compiler_manager_pool.run_wall_time_us) (dirs.queue_time_us, dirs.queue_time_us) (dirs.run_cpu_time_us, dirs.run_cpu_time_us) (dirs.run_wall_time_us, dirs.run_wall_time_us) (dns-resolver.queue_time_us, dns-resolver.queue_time_us) (dns-resolver.run_cpu_time_us, dns-resolver.run_cpu_time_us) (dns-resolver.run_wall_time_us, dns-resolver.run_wall_time_us) (prepare.queue_time_us, prepare.queue_time_us) (prepare.run_cpu_time_us, prepare.run_cpu_time_us) (prepare.run_wall_time_us, prepare.run_wall_time_us) (raft.queue_time_us, raft.queue_time_us) (raft.run_cpu_time_us, raft.run_cpu_time_us) (raft.run_wall_time_us, raft.run_wall_time_us) (repair_pool.queue_time_us, repair_pool.queue_time_us) (repair_pool.run_cpu_time_us, repair_pool.run_cpu_time_us) (repair_pool.run_wall_time_us, repair_pool.run_wall_time_us) (server-negotiator.queue_time_us, server-negotiator.queue_time_us) (server-negotiator.run_cpu_time_us, server-negotiator.run_cpu_time_us) (server-negotiator.run_wall_time_us, server-negotiator.run_wall_time_us) (tablet-copy.queue_time_us, tablet-copy.queue_time_us) (tablet-copy.run_cpu_time_us, tablet-copy.run_cpu_time_us) (tablet-copy.run_wall_time_us, tablet-copy.run_wall_time_us) (tablet-delete.queue_time_us, tablet-delete.queue_time_us) (tablet-delete.run_cpu_time_us, tablet-delete.run_cpu_time_us) (tablet-delete.run_wall_time_us, tablet-delete.run_wall_time_us) (tablet-download-pool-132d1335591e4170b1030c93fba9a79f.queue_time_us, tablet-download-pool-132d1335591e4170b1030c93fba9a79f.queue_time_us) (tablet-download-pool-132d1335591e4170b1030c93fba9a79f.run_cpu_time_us, tablet-download-pool-132d1335591e4170b1030c93fba9a79f.run_cpu_time_us) (tablet-download-pool-132d1335591e4170b1030c93fba9a79f.run_wall_time_us, tablet-download-pool-132d1335591e4170b1030c93fba9a79f.run_wall_time_us) (tablet-download-pool-1b11f4b5593548918661202d9f11b821.queue_time_us, tablet-download-pool-1b11f4b5593548918661202d9f11b821.queue_time_us) (tablet-download-pool-1b11f4b5593548918661202d9f11b821.run_cpu_time_us, tablet-download-pool-1b11f4b5593548918661202d9f11b821.run_cpu_time_us) (tablet-download-pool-1b11f4b5593548918661202d9f11b821.run_wall_time_us, tablet-download-pool-1b11f4b5593548918661202d9f11b821.run_wall_time_us) (tablet-download-pool-3233e361d51948b8afbf3aa9ec70cad1.queue_time_us, tablet-download-pool-3233e361d51948b8afbf3aa9ec70cad1.queue_time_us) (tablet-download-pool-3233e361d51948b8afbf3aa9ec70cad1.run_cpu_time_us, tablet-download-pool-3233e361d51948b8afbf3aa9ec70cad1.run_cpu_time_us) (tablet-download-pool-3233e361d51948b8afbf3aa9ec70cad1.run_wall_time_us, tablet-download-pool-3233e361d51948b8afbf3aa9ec70cad1.run_wall_time_us) (tablet-download-pool-63af60166b2c48d187f28a9fa6b2de77.queue_time_us, tablet-download-pool-63af60166b2c48d187f28a9fa6b2de77.queue_time_us) (tablet-download-pool-6426b3d51deb401d9c1641609bc8abe6.queue_time_us, tablet-download-pool-6426b3d51deb401d9c1641609bc8abe6.queue_time_us) (tablet-download-pool-6426b3d51deb401d9c1641609bc8abe6.run_cpu_time_us, tablet-download-pool-6426b3d51deb401d9c1641609bc8abe6.run_cpu_time_us) (tablet-download-pool-6426b3d51deb401d9c1641609bc8abe6.run_wall_time_us, tablet-download-pool-6426b3d51deb401d9c1641609bc8abe6.run_wall_time_us) (tablet-download-pool-7916cb46d6864e47a4b7ac2db4ac847c.queue_time_us, tablet-download-pool-7916cb46d6864e47a4b7ac2db4ac847c.queue_time_us) (tablet-download-pool-7916cb46d6864e47a4b7ac2db4ac847c.run_cpu_time_us, tablet-download-pool-7916cb46d6864e47a4b7ac2db4ac847c.run_cpu_time_us) (tablet-download-pool-7916cb46d6864e47a4b7ac2db4ac847c.run_wall_time_us, tablet-download-pool-7916cb46d6864e47a4b7ac2db4ac847c.run_wall_time_us) (tablet-download-pool-82359eb6be094060bdcab46c04d27fc6.queue_time_us, tablet-download-pool-82359eb6be094060bdcab46c04d27fc6.queue_time_us) (tablet-download-pool-82359eb6be094060bdcab46c04d27fc6.run_cpu_time_us, tablet-download-pool-82359eb6be094060bdcab46c04d27fc6.run_cpu_time_us) (tablet-download-pool-82359eb6be094060bdcab46c04d27fc6.run_wall_time_us, tablet-download-pool-82359eb6be094060bdcab46c04d27fc6.run_wall_time_us) (tablet-download-pool-859f3c3c03b4471d9b8cf7515b4e42ca.queue_time_us, tablet-download-pool-859f3c3c03b4471d9b8cf7515b4e42ca.queue_time_us) (tablet-download-pool-859f3c3c03b4471d9b8cf7515b4e42ca.run_cpu_time_us, tablet-download-pool-859f3c3c03b4471d9b8cf7515b4e42ca.run_cpu_time_us) (tablet-download-pool-859f3c3c03b4471d9b8cf7515b4e42ca.run_wall_time_us, tablet-download-pool-859f3c3c03b4471d9b8cf7515b4e42ca.run_wall_time_us) (tablet-download-pool-8b77fcd79c314d7783cbd9950f793f9e.queue_time_us, tablet-download-pool-8b77fcd79c314d7783cbd9950f793f9e.queue_time_us) (tablet-download-pool-8b77fcd79c314d7783cbd9950f793f9e.run_cpu_time_us, tablet-download-pool-8b77fcd79c314d7783cbd9950f793f9e.run_cpu_time_us) (tablet-download-pool-8b77fcd79c314d7783cbd9950f793f9e.run_wall_time_us, tablet-download-pool-8b77fcd79c314d7783cbd9950f793f9e.run_wall_time_us) (tablet-download-pool-9b85b747e67f4aa0bb0421ea5c8182b7.queue_time_us, tablet-download-pool-9b85b747e67f4aa0bb0421ea5c8182b7.queue_time_us) (tablet-download-pool-9b85b747e67f4aa0bb0421ea5c8182b7.run_cpu_time_us, tablet-download-pool-9b85b747e67f4aa0bb0421ea5c8182b7.run_cpu_time_us) (tablet-download-pool-9b85b747e67f4aa0bb0421ea5c8182b7.run_wall_time_us, tablet-download-pool-9b85b747e67f4aa0bb0421ea5c8182b7.run_wall_time_us) (tablet-download-pool-aabea09945a4430bb29f4faa49c2375b.queue_time_us, tablet-download-pool-aabea09945a4430bb29f4faa49c2375b.queue_time_us) (tablet-download-pool-aabea09945a4430bb29f4faa49c2375b.run_cpu_time_us, tablet-download-pool-aabea09945a4430bb29f4faa49c2375b.run_cpu_time_us) (tablet-download-pool-aabea09945a4430bb29f4faa49c2375b.run_wall_time_us, tablet-download-pool-aabea09945a4430bb29f4faa49c2375b.run_wall_time_us) (tablet-download-pool-ac007594566a4b60b0c496e31c78c623.queue_time_us, tablet-download-pool-ac007594566a4b60b0c496e31c78c623.queue_time_us) (tablet-download-pool-ac007594566a4b60b0c496e31c78c623.run_cpu_time_us, tablet-download-pool-ac007594566a4b60b0c496e31c78c623.run_cpu_time_us) (tablet-download-pool-ac007594566a4b60b0c496e31c78c623.run_wall_time_us, tablet-download-pool-ac007594566a4b60b0c496e31c78c623.run_wall_time_us) (tablet-download-pool-ae7995ab6cab4473936176bd918cd089.queue_time_us, tablet-download-pool-ae7995ab6cab4473936176bd918cd089.queue_time_us) (tablet-download-pool-ae7995ab6cab4473936176bd918cd089.run_cpu_time_us, tablet-download-pool-ae7995ab6cab4473936176bd918cd089.run_cpu_time_us) (tablet-download-pool-ae7995ab6cab4473936176bd918cd089.run_wall_time_us, tablet-download-pool-ae7995ab6cab4473936176bd918cd089.run_wall_time_us) (tablet-download-pool-be28321e9c1e4f1c964e3c3e115c88c3.queue_time_us, tablet-download-pool-be28321e9c1e4f1c964e3c3e115c88c3.queue_time_us) (tablet-download-pool-be28321e9c1e4f1c964e3c3e115c88c3.run_cpu_time_us, tablet-download-pool-be28321e9c1e4f1c964e3c3e115c88c3.run_cpu_time_us) (tablet-download-pool-be28321e9c1e4f1c964e3c3e115c88c3.run_wall_time_us, tablet-download-pool-be28321e9c1e4f1c964e3c3e115c88c3.run_wall_time_us) (tablet-download-pool-c4dba4295ef04b1faa3a453df4615413.queue_time_us, tablet-download-pool-c4dba4295ef04b1faa3a453df4615413.queue_time_us) (tablet-download-pool-c4dba4295ef04b1faa3a453df4615413.run_cpu_time_us, tablet-download-pool-c4dba4295ef04b1faa3a453df4615413.run_cpu_time_us) (tablet-download-pool-c4dba4295ef04b1faa3a453df4615413.run_wall_time_us, tablet-download-pool-c4dba4295ef04b1faa3a453df4615413.run_wall_time_us) (tablet-download-pool-c65ec6569c1541218bb6d7b5d3def67a.queue_time_us, tablet-download-pool-c65ec6569c1541218bb6d7b5d3def67a.queue_time_us) (tablet-download-pool-c65ec6569c1541218bb6d7b5d3def67a.run_cpu_time_us, tablet-download-pool-c65ec6569c1541218bb6d7b5d3def67a.run_cpu_time_us) (tablet-download-pool-c65ec6569c1541218bb6d7b5d3def67a.run_wall_time_us, tablet-download-pool-c65ec6569c1541218bb6d7b5d3def67a.run_wall_time_us) (tablet-download-pool-defc186d26e44d2e90c230792d147414.queue_time_us, tablet-download-pool-defc186d26e44d2e90c230792d147414.queue_time_us) (tablet-download-pool-defc186d26e44d2e90c230792d147414.run_cpu_time_us, tablet-download-pool-defc186d26e44d2e90c230792d147414.run_cpu_time_us) (tablet-download-pool-defc186d26e44d2e90c230792d147414.run_wall_time_us, tablet-download-pool-defc186d26e44d2e90c230792d147414.run_wall_time_us) (tablet-open.queue_time_us, tablet-open.queue_time_us) (tablet-open.run_cpu_time_us, tablet-open.run_cpu_time_us) (tablet-open.run_wall_time_us, tablet-open.run_wall_time_us) (txn-commit.queue_time_us, txn-commit.queue_time_us) (txn-commit.run_cpu_time_us, txn-commit.run_cpu_time_us) (txn-commit.run_wall_time_us, txn-commit.run_wall_time_us) (txn-participant-registration.queue_time_us, txn-participant-registration.queue_time_us) (txn-participant-registration.run_cpu_time_us, txn-participant-registration.run_cpu_time_us) (txn-participant-registration.run_wall_time_us, txn-participant-registration.run_wall_time_us) (txn-status-manager.queue_time_us, txn-status-manager.queue_time_us) (txn-status-manager.run_cpu_time_us, txn-status-manager.run_cpu_time_us) (txn-status-manager.run_wall_time_us, txn-status-manager.run_wall_time_us) (txn-status-tablet-reload.queue_time_us, txn-status-tablet-reload.queue_time_us) (txn-status-tablet-reload.run_cpu_time_us, txn-status-tablet-reload.run_cpu_time_us) (txn-status-tablet-reload.run_wall_time_us, txn-status-tablet-reload.run_wall_time_us)
*** Check failure stack trace: ***
I20240503 14:16:16.513608 30658 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.25.69.66:55411 (request call id 2)
I20240503 14:16:16.514027 30658 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.25.69.66:55411 (request call id 2)
I20240503 14:16:16.514410 30658 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.25.69.66:55411 (request call id 2)
I20240503 14:16:16.515982 30668 tablet_copy_source_session.cc:205] T 132d1335591e4170b1030c93fba9a79f P 9923003d760c40969bbf265fceed3d7f: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 14:16:16.516644 30668 tablet_copy_service.cc:140] P 9923003d760c40969bbf265fceed3d7f: Received BeginTabletCopySession request for tablet c65ec6569c1541218bb6d7b5d3def67a from peer a84338b8d24e453faa8e3e7567a2214b ({username='slave'} at 127.25.69.66:55411)
I20240503 14:16:16.516865 30668 tablet_copy_service.cc:161] P 9923003d760c40969bbf265fceed3d7f: Beginning new tablet copy session on tablet c65ec6569c1541218bb6d7b5d3def67a from peer a84338b8d24e453faa8e3e7567a2214b at {username='slave'} at 127.25.69.66:55411: session id = a84338b8d24e453faa8e3e7567a2214b-c65ec6569c1541218bb6d7b5d3def67a
I20240503 14:16:16.520828 30668 tablet_copy_source_session.cc:205] T c65ec6569c1541218bb6d7b5d3def67a P 9923003d760c40969bbf265fceed3d7f: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 14:16:16.538257 30760 ts_tablet_manager.cc:902] T 9dac678dce1f463fbdcd3f0802522e88 P a84338b8d24e453faa8e3e7567a2214b: Initiating tablet copy from peer 9923003d760c40969bbf265fceed3d7f (127.25.69.65:40957)
@ 0x7ff055a49dcd google::LogMessage::Fail() at ??:0
@ 0x7ff055a4db93 google::LogMessage::SendToLog() at ??:0
I20240503 14:16:16.542968 30668 tablet_copy_service.cc:140] P 9923003d760c40969bbf265fceed3d7f: Received BeginTabletCopySession request for tablet 6426b3d51deb401d9c1641609bc8abe6 from peer a84338b8d24e453faa8e3e7567a2214b ({username='slave'} at 127.25.69.66:55411)
I20240503 14:16:16.543215 30668 tablet_copy_service.cc:161] P 9923003d760c40969bbf265fceed3d7f: Beginning new tablet copy session on tablet 6426b3d51deb401d9c1641609bc8abe6 from peer a84338b8d24e453faa8e3e7567a2214b at {username='slave'} at 127.25.69.66:55411: session id = a84338b8d24e453faa8e3e7567a2214b-6426b3d51deb401d9c1641609bc8abe6
I20240503 14:16:16.547582 30668 tablet_copy_source_session.cc:205] T 6426b3d51deb401d9c1641609bc8abe6 P 9923003d760c40969bbf265fceed3d7f: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 14:16:16.548281 30668 tablet_copy_service.cc:140] P 9923003d760c40969bbf265fceed3d7f: Received BeginTabletCopySession request for tablet 8b77fcd79c314d7783cbd9950f793f9e from peer a84338b8d24e453faa8e3e7567a2214b ({username='slave'} at 127.25.69.66:55411)
I20240503 14:16:16.548444 30668 tablet_copy_service.cc:161] P 9923003d760c40969bbf265fceed3d7f: Beginning new tablet copy session on tablet 8b77fcd79c314d7783cbd9950f793f9e from peer a84338b8d24e453faa8e3e7567a2214b at {username='slave'} at 127.25.69.66:55411: session id = a84338b8d24e453faa8e3e7567a2214b-8b77fcd79c314d7783cbd9950f793f9e
I20240503 14:16:16.552083 30668 tablet_copy_source_session.cc:205] T 8b77fcd79c314d7783cbd9950f793f9e P 9923003d760c40969bbf265fceed3d7f: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 14:16:16.554863 30767 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b77fcd79c314d7783cbd9950f793f9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:16.557768 30770 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6426b3d51deb401d9c1641609bc8abe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:16.578497 30754 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae7995ab6cab4473936176bd918cd089. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:16.578758 30763 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c65ec6569c1541218bb6d7b5d3def67a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:16.582342 30756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 132d1335591e4170b1030c93fba9a79f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:16.582592 30755 ts_tablet_manager.cc:902] T 2bb95df8a92a4322ae312e90bd9d2bd9 P a84338b8d24e453faa8e3e7567a2214b: Initiating tablet copy from peer 9923003d760c40969bbf265fceed3d7f (127.25.69.65:40957)
I20240503 14:16:16.583935 30668 tablet_copy_service.cc:140] P 9923003d760c40969bbf265fceed3d7f: Received BeginTabletCopySession request for tablet c4dba4295ef04b1faa3a453df4615413 from peer a84338b8d24e453faa8e3e7567a2214b ({username='slave'} at 127.25.69.66:55411)
I20240503 14:16:16.584527 30658 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.25.69.66:55411 (request call id 15)
I20240503 14:16:16.585004 30668 tablet_copy_service.cc:161] P 9923003d760c40969bbf265fceed3d7f: Beginning new tablet copy session on tablet c4dba4295ef04b1faa3a453df4615413 from peer a84338b8d24e453faa8e3e7567a2214b at {username='slave'} at 127.25.69.66:55411: session id = a84338b8d24e453faa8e3e7567a2214b-c4dba4295ef04b1faa3a453df4615413
I20240503 14:16:16.588748 30753 ts_tablet_manager.cc:902] T 246be68db54741e1b119082f95aa1596 P a84338b8d24e453faa8e3e7567a2214b: Initiating tablet copy from peer 9923003d760c40969bbf265fceed3d7f (127.25.69.65:40957)
I20240503 14:16:16.588860 30658 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.25.69.66:55411 (request call id 15)
I20240503 14:16:16.589288 30658 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.25.69.66:55411 (request call id 15)
I20240503 14:16:16.589570 30658 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.25.69.66:55411 (request call id 15)
@ 0x7ff055a497cc google::LogMessage::Flush() at ??:0
@ 0x7ff055a4af59 google::LogMessageFatal::~LogMessageFatal() at ??:0
I20240503 14:16:16.592727 30668 tablet_copy_source_session.cc:205] T c4dba4295ef04b1faa3a453df4615413 P 9923003d760c40969bbf265fceed3d7f: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 14:16:16.593964 30768 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4dba4295ef04b1faa3a453df4615413. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:16.602209 30668 tablet_copy_service.cc:140] P 9923003d760c40969bbf265fceed3d7f: Received BeginTabletCopySession request for tablet 82359eb6be094060bdcab46c04d27fc6 from peer a84338b8d24e453faa8e3e7567a2214b ({username='slave'} at 127.25.69.66:55411)
I20240503 14:16:16.602386 30668 tablet_copy_service.cc:161] P 9923003d760c40969bbf265fceed3d7f: Beginning new tablet copy session on tablet 82359eb6be094060bdcab46c04d27fc6 from peer a84338b8d24e453faa8e3e7567a2214b at {username='slave'} at 127.25.69.66:55411: session id = a84338b8d24e453faa8e3e7567a2214b-82359eb6be094060bdcab46c04d27fc6
I20240503 14:16:16.606209 30668 tablet_copy_source_session.cc:205] T 82359eb6be094060bdcab46c04d27fc6 P 9923003d760c40969bbf265fceed3d7f: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 14:16:16.613588 30766 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82359eb6be094060bdcab46c04d27fc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:16.618242 30756 tablet_copy_client.cc:783] T 132d1335591e4170b1030c93fba9a79f P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Starting download of 0 data blocks...
I20240503 14:16:16.620337 30668 tablet_copy_service.cc:140] P 9923003d760c40969bbf265fceed3d7f: Received BeginTabletCopySession request for tablet 3233e361d51948b8afbf3aa9ec70cad1 from peer a84338b8d24e453faa8e3e7567a2214b ({username='slave'} at 127.25.69.66:55411)
I20240503 14:16:16.621501 30668 tablet_copy_service.cc:161] P 9923003d760c40969bbf265fceed3d7f: Beginning new tablet copy session on tablet 3233e361d51948b8afbf3aa9ec70cad1 from peer a84338b8d24e453faa8e3e7567a2214b at {username='slave'} at 127.25.69.66:55411: session id = a84338b8d24e453faa8e3e7567a2214b-3233e361d51948b8afbf3aa9ec70cad1
I20240503 14:16:16.623773 30658 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.25.69.66:55411 (request call id 20)
I20240503 14:16:16.624214 30658 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.25.69.66:55411 (request call id 20)
@ 0x7ff05878a742 kudu::TraceMetrics::InternName() at ??:0
I20240503 14:16:16.625523 30754 tablet_copy_client.cc:783] T ae7995ab6cab4473936176bd918cd089 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Starting download of 0 data blocks...
I20240503 14:16:16.625869 30763 tablet_copy_client.cc:783] T c65ec6569c1541218bb6d7b5d3def67a P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Starting download of 0 data blocks...
I20240503 14:16:16.626936 30767 tablet_copy_client.cc:783] T 8b77fcd79c314d7783cbd9950f793f9e P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Starting download of 0 data blocks...
I20240503 14:16:16.626930 30668 tablet_copy_source_session.cc:205] T 3233e361d51948b8afbf3aa9ec70cad1 P 9923003d760c40969bbf265fceed3d7f: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 14:16:16.629935 30756 tablet_copy_client.cc:647] T 132d1335591e4170b1030c93fba9a79f P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Starting download of 1 WAL segments...
I20240503 14:16:16.630307 30763 tablet_copy_client.cc:647] T c65ec6569c1541218bb6d7b5d3def67a P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Starting download of 1 WAL segments...
I20240503 14:16:16.630398 30668 tablet_copy_service.cc:140] P 9923003d760c40969bbf265fceed3d7f: Received BeginTabletCopySession request for tablet 1b11f4b5593548918661202d9f11b821 from peer a84338b8d24e453faa8e3e7567a2214b ({username='slave'} at 127.25.69.66:55411)
I20240503 14:16:16.631486 30770 tablet_copy_client.cc:783] T 6426b3d51deb401d9c1641609bc8abe6 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Starting download of 0 data blocks...
I20240503 14:16:16.631628 30668 tablet_copy_service.cc:161] P 9923003d760c40969bbf265fceed3d7f: Beginning new tablet copy session on tablet 1b11f4b5593548918661202d9f11b821 from peer a84338b8d24e453faa8e3e7567a2214b at {username='slave'} at 127.25.69.66:55411: session id = a84338b8d24e453faa8e3e7567a2214b-1b11f4b5593548918661202d9f11b821
I20240503 14:16:16.634088 30767 tablet_copy_client.cc:647] T 8b77fcd79c314d7783cbd9950f793f9e P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Starting download of 1 WAL segments...
I20240503 14:16:16.634766 30752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3233e361d51948b8afbf3aa9ec70cad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:16.639416 30658 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.25.69.66:55411 (request call id 23)
I20240503 14:16:16.641237 30770 tablet_copy_client.cc:647] T 6426b3d51deb401d9c1641609bc8abe6 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Starting download of 1 WAL segments...
I20240503 14:16:16.642463 30658 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.25.69.66:55411 (request call id 23)
I20240503 14:16:16.644275 30764 tablet_copy_client.cc:308] T 859f3c3c03b4471d9b8cf7515b4e42ca P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:40957
I20240503 14:16:16.645009 30658 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.25.69.66:55411 (request call id 26)
I20240503 14:16:16.650209 30754 tablet_copy_client.cc:647] T ae7995ab6cab4473936176bd918cd089 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Starting download of 1 WAL segments...
@ 0x7ff058756f8b kudu::ThreadPool::ThreadPool() at ??:0
I20240503 14:16:16.651460 30658 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.25.69.66:55411 (request call id 26)
I20240503 14:16:16.651760 30658 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.25.69.66:55411 (request call id 26)
I20240503 14:16:16.652055 30658 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.25.69.66:55411 (request call id 26)
I20240503 14:16:16.652398 30658 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.25.69.66:55411 (request call id 26)
I20240503 14:16:16.656889 30658 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.25.69.66:55411 (request call id 26)
I20240503 14:16:16.659205 30768 tablet_copy_client.cc:783] T c4dba4295ef04b1faa3a453df4615413 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Starting download of 0 data blocks...
I20240503 14:16:16.661355 30768 tablet_copy_client.cc:647] T c4dba4295ef04b1faa3a453df4615413 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Starting download of 1 WAL segments...
I20240503 14:16:16.662568 30658 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.25.69.66:55411 (request call id 26)
I20240503 14:16:16.664315 30658 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.25.69.66:55411 (request call id 26)
I20240503 14:16:16.666438 30658 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.25.69.66:55411 (request call id 26)
I20240503 14:16:16.671291 30658 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.25.69.66:55411 (request call id 26)
@ 0x7ff058750cd6 kudu::ThreadPoolBuilder::Build() at ??:0
I20240503 14:16:16.685564 30668 tablet_copy_source_session.cc:205] T 1b11f4b5593548918661202d9f11b821 P 9923003d760c40969bbf265fceed3d7f: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 14:16:16.685636 30658 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.25.69.66:55411 (request call id 26)
I20240503 14:16:16.686033 30668 tablet_copy_service.cc:140] P 9923003d760c40969bbf265fceed3d7f: Received BeginTabletCopySession request for tablet 859f3c3c03b4471d9b8cf7515b4e42ca from peer a84338b8d24e453faa8e3e7567a2214b ({username='slave'} at 127.25.69.66:55411)
I20240503 14:16:16.686209 30668 tablet_copy_service.cc:161] P 9923003d760c40969bbf265fceed3d7f: Beginning new tablet copy session on tablet 859f3c3c03b4471d9b8cf7515b4e42ca from peer a84338b8d24e453faa8e3e7567a2214b at {username='slave'} at 127.25.69.66:55411: session id = a84338b8d24e453faa8e3e7567a2214b-859f3c3c03b4471d9b8cf7515b4e42ca
I20240503 14:16:16.688652 30658 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.25.69.66:55411 (request call id 38)
I20240503 14:16:16.688997 30668 tablet_copy_source_session.cc:205] T 859f3c3c03b4471d9b8cf7515b4e42ca P 9923003d760c40969bbf265fceed3d7f: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 14:16:16.689110 30761 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b11f4b5593548918661202d9f11b821. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:16.694451 30758 tablet_copy_client.cc:308] T be28321e9c1e4f1c964e3c3e115c88c3 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:40957
I20240503 14:16:16.694744 30757 tablet_copy_client.cc:308] T 9b85b747e67f4aa0bb0421ea5c8182b7 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:40957
I20240503 14:16:16.697716 30768 tablet_copy_client.cc:523] T c4dba4295ef04b1faa3a453df4615413 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 14:16:16.698750 30763 tablet_copy_client.cc:523] T c65ec6569c1541218bb6d7b5d3def67a P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 14:16:16.699903 30766 tablet_copy_client.cc:783] T 82359eb6be094060bdcab46c04d27fc6 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Starting download of 0 data blocks...
I20240503 14:16:16.703001 30767 tablet_copy_client.cc:523] T 8b77fcd79c314d7783cbd9950f793f9e P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 14:16:16.704919 30766 tablet_copy_client.cc:647] T 82359eb6be094060bdcab46c04d27fc6 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Starting download of 1 WAL segments...
I20240503 14:16:16.705363 30668 tablet_copy_service.cc:140] P 9923003d760c40969bbf265fceed3d7f: Received BeginTabletCopySession request for tablet aabea09945a4430bb29f4faa49c2375b from peer a84338b8d24e453faa8e3e7567a2214b ({username='slave'} at 127.25.69.66:55411)
I20240503 14:16:16.705478 30754 tablet_copy_client.cc:523] T ae7995ab6cab4473936176bd918cd089 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 14:16:16.705505 30668 tablet_copy_service.cc:161] P 9923003d760c40969bbf265fceed3d7f: Beginning new tablet copy session on tablet aabea09945a4430bb29f4faa49c2375b from peer a84338b8d24e453faa8e3e7567a2214b at {username='slave'} at 127.25.69.66:55411: session id = a84338b8d24e453faa8e3e7567a2214b-aabea09945a4430bb29f4faa49c2375b
I20240503 14:16:16.708859 30668 tablet_copy_source_session.cc:205] T aabea09945a4430bb29f4faa49c2375b P 9923003d760c40969bbf265fceed3d7f: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 14:16:16.710743 30658 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.25.69.66:55411 (request call id 43)
I20240503 14:16:16.710839 30764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 859f3c3c03b4471d9b8cf7515b4e42ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:16.711432 30658 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.25.69.66:55411 (request call id 43)
I20240503 14:16:16.711670 30668 tablet_copy_service.cc:140] P 9923003d760c40969bbf265fceed3d7f: Received BeginTabletCopySession request for tablet be28321e9c1e4f1c964e3c3e115c88c3 from peer a84338b8d24e453faa8e3e7567a2214b ({username='slave'} at 127.25.69.66:55411)
I20240503 14:16:16.711817 30668 tablet_copy_service.cc:161] P 9923003d760c40969bbf265fceed3d7f: Beginning new tablet copy session on tablet be28321e9c1e4f1c964e3c3e115c88c3 from peer a84338b8d24e453faa8e3e7567a2214b at {username='slave'} at 127.25.69.66:55411: session id = a84338b8d24e453faa8e3e7567a2214b-be28321e9c1e4f1c964e3c3e115c88c3
I20240503 14:16:16.712368 30765 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aabea09945a4430bb29f4faa49c2375b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:16.719905 30658 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.25.69.66:55411 (request call id 46)
I20240503 14:16:16.720803 30769 tablet_copy_client.cc:308] T defc186d26e44d2e90c230792d147414 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:40957
I20240503 14:16:16.723604 30752 tablet_copy_client.cc:783] T 3233e361d51948b8afbf3aa9ec70cad1 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Starting download of 0 data blocks...
I20240503 14:16:16.725265 30658 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.25.69.66:55411 (request call id 46)
I20240503 14:16:16.725631 30752 tablet_copy_client.cc:647] T 3233e361d51948b8afbf3aa9ec70cad1 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Starting download of 1 WAL segments...
I20240503 14:16:16.726397 30658 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.25.69.66:55411 (request call id 46)
I20240503 14:16:16.726651 30668 tablet_copy_source_session.cc:205] T be28321e9c1e4f1c964e3c3e115c88c3 P 9923003d760c40969bbf265fceed3d7f: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 14:16:16.727367 30668 tablet_copy_service.cc:140] P 9923003d760c40969bbf265fceed3d7f: Received BeginTabletCopySession request for tablet 7916cb46d6864e47a4b7ac2db4ac847c from peer a84338b8d24e453faa8e3e7567a2214b ({username='slave'} at 127.25.69.66:55411)
I20240503 14:16:16.727500 30668 tablet_copy_service.cc:161] P 9923003d760c40969bbf265fceed3d7f: Beginning new tablet copy session on tablet 7916cb46d6864e47a4b7ac2db4ac847c from peer a84338b8d24e453faa8e3e7567a2214b at {username='slave'} at 127.25.69.66:55411: session id = a84338b8d24e453faa8e3e7567a2214b-7916cb46d6864e47a4b7ac2db4ac847c
I20240503 14:16:16.730538 30668 tablet_copy_source_session.cc:205] T 7916cb46d6864e47a4b7ac2db4ac847c P 9923003d760c40969bbf265fceed3d7f: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 14:16:16.737434 30759 tablet_copy_client.cc:308] T ac007594566a4b60b0c496e31c78c623 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Beginning tablet copy session from remote peer at address 127.25.69.65:40957
I20240503 14:16:16.738258 30668 tablet_copy_service.cc:140] P 9923003d760c40969bbf265fceed3d7f: Received BeginTabletCopySession request for tablet ac007594566a4b60b0c496e31c78c623 from peer a84338b8d24e453faa8e3e7567a2214b ({username='slave'} at 127.25.69.66:55411)
I20240503 14:16:16.738425 30668 tablet_copy_service.cc:161] P 9923003d760c40969bbf265fceed3d7f: Beginning new tablet copy session on tablet ac007594566a4b60b0c496e31c78c623 from peer a84338b8d24e453faa8e3e7567a2214b at {username='slave'} at 127.25.69.66:55411: session id = a84338b8d24e453faa8e3e7567a2214b-ac007594566a4b60b0c496e31c78c623
I20240503 14:16:16.738757 30758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be28321e9c1e4f1c964e3c3e115c88c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:16.741961 30668 tablet_copy_source_session.cc:205] T ac007594566a4b60b0c496e31c78c623 P 9923003d760c40969bbf265fceed3d7f: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 14:16:16.742092 30767 tablet_bootstrap.cc:492] T 8b77fcd79c314d7783cbd9950f793f9e P a84338b8d24e453faa8e3e7567a2214b: Bootstrap starting.
I20240503 14:16:16.742516 30668 tablet_copy_service.cc:140] P 9923003d760c40969bbf265fceed3d7f: Received BeginTabletCopySession request for tablet defc186d26e44d2e90c230792d147414 from peer a84338b8d24e453faa8e3e7567a2214b ({username='slave'} at 127.25.69.66:55411)
I20240503 14:16:16.742662 30668 tablet_copy_service.cc:161] P 9923003d760c40969bbf265fceed3d7f: Beginning new tablet copy session on tablet defc186d26e44d2e90c230792d147414 from peer a84338b8d24e453faa8e3e7567a2214b at {username='slave'} at 127.25.69.66:55411: session id = a84338b8d24e453faa8e3e7567a2214b-defc186d26e44d2e90c230792d147414
I20240503 14:16:16.745414 30762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7916cb46d6864e47a4b7ac2db4ac847c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:16.746245 30658 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.25.69.66:55411 (request call id 52)
I20240503 14:16:16.747583 30668 tablet_copy_source_session.cc:205] T defc186d26e44d2e90c230792d147414 P 9923003d760c40969bbf265fceed3d7f: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 14:16:16.755035 30759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac007594566a4b60b0c496e31c78c623. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:16.758280 30769 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet defc186d26e44d2e90c230792d147414. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:16.759276 30768 tablet_bootstrap.cc:492] T c4dba4295ef04b1faa3a453df4615413 P a84338b8d24e453faa8e3e7567a2214b: Bootstrap starting.
I20240503 14:16:16.762514 30765 tablet_copy_client.cc:783] T aabea09945a4430bb29f4faa49c2375b P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Starting download of 0 data blocks...
I20240503 14:16:16.762717 30765 tablet_copy_client.cc:647] T aabea09945a4430bb29f4faa49c2375b P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Starting download of 1 WAL segments...
I20240503 14:16:16.764552 30761 tablet_copy_client.cc:783] T 1b11f4b5593548918661202d9f11b821 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Starting download of 0 data blocks...
I20240503 14:16:16.764757 30761 tablet_copy_client.cc:647] T 1b11f4b5593548918661202d9f11b821 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Starting download of 1 WAL segments...
I20240503 14:16:16.772955 30754 tablet_bootstrap.cc:492] T ae7995ab6cab4473936176bd918cd089 P a84338b8d24e453faa8e3e7567a2214b: Bootstrap starting.
I20240503 14:16:16.776957 30763 tablet_bootstrap.cc:492] T c65ec6569c1541218bb6d7b5d3def67a P a84338b8d24e453faa8e3e7567a2214b: Bootstrap starting.
I20240503 14:16:16.781433 30766 tablet_copy_client.cc:523] T 82359eb6be094060bdcab46c04d27fc6 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 14:16:16.782217 30658 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.25.69.66:55411 (request call id 55)
I20240503 14:16:16.782840 30658 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.25.69.66:55411 (request call id 55)
I20240503 14:16:16.783277 30658 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.25.69.66:55411 (request call id 55)
I20240503 14:16:16.783567 30658 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.25.69.66:55411 (request call id 55)
I20240503 14:16:16.784312 30668 tablet_copy_service.cc:140] P 9923003d760c40969bbf265fceed3d7f: Received BeginTabletCopySession request for tablet 9b85b747e67f4aa0bb0421ea5c8182b7 from peer a84338b8d24e453faa8e3e7567a2214b ({username='slave'} at 127.25.69.66:55411)
I20240503 14:16:16.784503 30668 tablet_copy_service.cc:161] P 9923003d760c40969bbf265fceed3d7f: Beginning new tablet copy session on tablet 9b85b747e67f4aa0bb0421ea5c8182b7 from peer a84338b8d24e453faa8e3e7567a2214b at {username='slave'} at 127.25.69.66:55411: session id = a84338b8d24e453faa8e3e7567a2214b-9b85b747e67f4aa0bb0421ea5c8182b7
I20240503 14:16:16.788635 30668 tablet_copy_source_session.cc:205] T 9b85b747e67f4aa0bb0421ea5c8182b7 P 9923003d760c40969bbf265fceed3d7f: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 14:16:16.796155 30766 tablet_bootstrap.cc:492] T 82359eb6be094060bdcab46c04d27fc6 P a84338b8d24e453faa8e3e7567a2214b: Bootstrap starting.
I20240503 14:16:16.812738 30756 tablet_copy_client.cc:523] T 132d1335591e4170b1030c93fba9a79f P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 14:16:16.813859 30764 tablet_copy_client.cc:783] T 859f3c3c03b4471d9b8cf7515b4e42ca P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Starting download of 0 data blocks...
I20240503 14:16:16.818295 30759 tablet_copy_client.cc:783] T ac007594566a4b60b0c496e31c78c623 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Starting download of 0 data blocks...
I20240503 14:16:16.818977 30658 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.25.69.66:55411 (request call id 62)
I20240503 14:16:16.823216 30757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b85b747e67f4aa0bb0421ea5c8182b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:16:16.824734 30764 tablet_copy_client.cc:647] T 859f3c3c03b4471d9b8cf7515b4e42ca P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Starting download of 1 WAL segments...
I20240503 14:16:16.832302 30762 tablet_copy_client.cc:783] T 7916cb46d6864e47a4b7ac2db4ac847c P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Starting download of 0 data blocks...
I20240503 14:16:16.833220 30758 tablet_copy_client.cc:783] T be28321e9c1e4f1c964e3c3e115c88c3 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Starting download of 0 data blocks...
I20240503 14:16:16.834141 30762 tablet_copy_client.cc:647] T 7916cb46d6864e47a4b7ac2db4ac847c P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Starting download of 1 WAL segments...
I20240503 14:16:16.834425 30759 tablet_copy_client.cc:647] T ac007594566a4b60b0c496e31c78c623 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Starting download of 1 WAL segments...
I20240503 14:16:16.844506 30758 tablet_copy_client.cc:647] T be28321e9c1e4f1c964e3c3e115c88c3 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Starting download of 1 WAL segments...
I20240503 14:16:16.856734 30756 tablet_bootstrap.cc:492] T 132d1335591e4170b1030c93fba9a79f P a84338b8d24e453faa8e3e7567a2214b: Bootstrap starting.
I20240503 14:16:16.883608 30765 tablet_copy_client.cc:523] T aabea09945a4430bb29f4faa49c2375b P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
@ 0x7ff067ba48de kudu::tserver::TabletCopyClient::TabletCopyClient() at ??:0
I20240503 14:16:16.892016 30769 tablet_copy_client.cc:783] T defc186d26e44d2e90c230792d147414 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Starting download of 0 data blocks...
I20240503 14:16:16.903115 30769 tablet_copy_client.cc:647] T defc186d26e44d2e90c230792d147414 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Starting download of 1 WAL segments...
I20240503 14:16:16.914690 30658 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.25.69.66:55411 (request call id 64)
I20240503 14:16:16.915189 30658 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.25.69.66:55411 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.25.69.66:55411 (request call id 67)
I20240503 14:16:16.918370 30764 tablet_copy_client.cc:523] T 859f3c3c03b4471d9b8cf7515b4e42ca P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 14:16:16.919137 30759 tablet_copy_client.cc:523] T ac007594566a4b60b0c496e31c78c623 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 14:16:16.920120 30761 tablet_copy_client.cc:523] T 1b11f4b5593548918661202d9f11b821 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 14:16:16.920735 30765 tablet_bootstrap.cc:492] T aabea09945a4430bb29f4faa49c2375b P a84338b8d24e453faa8e3e7567a2214b: Bootstrap starting.
I20240503 14:16:16.921334 30752 tablet_copy_client.cc:523] T 3233e361d51948b8afbf3aa9ec70cad1 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 14:16:16.928440 30762 tablet_copy_client.cc:523] T 7916cb46d6864e47a4b7ac2db4ac847c P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 14:16:16.929164 30758 tablet_copy_client.cc:523] T be28321e9c1e4f1c964e3c3e115c88c3 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 14:16:16.930606 30761 tablet_bootstrap.cc:492] T 1b11f4b5593548918661202d9f11b821 P a84338b8d24e453faa8e3e7567a2214b: Bootstrap starting.
I20240503 14:16:16.931839 30769 tablet_copy_client.cc:523] T defc186d26e44d2e90c230792d147414 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 14:16:16.934357 30757 tablet_copy_client.cc:783] T 9b85b747e67f4aa0bb0421ea5c8182b7 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Starting download of 0 data blocks...
I20240503 14:16:16.943624 30752 tablet_bootstrap.cc:492] T 3233e361d51948b8afbf3aa9ec70cad1 P a84338b8d24e453faa8e3e7567a2214b: Bootstrap starting.
I20240503 14:16:16.946225 30770 tablet_copy_client.cc:523] T 6426b3d51deb401d9c1641609bc8abe6 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
@ 0x7ff067bbcdaf kudu::tserver::RemoteTabletCopyClient::RemoteTabletCopyClient() at ??:0
I20240503 14:16:16.951606 30757 tablet_copy_client.cc:647] T 9b85b747e67f4aa0bb0421ea5c8182b7 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Starting download of 1 WAL segments...
@ 0x7ff067ce7480 kudu::tserver::TSTabletManager::RunTabletCopy() at ??:0
I20240503 14:16:16.963654 30759 tablet_bootstrap.cc:492] T ac007594566a4b60b0c496e31c78c623 P a84338b8d24e453faa8e3e7567a2214b: Bootstrap starting.
I20240503 14:16:16.968050 30762 tablet_bootstrap.cc:492] T 7916cb46d6864e47a4b7ac2db4ac847c P a84338b8d24e453faa8e3e7567a2214b: Bootstrap starting.
I20240503 14:16:16.978813 30758 tablet_bootstrap.cc:492] T be28321e9c1e4f1c964e3c3e115c88c3 P a84338b8d24e453faa8e3e7567a2214b: Bootstrap starting.
I20240503 14:16:16.994431 30764 tablet_bootstrap.cc:492] T 859f3c3c03b4471d9b8cf7515b4e42ca P a84338b8d24e453faa8e3e7567a2214b: Bootstrap starting.
I20240503 14:16:16.995863 30769 tablet_bootstrap.cc:492] T defc186d26e44d2e90c230792d147414 P a84338b8d24e453faa8e3e7567a2214b: Bootstrap starting.
I20240503 14:16:17.000923 30770 tablet_bootstrap.cc:492] T 6426b3d51deb401d9c1641609bc8abe6 P a84338b8d24e453faa8e3e7567a2214b: Bootstrap starting.
I20240503 14:16:17.011034 30757 tablet_copy_client.cc:523] T 9b85b747e67f4aa0bb0421ea5c8182b7 P a84338b8d24e453faa8e3e7567a2214b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 14:16:17.041477 30757 tablet_bootstrap.cc:492] T 9b85b747e67f4aa0bb0421ea5c8182b7 P a84338b8d24e453faa8e3e7567a2214b: Bootstrap starting.
@ 0x7ff067d1fa8d kudu::tserver::TabletCopyRunnable::Run() at ??:0
@ 0x7ff067d02981 kudu::tserver::TSTabletManager::StartTabletCopy()::$_12::operator()() at ??:0
@ 0x7ff067d0270e std::_Function_handler<>::_M_invoke() at ??:0
@ 0xa60bcd std::function<>::operator()() at ??:?
@ 0x7ff05875ab75 kudu::ThreadPool::DispatchThread() at ??:0
I20240503 14:16:17.255733 30763 log.cc:824] T c65ec6569c1541218bb6d7b5d3def67a P a84338b8d24e453faa8e3e7567a2214b: Log is configured to *not* fsync() on all Append() calls
@ 0x7ff05875e19c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7ff05875e019 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xa60bcd std::function<>::operator()() at ??:?
@ 0x7ff05873901e kudu::Thread::SuperviseThread() at ??:0
@ 0x7ff05babe6db start_thread at ??:0
@ 0x7ff0548fc71f clone at ??:0
W20240503 14:16:17.596791 29937 connection.cc:535] client connection to 127.25.69.66:37477 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
F20240503 14:16:17.597657 30750 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: F20240503 14:16:17.597635 30747 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
F20240503 14:16:17.597657 30750 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: F20240503 14:16:17.597635 30747 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 14:16:17.597611 3*** Check failure stack trace: ***
*** Aborted at 1714745777 (unix time) try "date -d @1714745777" if you are using GNU date ***
F20240503 14:16:17.597604 30751 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
F20240503 14:16:17.597657 30750 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: F20240503 14:16:17.597635 30747 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 14:16:17.597611 30749 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e800006515) received by PID 25877 (TID 0x7f68ce560700) from PID 25877; stack trace: ***
@ 0x7f68e8ec1980 (unknown) at ??:0
@ 0x7f68e1f6cfb7 gsignal at ??:0
@ 0x7f68e1f6e921 abort at ??:0
@ 0x7f68e4c95dcd google::LogMessage::Fail() at ??:0
@ 0x7f68e4c99b93 google::LogMessage::SendToLog() at ??:0
@ 0x7f68e4c957cc google::LogMessage::Flush() at ??:0
@ 0x7f68e4c96f59 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x3b9874 kudu::TabletCopyClientSessionITest_TestTabletCopyWithBusySource_Test::TestBody()::$_3::operator()() at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/tablet_copy_client_session-itest.cc:313
@ 0x3b926e std::__invoke_impl<>() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/invoke.h:60
@ 0x3b91ee std::__invoke<>() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/invoke.h:95
@ 0x3b91b3 _ZNSt6thread8_InvokerISt5tupleIJZN4kudu62TabletCopyClientSessionITest_TestTabletCopyWithBusySource_Test8TestBodyEvE3$_3EEE9_M_invokeIJLm0EEEEDTclsr3stdE8__invokespcl10_S_declvalIXT_EEEEESt12_Index_tupleIJXspT_EEE at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:234
@ 0x3b917e std::thread::_Invoker<>::operator()() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:243
@ 0x3b9069 std::thread::_State_impl<>::_M_run() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:186
@ 0x7f68e25f66df (unknown) at ??:0
@ 0x7f68e8eb66db start_thread at ??:0
@ 0x7f68e204f71f clone at ??:0