[==========] Running 5 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 5 tests from TabletCopyClientSessionITest
[ RUN ] TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping
2024-05-02T02:00:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-02T02:00:41Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20240502 02:00:41.990700 16703 external_mini_cluster.cc:1326] Running /tmp/dist-test-task3rm6An/build/debug/bin/kudu
/tmp/dist-test-task3rm6An/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.79.254:35511
--webserver_interface=127.16.79.254
--webserver_port=0
--builtin_ntp_servers=127.16.79.212:44323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.79.254:35511
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240502 02:00:42.085045 16711 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 02:00:42.085207 16711 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 02:00:42.085242 16711 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 02:00:42.088068 16711 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 02:00:42.088111 16711 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 02:00:42.088128 16711 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 02:00:42.088151 16711 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 02:00:42.091578 16711 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.79.212:44323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.16.79.254:35511
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.79.254:35511
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.79.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.16711
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 02:00:42.092204 16711 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 02:00:42.093067 16711 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 02:00:42.099572 16719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 02:00:42.100157 16711 server_base.cc:1034] running on GCE node
W20240502 02:00:42.100427 16717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:42.100759 16716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 02:00:42.101154 16711 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 02:00:42.101919 16711 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 02:00:42.103057 16711 hybrid_clock.cc:648] HybridClock initialized: now 1714615242103047 us; error 23 us; skew 500 ppm
I20240502 02:00:42.108695 16711 webserver.cc:460] Webserver started at http://127.16.79.254:33875/ using document root <none> and password file <none>
I20240502 02:00:42.109115 16711 fs_manager.cc:359] Metadata directory not provided
I20240502 02:00:42.109160 16711 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 02:00:42.109301 16711 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 02:00:42.110677 16711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/master-0/data/instance:
uuid: "8abb3a8e3b664cb896ce7dc005742b98"
format_stamp: "Formatted at 2024-05-02 02:00:42 on dist-test-slave-tj0m"
I20240502 02:00:42.111049 16711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/master-0/wal/instance:
uuid: "8abb3a8e3b664cb896ce7dc005742b98"
format_stamp: "Formatted at 2024-05-02 02:00:42 on dist-test-slave-tj0m"
I20240502 02:00:42.113727 16711 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20240502 02:00:42.115624 16725 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:42.116443 16711 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:42.116529 16711 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/master-0/data,/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/master-0/wal
uuid: "8abb3a8e3b664cb896ce7dc005742b98"
format_stamp: "Formatted at 2024-05-02 02:00:42 on dist-test-slave-tj0m"
I20240502 02:00:42.116590 16711 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 02:00:42.145088 16711 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 02:00:42.145534 16711 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 02:00:42.145641 16711 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 02:00:42.151302 16711 rpc_server.cc:307] RPC server started. Bound to: 127.16.79.254:35511
I20240502 02:00:42.151311 16778 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.79.254:35511 every 8 connection(s)
I20240502 02:00:42.152067 16711 server_base.cc:1166] Dumped server information to /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/master-0/data/info.pb
I20240502 02:00:42.154268 16779 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:42.154929 16703 external_mini_cluster.cc:1388] Started /tmp/dist-test-task3rm6An/build/debug/bin/kudu as pid 16711
I20240502 02:00:42.155031 16703 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/master-0/wal/instance
I20240502 02:00:42.159090 16779 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98: Bootstrap starting.
I20240502 02:00:42.160859 16779 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98: Neither blocks nor log segments found. Creating new log.
I20240502 02:00:42.161461 16779 log.cc:824] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98: Log is configured to *not* fsync() on all Append() calls
I20240502 02:00:42.162802 16779 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98: No bootstrap required, opened a new log
I20240502 02:00:42.165032 16779 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8abb3a8e3b664cb896ce7dc005742b98" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 35511 } }
I20240502 02:00:42.165187 16779 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 02:00:42.165243 16779 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8abb3a8e3b664cb896ce7dc005742b98, State: Initialized, Role: FOLLOWER
I20240502 02:00:42.165616 16779 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8abb3a8e3b664cb896ce7dc005742b98" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 35511 } }
I20240502 02:00:42.165760 16779 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:42.165822 16779 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:42.165930 16779 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98 [term 0 FOLLOWER]: Advancing to term 1
I20240502 02:00:42.166688 16779 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8abb3a8e3b664cb896ce7dc005742b98" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 35511 } }
I20240502 02:00:42.167012 16779 leader_election.cc:302] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8abb3a8e3b664cb896ce7dc005742b98; no voters:
I20240502 02:00:42.167275 16779 leader_election.cc:288] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 02:00:42.167613 16784 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 02:00:42.167809 16784 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98 [term 1 LEADER]: Becoming Leader. State: Replica: 8abb3a8e3b664cb896ce7dc005742b98, State: Running, Role: LEADER
I20240502 02:00:42.168102 16784 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8abb3a8e3b664cb896ce7dc005742b98" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 35511 } }
I20240502 02:00:42.168267 16779 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98 [sys.catalog]: configured and running, proceeding with master startup.
I20240502 02:00:42.169606 16785 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8abb3a8e3b664cb896ce7dc005742b98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8abb3a8e3b664cb896ce7dc005742b98" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 35511 } } }
I20240502 02:00:42.169719 16785 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98 [sys.catalog]: This master's current role is: LEADER
I20240502 02:00:42.169587 16786 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8abb3a8e3b664cb896ce7dc005742b98. Latest consensus state: current_term: 1 leader_uuid: "8abb3a8e3b664cb896ce7dc005742b98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8abb3a8e3b664cb896ce7dc005742b98" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 35511 } } }
I20240502 02:00:42.169991 16786 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98 [sys.catalog]: This master's current role is: LEADER
I20240502 02:00:42.170034 16795 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 02:00:42.172328 16795 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 02:00:42.176417 16795 catalog_manager.cc:1347] Generated new cluster ID: f9af34f15f0241caa3466362275ca5ca
I20240502 02:00:42.176474 16795 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 02:00:42.182086 16795 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 02:00:42.182772 16795 catalog_manager.cc:1504] Loading token signing keys...
I20240502 02:00:42.189720 16795 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98: Generated new TSK 0
I20240502 02:00:42.190239 16795 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 02:00:42.199267 16703 external_mini_cluster.cc:1326] Running /tmp/dist-test-task3rm6An/build/debug/bin/kudu
/tmp/dist-test-task3rm6An/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.79.193:0
--local_ip_for_outbound_sockets=127.16.79.193
--webserver_interface=127.16.79.193
--webserver_port=0
--tserver_master_addrs=127.16.79.254:35511
--builtin_ntp_servers=127.16.79.212:44323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240502 02:00:42.294077 16803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 02:00:42.294236 16803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 02:00:42.294275 16803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 02:00:42.297185 16803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 02:00:42.297278 16803 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.79.193
I20240502 02:00:42.300652 16803 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.79.212:44323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.79.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.79.193
--webserver_port=0
--tserver_master_addrs=127.16.79.254:35511
--never_fsync=true
--heap_profile_path=/tmp/kudu.16803
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.79.193
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 02:00:42.301313 16803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 02:00:42.302244 16803 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 02:00:42.309636 16808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:42.310015 16809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:42.310534 16811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 02:00:42.311058 16803 server_base.cc:1034] running on GCE node
I20240502 02:00:42.311344 16803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 02:00:42.311790 16803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 02:00:42.312924 16803 hybrid_clock.cc:648] HybridClock initialized: now 1714615242312908 us; error 36 us; skew 500 ppm
I20240502 02:00:42.314520 16803 webserver.cc:460] Webserver started at http://127.16.79.193:44157/ using document root <none> and password file <none>
I20240502 02:00:42.314977 16803 fs_manager.cc:359] Metadata directory not provided
I20240502 02:00:42.315032 16803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 02:00:42.315174 16803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 02:00:42.316536 16803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/data/instance:
uuid: "8eca624f1c9147d29ad9449bbe4e7169"
format_stamp: "Formatted at 2024-05-02 02:00:42 on dist-test-slave-tj0m"
I20240502 02:00:42.316946 16803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/wal/instance:
uuid: "8eca624f1c9147d29ad9449bbe4e7169"
format_stamp: "Formatted at 2024-05-02 02:00:42 on dist-test-slave-tj0m"
I20240502 02:00:42.319887 16803 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20240502 02:00:42.321688 16817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:42.322547 16803 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20240502 02:00:42.322640 16803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/data,/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/wal
uuid: "8eca624f1c9147d29ad9449bbe4e7169"
format_stamp: "Formatted at 2024-05-02 02:00:42 on dist-test-slave-tj0m"
I20240502 02:00:42.322716 16803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 02:00:42.331997 16803 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 02:00:42.332439 16803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 02:00:42.332561 16803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 02:00:42.332983 16803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 02:00:42.333711 16803 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 02:00:42.333791 16803 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:42.333829 16803 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 02:00:42.333851 16803 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:42.341081 16803 rpc_server.cc:307] RPC server started. Bound to: 127.16.79.193:38343
I20240502 02:00:42.341130 16931 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.79.193:38343 every 8 connection(s)
I20240502 02:00:42.341840 16803 server_base.cc:1166] Dumped server information to /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/data/info.pb
I20240502 02:00:42.343323 16703 external_mini_cluster.cc:1388] Started /tmp/dist-test-task3rm6An/build/debug/bin/kudu as pid 16803
I20240502 02:00:42.343412 16703 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/wal/instance
I20240502 02:00:42.345364 16703 external_mini_cluster.cc:1326] Running /tmp/dist-test-task3rm6An/build/debug/bin/kudu
/tmp/dist-test-task3rm6An/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.79.194:0
--local_ip_for_outbound_sockets=127.16.79.194
--webserver_interface=127.16.79.194
--webserver_port=0
--tserver_master_addrs=127.16.79.254:35511
--builtin_ntp_servers=127.16.79.212:44323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240502 02:00:42.350101 16932 heartbeater.cc:347] Connected to a master server at 127.16.79.254:35511
I20240502 02:00:42.350286 16932 heartbeater.cc:464] Registering TS with master...
I20240502 02:00:42.350723 16932 heartbeater.cc:511] Master 127.16.79.254:35511 requested a full tablet report, sending...
I20240502 02:00:42.352077 16742 ts_manager.cc:194] Registered new tserver with Master: 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:42.353600 16742 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.79.193:42119
W20240502 02:00:42.443213 16935 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 02:00:42.443372 16935 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 02:00:42.443409 16935 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 02:00:42.446270 16935 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 02:00:42.446354 16935 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.79.194
I20240502 02:00:42.449662 16935 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.79.212:44323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.79.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.79.194
--webserver_port=0
--tserver_master_addrs=127.16.79.254:35511
--never_fsync=true
--heap_profile_path=/tmp/kudu.16935
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.79.194
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 02:00:42.450289 16935 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 02:00:42.451166 16935 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 02:00:42.457855 16941 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:42.458261 16940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:42.458519 16943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 02:00:42.459182 16935 server_base.cc:1034] running on GCE node
I20240502 02:00:42.459460 16935 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 02:00:42.459865 16935 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 02:00:42.460999 16935 hybrid_clock.cc:648] HybridClock initialized: now 1714615242460989 us; error 22 us; skew 500 ppm
I20240502 02:00:42.462489 16935 webserver.cc:460] Webserver started at http://127.16.79.194:45971/ using document root <none> and password file <none>
I20240502 02:00:42.462922 16935 fs_manager.cc:359] Metadata directory not provided
I20240502 02:00:42.462970 16935 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 02:00:42.463119 16935 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 02:00:42.464437 16935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data/instance:
uuid: "c71d0db6ea364ba5ac0646bb1eb5b87d"
format_stamp: "Formatted at 2024-05-02 02:00:42 on dist-test-slave-tj0m"
I20240502 02:00:42.464839 16935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/wal/instance:
uuid: "c71d0db6ea364ba5ac0646bb1eb5b87d"
format_stamp: "Formatted at 2024-05-02 02:00:42 on dist-test-slave-tj0m"
I20240502 02:00:42.467557 16935 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20240502 02:00:42.469409 16949 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:42.470311 16935 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:42.470400 16935 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data,/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/wal
uuid: "c71d0db6ea364ba5ac0646bb1eb5b87d"
format_stamp: "Formatted at 2024-05-02 02:00:42 on dist-test-slave-tj0m"
I20240502 02:00:42.470471 16935 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 02:00:42.487151 16935 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 02:00:42.487551 16935 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 02:00:42.487673 16935 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 02:00:42.488065 16935 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 02:00:42.488749 16935 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 02:00:42.488793 16935 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:42.488838 16935 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 02:00:42.488863 16935 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:42.496260 16935 rpc_server.cc:307] RPC server started. Bound to: 127.16.79.194:42067
I20240502 02:00:42.496304 17062 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.79.194:42067 every 8 connection(s)
I20240502 02:00:42.496968 16935 server_base.cc:1166] Dumped server information to /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data/info.pb
I20240502 02:00:42.499729 16703 external_mini_cluster.cc:1388] Started /tmp/dist-test-task3rm6An/build/debug/bin/kudu as pid 16935
I20240502 02:00:42.499825 16703 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/wal/instance
I20240502 02:00:42.504727 17063 heartbeater.cc:347] Connected to a master server at 127.16.79.254:35511
I20240502 02:00:42.504884 17063 heartbeater.cc:464] Registering TS with master...
I20240502 02:00:42.505261 17063 heartbeater.cc:511] Master 127.16.79.254:35511 requested a full tablet report, sending...
I20240502 02:00:42.506052 16742 ts_manager.cc:194] Registered new tserver with Master: c71d0db6ea364ba5ac0646bb1eb5b87d (127.16.79.194:42067)
I20240502 02:00:42.506561 16742 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.79.194:49227
I20240502 02:00:42.513607 16703 external_mini_cluster.cc:930] 2 TS(s) registered with all masters
I20240502 02:00:42.521775 16703 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task3rm6An/build/debug/bin/kudu with pid 16935
I20240502 02:00:42.528103 16703 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task3rm6An/build/debug/bin/kudu with pid 16711
I20240502 02:00:42.533888 16703 external_mini_cluster.cc:1326] Running /tmp/dist-test-task3rm6An/build/debug/bin/kudu
/tmp/dist-test-task3rm6An/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.79.254:35511
--webserver_interface=127.16.79.254
--webserver_port=33875
--builtin_ntp_servers=127.16.79.212:44323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.79.254:35511
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240502 02:00:42.628999 17071 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 02:00:42.629173 17071 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 02:00:42.629222 17071 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 02:00:42.632113 17071 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 02:00:42.632170 17071 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 02:00:42.632196 17071 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 02:00:42.632220 17071 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 02:00:42.635640 17071 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.79.212:44323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.16.79.254:35511
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.79.254:35511
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.79.254
--webserver_port=33875
--never_fsync=true
--heap_profile_path=/tmp/kudu.17071
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 02:00:42.636301 17071 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 02:00:42.637205 17071 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 02:00:42.643280 17079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:42.643658 17077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:42.644201 17076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 02:00:42.644762 17071 server_base.cc:1034] running on GCE node
I20240502 02:00:42.645184 17071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 02:00:42.645931 17071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 02:00:42.647079 17071 hybrid_clock.cc:648] HybridClock initialized: now 1714615242647066 us; error 25 us; skew 500 ppm
I20240502 02:00:42.648635 17071 webserver.cc:460] Webserver started at http://127.16.79.254:33875/ using document root <none> and password file <none>
I20240502 02:00:42.649096 17071 fs_manager.cc:359] Metadata directory not provided
I20240502 02:00:42.649163 17071 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 02:00:42.652027 17071 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:42.653643 17085 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:42.654493 17071 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:42.654599 17071 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/master-0/data,/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/master-0/wal
uuid: "8abb3a8e3b664cb896ce7dc005742b98"
format_stamp: "Formatted at 2024-05-02 02:00:42 on dist-test-slave-tj0m"
I20240502 02:00:42.654927 17071 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 02:00:42.673403 17071 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 02:00:42.673924 17071 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 02:00:42.674059 17071 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 02:00:42.679734 17137 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.79.254:35511 every 8 connection(s)
I20240502 02:00:42.679731 17071 rpc_server.cc:307] RPC server started. Bound to: 127.16.79.254:35511
I20240502 02:00:42.680621 17071 server_base.cc:1166] Dumped server information to /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/master-0/data/info.pb
I20240502 02:00:42.684093 17138 sys_catalog.cc:263] Verifying existing consensus state
I20240502 02:00:42.685340 17138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98: Bootstrap starting.
I20240502 02:00:42.687775 16703 external_mini_cluster.cc:1388] Started /tmp/dist-test-task3rm6An/build/debug/bin/kudu as pid 17071
I20240502 02:00:42.698511 17138 log.cc:824] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98: Log is configured to *not* fsync() on all Append() calls
I20240502 02:00:42.703446 17138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 02:00:42.703730 17138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98: Bootstrap complete.
I20240502 02:00:42.706670 17138 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8abb3a8e3b664cb896ce7dc005742b98" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 35511 } }
I20240502 02:00:42.707046 17138 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8abb3a8e3b664cb896ce7dc005742b98, State: Initialized, Role: FOLLOWER
I20240502 02:00:42.707471 17138 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8abb3a8e3b664cb896ce7dc005742b98" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 35511 } }
I20240502 02:00:42.707623 17138 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:42.707682 17138 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:42.707756 17138 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98 [term 1 FOLLOWER]: Advancing to term 2
I20240502 02:00:42.709089 17138 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8abb3a8e3b664cb896ce7dc005742b98" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 35511 } }
I20240502 02:00:42.709352 17138 leader_election.cc:302] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8abb3a8e3b664cb896ce7dc005742b98; no voters:
I20240502 02:00:42.709554 17138 leader_election.cc:288] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 02:00:42.709650 17143 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 02:00:42.709898 17143 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98 [term 2 LEADER]: Becoming Leader. State: Replica: 8abb3a8e3b664cb896ce7dc005742b98, State: Running, Role: LEADER
I20240502 02:00:42.710158 17143 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8abb3a8e3b664cb896ce7dc005742b98" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 35511 } }
I20240502 02:00:42.710440 17138 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98 [sys.catalog]: configured and running, proceeding with master startup.
I20240502 02:00:42.710880 17145 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8abb3a8e3b664cb896ce7dc005742b98. Latest consensus state: current_term: 2 leader_uuid: "8abb3a8e3b664cb896ce7dc005742b98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8abb3a8e3b664cb896ce7dc005742b98" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 35511 } } }
I20240502 02:00:42.710974 17145 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98 [sys.catalog]: This master's current role is: LEADER
I20240502 02:00:42.711310 17148 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 02:00:42.711485 17144 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "8abb3a8e3b664cb896ce7dc005742b98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8abb3a8e3b664cb896ce7dc005742b98" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 35511 } } }
I20240502 02:00:42.711577 17144 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98 [sys.catalog]: This master's current role is: LEADER
I20240502 02:00:42.713783 17148 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 02:00:42.714432 17148 catalog_manager.cc:1259] Loaded cluster ID: f9af34f15f0241caa3466362275ca5ca
I20240502 02:00:42.714478 17148 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 02:00:42.716075 17148 catalog_manager.cc:1504] Loading token signing keys...
I20240502 02:00:42.716651 17148 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8abb3a8e3b664cb896ce7dc005742b98: Loaded TSK: 0
I20240502 02:00:42.717489 17148 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 02:00:43.355463 16932 heartbeater.cc:503] Master 127.16.79.254:35511 was elected leader, sending a full tablet report...
I20240502 02:00:43.359584 17102 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "8eca624f1c9147d29ad9449bbe4e7169" instance_seqno: 1714615242339175) as {username='slave'} at 127.16.79.193:42569; Asking this server to re-register.
I20240502 02:00:43.360090 16932 heartbeater.cc:464] Registering TS with master...
I20240502 02:00:43.360240 16932 heartbeater.cc:511] Master 127.16.79.254:35511 requested a full tablet report, sending...
I20240502 02:00:43.361060 17102 ts_manager.cc:194] Registered new tserver with Master: 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:43.364565 16703 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20240502 02:00:43.364683 16703 test_util.cc:268] Using random seed: -125707959
I20240502 02:00:43.380753 17102 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46108:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20240502 02:00:43.401595 16865 tablet_service.cc:1467] Processing CreateTablet for tablet 8986350f57d240be8b7660810e6ff8ce (DEFAULT_TABLE table=test-workload [id=83deff8b404047cbb643915466591e69]), partition=RANGE (key) PARTITION UNBOUNDED
I20240502 02:00:43.402583 16865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8986350f57d240be8b7660810e6ff8ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:43.407696 17173 tablet_bootstrap.cc:492] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169: Bootstrap starting.
I20240502 02:00:43.409415 17173 tablet_bootstrap.cc:654] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169: Neither blocks nor log segments found. Creating new log.
I20240502 02:00:43.410106 17173 log.cc:824] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169: Log is configured to *not* fsync() on all Append() calls
I20240502 02:00:43.411484 17173 tablet_bootstrap.cc:492] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169: No bootstrap required, opened a new log
I20240502 02:00:43.411633 17173 ts_tablet_manager.cc:1367] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240502 02:00:43.414393 17173 raft_consensus.cc:348] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eca624f1c9147d29ad9449bbe4e7169" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 38343 } }
I20240502 02:00:43.414541 17173 raft_consensus.cc:374] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 02:00:43.414590 17173 raft_consensus.cc:729] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8eca624f1c9147d29ad9449bbe4e7169, State: Initialized, Role: FOLLOWER
I20240502 02:00:43.414995 17173 consensus_queue.cc:260] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eca624f1c9147d29ad9449bbe4e7169" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 38343 } }
I20240502 02:00:43.415103 17173 raft_consensus.cc:388] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:43.415163 17173 raft_consensus.cc:482] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:43.415259 17173 raft_consensus.cc:3037] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [term 0 FOLLOWER]: Advancing to term 1
I20240502 02:00:43.415908 17173 raft_consensus.cc:504] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eca624f1c9147d29ad9449bbe4e7169" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 38343 } }
I20240502 02:00:43.416188 17173 leader_election.cc:302] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8eca624f1c9147d29ad9449bbe4e7169; no voters:
I20240502 02:00:43.416414 17173 leader_election.cc:288] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 02:00:43.416524 17175 raft_consensus.cc:2781] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 02:00:43.416705 17175 raft_consensus.cc:686] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [term 1 LEADER]: Becoming Leader. State: Replica: 8eca624f1c9147d29ad9449bbe4e7169, State: Running, Role: LEADER
I20240502 02:00:43.417022 17175 consensus_queue.cc:237] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eca624f1c9147d29ad9449bbe4e7169" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 38343 } }
I20240502 02:00:43.417121 17173 ts_tablet_manager.cc:1398] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20240502 02:00:43.420449 17102 catalog_manager.cc:5484] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193). New cstate: current_term: 1 leader_uuid: "8eca624f1c9147d29ad9449bbe4e7169" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eca624f1c9147d29ad9449bbe4e7169" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 38343 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:43.806231 16703 external_mini_cluster.cc:1326] Running /tmp/dist-test-task3rm6An/build/debug/bin/kudu
/tmp/dist-test-task3rm6An/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.79.194:42067
--local_ip_for_outbound_sockets=127.16.79.194
--tserver_master_addrs=127.16.79.254:35511
--webserver_port=45971
--webserver_interface=127.16.79.194
--builtin_ntp_servers=127.16.79.212:44323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240502 02:00:43.906117 17190 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 02:00:43.906272 17190 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 02:00:43.906311 17190 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 02:00:43.909157 17190 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 02:00:43.909241 17190 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.79.194
I20240502 02:00:43.912734 17190 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.79.212:44323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.79.194:42067
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.79.194
--webserver_port=45971
--tserver_master_addrs=127.16.79.254:35511
--never_fsync=true
--heap_profile_path=/tmp/kudu.17190
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.79.194
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 02:00:43.913362 17190 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 02:00:43.914269 17190 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 02:00:43.921288 17198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:43.921662 17196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:43.922219 17195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 02:00:43.922748 17190 server_base.cc:1034] running on GCE node
I20240502 02:00:43.923041 17190 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 02:00:43.923507 17190 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 02:00:43.924646 17190 hybrid_clock.cc:648] HybridClock initialized: now 1714615243924624 us; error 37 us; skew 500 ppm
I20240502 02:00:43.926239 17190 webserver.cc:460] Webserver started at http://127.16.79.194:45971/ using document root <none> and password file <none>
I20240502 02:00:43.926724 17190 fs_manager.cc:359] Metadata directory not provided
I20240502 02:00:43.926793 17190 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 02:00:43.929651 17190 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20240502 02:00:43.931349 17204 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:43.932199 17190 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240502 02:00:43.932299 17190 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data,/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/wal
uuid: "c71d0db6ea364ba5ac0646bb1eb5b87d"
format_stamp: "Formatted at 2024-05-02 02:00:42 on dist-test-slave-tj0m"
I20240502 02:00:43.932636 17190 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 02:00:43.971516 17190 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 02:00:43.971989 17190 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 02:00:43.972129 17190 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 02:00:43.972568 17190 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 02:00:43.973330 17190 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 02:00:43.973376 17190 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:43.973423 17190 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 02:00:43.973451 17190 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:43.980891 17190 rpc_server.cc:307] RPC server started. Bound to: 127.16.79.194:42067
I20240502 02:00:43.980919 17318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.79.194:42067 every 8 connection(s)
I20240502 02:00:43.981806 17190 server_base.cc:1166] Dumped server information to /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data/info.pb
I20240502 02:00:43.989346 17319 heartbeater.cc:347] Connected to a master server at 127.16.79.254:35511
I20240502 02:00:43.989523 17319 heartbeater.cc:464] Registering TS with master...
I20240502 02:00:43.989987 17319 heartbeater.cc:511] Master 127.16.79.254:35511 requested a full tablet report, sending...
I20240502 02:00:43.990837 17100 ts_manager.cc:194] Registered new tserver with Master: c71d0db6ea364ba5ac0646bb1eb5b87d (127.16.79.194:42067)
I20240502 02:00:43.991516 16703 external_mini_cluster.cc:1388] Started /tmp/dist-test-task3rm6An/build/debug/bin/kudu as pid 17190
I20240502 02:00:43.991714 17100 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.79.194:45627
I20240502 02:00:43.993994 16703 tablet_copy_client_session-itest.cc:139] Starting loop 0
I20240502 02:00:43.994056 16703 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task3rm6An/build/debug/bin/kudu with pid 16803
I20240502 02:00:44.000190 16703 external_mini_cluster.cc:1326] Running /tmp/dist-test-task3rm6An/build/debug/bin/kudu
/tmp/dist-test-task3rm6An/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.79.193:38343
--local_ip_for_outbound_sockets=127.16.79.193
--tserver_master_addrs=127.16.79.254:35511
--webserver_port=44157
--webserver_interface=127.16.79.193
--builtin_ntp_servers=127.16.79.212:44323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240502 02:00:44.006907 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.007604 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.012374 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.012735 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.026911 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.027261 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.029986 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.030319 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.041646 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.041990 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.045565 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.045912 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.054661 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.054976 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.066711 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.067025 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.072131 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.072429 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.084839 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.085160 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.087641 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.087944 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.089193 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.089514 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.094826 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.095265 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.098197 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.098501 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
W20240502 02:00:44.104719 17328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 02:00:44.104877 17328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 02:00:44.104933 17328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 02:00:44.107832 17328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 02:00:44.107935 17328 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.79.193
I20240502 02:00:44.111388 17328 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.79.212:44323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.79.193:38343
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.79.193
--webserver_port=44157
--tserver_master_addrs=127.16.79.254:35511
--never_fsync=true
--heap_profile_path=/tmp/kudu.17328
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.79.193
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 02:00:44.112098 17328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 02:00:44.113031 17328 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20240502 02:00:44.115154 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.115494 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
W20240502 02:00:44.120455 17397 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:44.120842 17400 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:44.121402 17398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 02:00:44.121954 17328 server_base.cc:1034] running on GCE node
I20240502 02:00:44.122263 17328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 02:00:44.122690 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.122797 17328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 02:00:44.122999 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.123953 17328 hybrid_clock.cc:648] HybridClock initialized: now 1714615244123929 us; error 37 us; skew 500 ppm
I20240502 02:00:44.125408 17328 webserver.cc:460] Webserver started at http://127.16.79.193:44157/ using document root <none> and password file <none>
I20240502 02:00:44.125901 17328 fs_manager.cc:359] Metadata directory not provided
I20240502 02:00:44.125972 17328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 02:00:44.128386 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.128705 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.128940 17328 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:44.130824 17414 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:44.131579 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.131693 17328 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240502 02:00:44.131889 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.131793 17328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/data,/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/wal
uuid: "8eca624f1c9147d29ad9449bbe4e7169"
format_stamp: "Formatted at 2024-05-02 02:00:42 on dist-test-slave-tj0m"
I20240502 02:00:44.132165 17328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 02:00:44.137761 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.138082 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.146867 17328 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 02:00:44.147308 17328 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 02:00:44.147435 17328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 02:00:44.147858 17328 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 02:00:44.148644 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.148919 17430 ts_tablet_manager.cc:516] Loading tablet metadata (0/1 complete)
I20240502 02:00:44.148970 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.150624 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.150923 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.152137 17328 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240502 02:00:44.152189 17328 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.003s user 0.000s sys 0.000s
I20240502 02:00:44.152235 17328 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240502 02:00:44.153400 17328 ts_tablet_manager.cc:590] Registered 1 tablets
I20240502 02:00:44.153439 17328 ts_tablet_manager.cc:569] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20240502 02:00:44.153663 17430 tablet_bootstrap.cc:492] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169: Bootstrap starting.
I20240502 02:00:44.160907 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.161098 17328 rpc_server.cc:307] RPC server started. Bound to: 127.16.79.193:38343
I20240502 02:00:44.161221 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.161891 17544 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.79.193:38343 every 8 connection(s)
I20240502 02:00:44.162657 17328 server_base.cc:1166] Dumped server information to /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/data/info.pb
I20240502 02:00:44.164851 16703 external_mini_cluster.cc:1388] Started /tmp/dist-test-task3rm6An/build/debug/bin/kudu as pid 17328
I20240502 02:00:44.169013 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.169149 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.169632 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.171187 17550 heartbeater.cc:347] Connected to a master server at 127.16.79.254:35511
I20240502 02:00:44.171368 17550 heartbeater.cc:464] Registering TS with master...
I20240502 02:00:44.171872 17550 heartbeater.cc:511] Master 127.16.79.254:35511 requested a full tablet report, sending...
I20240502 02:00:44.173379 17100 ts_manager.cc:194] Re-registered known tserver with Master: 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.174341 17100 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.79.193:42573
I20240502 02:00:44.187665 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.188004 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.188406 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.188488 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.188555 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.188642 17430 log.cc:824] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169: Log is configured to *not* fsync() on all Append() calls
I20240502 02:00:44.189862 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.190181 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.190586 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.190654 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.190712 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.199745 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.200106 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.200482 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.200568 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.200655 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.206223 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.206578 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.206981 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.207058 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.207137 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.220746 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.221096 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.221467 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.221539 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.221616 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.234301 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.234653 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.235045 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.235133 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.235211 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.238049 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.238364 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.238734 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.238821 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.238898 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.244226 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.244568 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.244953 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.245035 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.245111 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.254469 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.254824 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.255195 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.255278 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.255352 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.264909 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.265257 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.265637 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.265722 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.265841 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.274873 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.275226 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.275597 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.275684 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.275760 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.280273 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.280642 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.281018 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.281100 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.281177 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.284678 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.284987 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.285351 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.285437 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.285516 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.291348 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.291647 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.292017 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.292105 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.292189 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.293769 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.294091 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.294559 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.294667 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.294744 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.317811 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.318149 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.318537 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.318650 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.318728 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.321092 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.321426 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.321817 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.321902 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.321979 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.332451 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.332770 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.333132 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.333221 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.333300 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.339179 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.339478 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.339854 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.339943 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.340018 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.341255 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.341567 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.341966 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.342049 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.342126 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.349511 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.349875 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.350253 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.350337 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.350414 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.369998 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.370339 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.370735 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.370822 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.370903 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.374202 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.374524 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.374895 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.374981 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.375059 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.383498 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.383831 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.384176 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.384260 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.384335 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.392918 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.393234 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.393599 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.393671 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.393774 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.413807 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.414121 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.414486 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.414557 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.414651 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.419981 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.420385 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.420760 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.420851 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.420929 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.422034 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.422364 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.422735 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.422808 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.422883 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.431294 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.431658 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.432030 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.432103 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.432186 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.436712 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.437074 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.437443 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.437515 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.437590 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.442478 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.442818 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.443194 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.443269 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.443344 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.449378 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.449752 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.450129 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.450199 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.450274 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.453073 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.453379 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.453764 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.453845 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.453922 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.458812 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.459177 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.459555 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.459627 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.459710 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.463124 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.463444 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.463817 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.463886 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.463961 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.465119 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.465426 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.465807 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.465878 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.465953 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.468462 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.468786 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.469132 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.469203 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.469277 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.471596 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.471926 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.472285 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.472355 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.472429 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.483443 17331 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.483752 17331 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.484113 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.484197 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.484267 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.491798 17329 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.492130 17329 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.492529 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.492619 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:44.492700 17518 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:51259: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:44.500870 17430 tablet_bootstrap.cc:492] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169: Bootstrap replayed 1/1 log segments. Stats: ops{read=211 overwritten=0 applied=211 ignored=0} inserts{seen=10500 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 02:00:44.501202 17430 tablet_bootstrap.cc:492] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169: Bootstrap complete.
I20240502 02:00:44.502103 17430 ts_tablet_manager.cc:1367] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169: Time spent bootstrapping tablet: real 0.349s user 0.328s sys 0.020s
I20240502 02:00:44.504084 17430 raft_consensus.cc:348] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eca624f1c9147d29ad9449bbe4e7169" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 38343 } }
I20240502 02:00:44.504405 17430 raft_consensus.cc:729] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8eca624f1c9147d29ad9449bbe4e7169, State: Initialized, Role: FOLLOWER
I20240502 02:00:44.504773 17430 consensus_queue.cc:260] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 211, Last appended: 1.211, Last appended by leader: 211, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eca624f1c9147d29ad9449bbe4e7169" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 38343 } }
I20240502 02:00:44.504869 17430 raft_consensus.cc:388] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:44.504930 17430 raft_consensus.cc:482] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:44.505031 17430 raft_consensus.cc:3037] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [term 1 FOLLOWER]: Advancing to term 2
I20240502 02:00:44.506642 17430 raft_consensus.cc:504] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eca624f1c9147d29ad9449bbe4e7169" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 38343 } }
I20240502 02:00:44.506916 17430 leader_election.cc:302] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8eca624f1c9147d29ad9449bbe4e7169; no voters:
I20240502 02:00:44.507146 17430 leader_election.cc:288] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 02:00:44.507239 17714 raft_consensus.cc:2781] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 02:00:44.507464 17714 raft_consensus.cc:686] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [term 2 LEADER]: Becoming Leader. State: Replica: 8eca624f1c9147d29ad9449bbe4e7169, State: Running, Role: LEADER
I20240502 02:00:44.507750 17714 consensus_queue.cc:237] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 211, Committed index: 211, Last appended: 1.211, Last appended by leader: 211, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eca624f1c9147d29ad9449bbe4e7169" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 38343 } }
I20240502 02:00:44.507757 17550 heartbeater.cc:503] Master 127.16.79.254:35511 was elected leader, sending a full tablet report...
I20240502 02:00:44.507891 17430 ts_tablet_manager.cc:1398] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20240502 02:00:44.509615 17100 catalog_manager.cc:5484] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "8eca624f1c9147d29ad9449bbe4e7169" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eca624f1c9147d29ad9449bbe4e7169" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 38343 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:44.510968 17329 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:44.511346 17329 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:44.511734 17518 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:51259)
I20240502 02:00:44.511803 17518 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:51259: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
I20240502 02:00:44.512807 17518 tablet_copy_source_session.cc:205] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 02:00:44.515592 17329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8986350f57d240be8b7660810e6ff8ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:44.520009 17329 tablet_copy_client.cc:783] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Starting download of 0 data blocks...
I20240502 02:00:44.520161 17329 tablet_copy_client.cc:647] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Starting download of 1 WAL segments...
I20240502 02:00:44.523730 17329 tablet_copy_client.cc:523] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 02:00:44.525030 17329 tablet_bootstrap.cc:492] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Bootstrap starting.
I20240502 02:00:44.545960 17329 log.cc:824] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Log is configured to *not* fsync() on all Append() calls
I20240502 02:00:44.843636 17329 tablet_bootstrap.cc:492] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Bootstrap replayed 1/1 log segments. Stats: ops{read=212 overwritten=0 applied=212 ignored=0} inserts{seen=10500 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 02:00:44.843962 17329 tablet_bootstrap.cc:492] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Bootstrap complete.
I20240502 02:00:44.844323 17329 ts_tablet_manager.cc:1367] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Time spent bootstrapping tablet: real 0.319s user 0.306s sys 0.012s
I20240502 02:00:44.846359 17329 raft_consensus.cc:348] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eca624f1c9147d29ad9449bbe4e7169" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 38343 } }
I20240502 02:00:44.846571 17329 raft_consensus.cc:729] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: c71d0db6ea364ba5ac0646bb1eb5b87d, State: Initialized, Role: NON_PARTICIPANT
I20240502 02:00:44.846890 17329 consensus_queue.cc:260] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 212, Last appended: 2.212, Last appended by leader: 212, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eca624f1c9147d29ad9449bbe4e7169" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 38343 } }
I20240502 02:00:44.847491 17319 heartbeater.cc:503] Master 127.16.79.254:35511 was elected leader, sending a full tablet report...
I20240502 02:00:44.847692 17329 ts_tablet_manager.cc:1398] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Time spent starting tablet: real 0.003s user 0.005s sys 0.000s
I20240502 02:00:44.848343 17518 tablet_copy_service.cc:342] P 8eca624f1c9147d29ad9449bbe4e7169: Request end of tablet copy session c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce received from {username='slave'} at 127.16.79.194:51259
I20240502 02:00:44.848426 17518 tablet_copy_service.cc:433] P 8eca624f1c9147d29ad9449bbe4e7169: ending tablet copy session c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce on tablet 8986350f57d240be8b7660810e6ff8ce with peer c71d0db6ea364ba5ac0646bb1eb5b87d
W20240502 02:00:44.854903 17329 ts_tablet_manager.cc:701] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Tablet Copy: Invalid argument: Leader has replica of tablet 8986350f57d240be8b7660810e6ff8ce with term 0, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20240502 02:00:44.861208 17329 ts_tablet_manager.cc:701] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Tablet Copy: Invalid argument: Leader has replica of tablet 8986350f57d240be8b7660810e6ff8ce with term 0, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20240502 02:00:44.884313 17329 ts_tablet_manager.cc:701] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Tablet Copy: Invalid argument: Leader has replica of tablet 8986350f57d240be8b7660810e6ff8ce with term 0, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
I20240502 02:00:44.885901 17252 tablet_service.cc:1514] Processing DeleteTablet for tablet 8986350f57d240be8b7660810e6ff8ce with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:57936
I20240502 02:00:44.886262 17730 tablet_replica.cc:330] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: stopping tablet replica
I20240502 02:00:44.886484 17730 raft_consensus.cc:2229] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d [term 2 NON_PARTICIPANT]: Raft consensus shutting down.
I20240502 02:00:44.886657 17730 raft_consensus.cc:2258] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d [term 2 NON_PARTICIPANT]: Raft consensus is shut down!
I20240502 02:00:44.887718 17730 ts_tablet_manager.cc:1875] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20240502 02:00:44.889397 17730 ts_tablet_manager.cc:1888] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.212
I20240502 02:00:44.889465 17730 log.cc:1196] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Deleting WAL directory at /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/wal/wals/8986350f57d240be8b7660810e6ff8ce
I20240502 02:00:44.889708 17730 ts_tablet_manager.cc:1909] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Deleting consensus metadata
I20240502 02:00:44.890733 16703 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task3rm6An/build/debug/bin/kudu with pid 17190
I20240502 02:00:44.896353 16703 external_mini_cluster.cc:1326] Running /tmp/dist-test-task3rm6An/build/debug/bin/kudu
/tmp/dist-test-task3rm6An/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.79.194:42067
--local_ip_for_outbound_sockets=127.16.79.194
--tserver_master_addrs=127.16.79.254:35511
--webserver_port=45971
--webserver_interface=127.16.79.194
--builtin_ntp_servers=127.16.79.212:44323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240502 02:00:44.993093 17731 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 02:00:44.993261 17731 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 02:00:44.993304 17731 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 02:00:44.996212 17731 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 02:00:44.996310 17731 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.79.194
I20240502 02:00:44.999796 17731 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.79.212:44323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.79.194:42067
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.79.194
--webserver_port=45971
--tserver_master_addrs=127.16.79.254:35511
--never_fsync=true
--heap_profile_path=/tmp/kudu.17731
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.79.194
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 02:00:45.000471 17731 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 02:00:45.001415 17731 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 02:00:45.008497 17736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:45.008986 17737 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:45.009527 17739 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 02:00:45.009932 17731 server_base.cc:1034] running on GCE node
I20240502 02:00:45.010262 17731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 02:00:45.010764 17731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 02:00:45.011904 17731 hybrid_clock.cc:648] HybridClock initialized: now 1714615245011874 us; error 46 us; skew 500 ppm
I20240502 02:00:45.013398 17731 webserver.cc:460] Webserver started at http://127.16.79.194:45971/ using document root <none> and password file <none>
I20240502 02:00:45.013908 17731 fs_manager.cc:359] Metadata directory not provided
I20240502 02:00:45.013962 17731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 02:00:45.016901 17731 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:45.018527 17745 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:45.019364 17731 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:45.019459 17731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data,/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/wal
uuid: "c71d0db6ea364ba5ac0646bb1eb5b87d"
format_stamp: "Formatted at 2024-05-02 02:00:42 on dist-test-slave-tj0m"
I20240502 02:00:45.019809 17731 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 02:00:45.037775 17731 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 02:00:45.038209 17731 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 02:00:45.038341 17731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 02:00:45.038775 17731 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 02:00:45.039522 17731 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 02:00:45.039566 17731 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:45.039604 17731 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 02:00:45.039633 17731 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:45.047098 17731 rpc_server.cc:307] RPC server started. Bound to: 127.16.79.194:42067
I20240502 02:00:45.047128 17858 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.79.194:42067 every 8 connection(s)
I20240502 02:00:45.047958 17731 server_base.cc:1166] Dumped server information to /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data/info.pb
I20240502 02:00:45.050336 16703 external_mini_cluster.cc:1388] Started /tmp/dist-test-task3rm6An/build/debug/bin/kudu as pid 17731
I20240502 02:00:45.050479 16703 tablet_copy_client_session-itest.cc:139] Starting loop 1
I20240502 02:00:45.050541 16703 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task3rm6An/build/debug/bin/kudu with pid 17328
I20240502 02:00:45.057909 16703 external_mini_cluster.cc:1326] Running /tmp/dist-test-task3rm6An/build/debug/bin/kudu
/tmp/dist-test-task3rm6An/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.79.193:38343
--local_ip_for_outbound_sockets=127.16.79.193
--tserver_master_addrs=127.16.79.254:35511
--webserver_port=44157
--webserver_interface=127.16.79.193
--builtin_ntp_servers=127.16.79.212:44323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240502 02:00:45.058495 17859 heartbeater.cc:347] Connected to a master server at 127.16.79.254:35511
I20240502 02:00:45.058697 17859 heartbeater.cc:464] Registering TS with master...
I20240502 02:00:45.059211 17859 heartbeater.cc:511] Master 127.16.79.254:35511 requested a full tablet report, sending...
I20240502 02:00:45.060230 17100 ts_manager.cc:194] Re-registered known tserver with Master: c71d0db6ea364ba5ac0646bb1eb5b87d (127.16.79.194:42067)
I20240502 02:00:45.060957 17100 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.79.194:48823
I20240502 02:00:45.065383 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.066058 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.070899 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.071255 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.073912 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.074247 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.075822 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.076150 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.085800 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.086129 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.098058 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.098384 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.105085 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.105412 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.106889 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.107209 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.110908 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.111251 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.118088 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.118402 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.136078 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.136404 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.139297 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.139618 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.154971 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.155277 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
W20240502 02:00:45.163601 17868 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 02:00:45.163775 17868 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 02:00:45.163849 17868 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 02:00:45.166759 17868 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 02:00:45.166862 17868 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.79.193
I20240502 02:00:45.168293 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.168639 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.170784 17868 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.79.212:44323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.79.193:38343
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.79.193
--webserver_port=44157
--tserver_master_addrs=127.16.79.254:35511
--never_fsync=true
--heap_profile_path=/tmp/kudu.17868
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.79.193
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 02:00:45.171478 17868 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 02:00:45.172399 17868 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20240502 02:00:45.178319 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.178664 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
W20240502 02:00:45.179656 17937 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:45.179904 17934 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:45.180394 17935 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 02:00:45.180882 17868 server_base.cc:1034] running on GCE node
I20240502 02:00:45.181185 17868 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 02:00:45.181646 17868 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 02:00:45.182790 17868 hybrid_clock.cc:648] HybridClock initialized: now 1714615245182781 us; error 20 us; skew 500 ppm
I20240502 02:00:45.184230 17868 webserver.cc:460] Webserver started at http://127.16.79.193:44157/ using document root <none> and password file <none>
I20240502 02:00:45.184689 17868 fs_manager.cc:359] Metadata directory not provided
I20240502 02:00:45.184743 17868 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 02:00:45.187561 17868 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20240502 02:00:45.189229 17947 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:45.190096 17868 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:45.190182 17868 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/data,/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/wal
uuid: "8eca624f1c9147d29ad9449bbe4e7169"
format_stamp: "Formatted at 2024-05-02 02:00:42 on dist-test-slave-tj0m"
I20240502 02:00:45.190501 17868 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 02:00:45.200120 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.200465 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.205509 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.205862 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.209693 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.210019 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.213245 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.213554 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.221304 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.221635 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.224483 17868 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 02:00:45.224943 17868 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 02:00:45.225066 17868 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 02:00:45.225492 17868 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 02:00:45.226459 17974 ts_tablet_manager.cc:516] Loading tablet metadata (0/1 complete)
I20240502 02:00:45.229018 17868 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240502 02:00:45.229064 17868 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.003s user 0.000s sys 0.000s
I20240502 02:00:45.229106 17868 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240502 02:00:45.230378 17868 ts_tablet_manager.cc:590] Registered 1 tablets
I20240502 02:00:45.230417 17868 ts_tablet_manager.cc:569] Time spent register tablets: real 0.001s user 0.001s sys 0.000s
I20240502 02:00:45.230628 17974 tablet_bootstrap.cc:492] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169: Bootstrap starting.
I20240502 02:00:45.237179 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.237545 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.239823 17868 rpc_server.cc:307] RPC server started. Bound to: 127.16.79.193:38343
I20240502 02:00:45.239858 18085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.79.193:38343 every 8 connection(s)
I20240502 02:00:45.240854 17868 server_base.cc:1166] Dumped server information to /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/data/info.pb
I20240502 02:00:45.243053 16703 external_mini_cluster.cc:1388] Started /tmp/dist-test-task3rm6An/build/debug/bin/kudu as pid 17868
I20240502 02:00:45.246994 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.247363 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.249262 18086 heartbeater.cc:347] Connected to a master server at 127.16.79.254:35511
I20240502 02:00:45.249459 18086 heartbeater.cc:464] Registering TS with master...
I20240502 02:00:45.250032 18086 heartbeater.cc:511] Master 127.16.79.254:35511 requested a full tablet report, sending...
I20240502 02:00:45.251643 17100 ts_manager.cc:194] Re-registered known tserver with Master: 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.252429 17100 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.79.193:45529
I20240502 02:00:45.252866 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.252995 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.253440 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.257359 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.257759 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.258219 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.258312 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.258390 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.262864 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.263200 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.263546 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.263622 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.263690 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.265158 17974 log.cc:824] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169: Log is configured to *not* fsync() on all Append() calls
I20240502 02:00:45.267374 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.267688 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.268046 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.268115 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.268172 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.275244 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.275547 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.275897 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.275969 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.276024 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.278599 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.278959 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.279354 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.279441 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.279516 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.287119 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.287464 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.287846 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.287919 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.287995 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.290230 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.290596 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.290979 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.291052 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.291127 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.303033 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.303377 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.303759 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.303833 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.303908 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.318535 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.318892 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.319288 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.319373 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.319448 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.327615 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.327936 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.328307 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.328378 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.328452 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.339927 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.340255 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.340607 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.340696 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.340765 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.347563 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.347867 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.348228 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.348315 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.348392 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.351172 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.351511 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.351869 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.351956 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.352033 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.361331 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.361685 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.362072 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.362154 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.362231 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.370036 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.370373 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.370760 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.370846 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.370916 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.375804 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.376108 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.376479 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.376564 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.376672 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.379953 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.380268 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.380640 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.380728 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.380806 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.388466 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.388777 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.389139 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.389226 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.389303 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.392627 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.392946 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.393340 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.393426 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.393498 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.394658 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.394980 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.395334 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.395419 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.395494 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.402297 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.402611 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.402979 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.403055 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.403121 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.423931 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.424245 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.424650 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.424739 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.424814 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.428926 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.429237 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.429605 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.429701 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.429809 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.434996 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.435303 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.435675 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.435746 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.435822 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.446349 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.446676 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.447048 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.447118 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.447207 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.453822 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.454136 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.454524 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.454595 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.454670 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.458369 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.458678 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.459046 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.459129 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.459210 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.467732 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.468035 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.468401 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.468479 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.468559 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.470218 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.470582 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.470963 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.471045 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.471118 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.473440 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.473798 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.474174 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.474258 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.474337 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.493799 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.494122 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.494527 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.494596 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.494653 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.505110 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.505417 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.505826 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.505900 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.505964 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.514621 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.514979 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.515370 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.515455 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.515537 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.516268 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.516578 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.516923 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.517010 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.517086 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.518671 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.518978 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.519333 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.519418 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.519492 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.531136 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.531443 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.531811 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.531901 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.531980 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.535379 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.535681 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.536046 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.536134 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.536213 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.539834 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.540185 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.540565 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.540655 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.540735 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.542141 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.542469 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.542831 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.542914 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.542989 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.551492 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.551848 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.552203 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.552289 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.552357 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.569558 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.569900 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.570266 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.570354 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.570431 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.574154 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.574452 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.574865 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.574952 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:45.575026 18051 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:35907: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:45.580297 17974 tablet_bootstrap.cc:492] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169: Bootstrap replayed 1/1 log segments. Stats: ops{read=212 overwritten=0 applied=212 ignored=0} inserts{seen=10500 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 02:00:45.580603 17974 tablet_bootstrap.cc:492] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169: Bootstrap complete.
I20240502 02:00:45.581478 17974 ts_tablet_manager.cc:1367] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169: Time spent bootstrapping tablet: real 0.351s user 0.331s sys 0.016s
I20240502 02:00:45.583516 17974 raft_consensus.cc:348] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eca624f1c9147d29ad9449bbe4e7169" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 38343 } }
I20240502 02:00:45.583842 17974 raft_consensus.cc:729] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8eca624f1c9147d29ad9449bbe4e7169, State: Initialized, Role: FOLLOWER
I20240502 02:00:45.584228 17974 consensus_queue.cc:260] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 212, Last appended: 2.212, Last appended by leader: 212, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eca624f1c9147d29ad9449bbe4e7169" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 38343 } }
I20240502 02:00:45.584322 17974 raft_consensus.cc:388] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:45.584367 17974 raft_consensus.cc:482] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:45.584447 17974 raft_consensus.cc:3037] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [term 2 FOLLOWER]: Advancing to term 3
I20240502 02:00:45.585968 17974 raft_consensus.cc:504] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eca624f1c9147d29ad9449bbe4e7169" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 38343 } }
I20240502 02:00:45.586287 17974 leader_election.cc:302] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8eca624f1c9147d29ad9449bbe4e7169; no voters:
I20240502 02:00:45.586527 17974 leader_election.cc:288] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [CANDIDATE]: Term 3 election: Requested vote from peers
I20240502 02:00:45.586629 18263 raft_consensus.cc:2781] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [term 3 FOLLOWER]: Leader election won for term 3
I20240502 02:00:45.586850 18263 raft_consensus.cc:686] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [term 3 LEADER]: Becoming Leader. State: Replica: 8eca624f1c9147d29ad9449bbe4e7169, State: Running, Role: LEADER
I20240502 02:00:45.586863 17872 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:45.587154 17872 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:45.587111 18263 consensus_queue.cc:237] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 212, Committed index: 212, Last appended: 2.212, Last appended by leader: 212, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eca624f1c9147d29ad9449bbe4e7169" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 38343 } }
I20240502 02:00:45.587358 17974 ts_tablet_manager.cc:1398] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169: Time spent starting tablet: real 0.006s user 0.009s sys 0.000s
I20240502 02:00:45.587411 18086 heartbeater.cc:503] Master 127.16.79.254:35511 was elected leader, sending a full tablet report...
I20240502 02:00:45.587577 18051 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:35907)
I20240502 02:00:45.587656 18051 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:35907: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
I20240502 02:00:45.588575 18051 tablet_copy_source_session.cc:205] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 02:00:45.589036 17100 catalog_manager.cc:5484] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 reported cstate change: term changed from 2 to 3. New cstate: current_term: 3 leader_uuid: "8eca624f1c9147d29ad9449bbe4e7169" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eca624f1c9147d29ad9449bbe4e7169" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 38343 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:45.591854 17872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8986350f57d240be8b7660810e6ff8ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:45.596546 17872 tablet_copy_client.cc:783] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Starting download of 0 data blocks...
I20240502 02:00:45.596716 17872 tablet_copy_client.cc:647] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Starting download of 1 WAL segments...
I20240502 02:00:45.600472 17872 tablet_copy_client.cc:523] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 02:00:45.601716 17872 tablet_bootstrap.cc:492] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Bootstrap starting.
I20240502 02:00:45.623217 17872 log.cc:824] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Log is configured to *not* fsync() on all Append() calls
I20240502 02:00:45.925753 17872 tablet_bootstrap.cc:492] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Bootstrap replayed 1/1 log segments. Stats: ops{read=212 overwritten=0 applied=212 ignored=0} inserts{seen=10500 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 02:00:45.926084 17872 tablet_bootstrap.cc:492] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Bootstrap complete.
I20240502 02:00:45.926460 17872 ts_tablet_manager.cc:1367] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Time spent bootstrapping tablet: real 0.325s user 0.317s sys 0.009s
I20240502 02:00:45.928444 17872 raft_consensus.cc:348] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d [term 3 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eca624f1c9147d29ad9449bbe4e7169" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 38343 } }
I20240502 02:00:45.928655 17872 raft_consensus.cc:729] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d [term 3 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: c71d0db6ea364ba5ac0646bb1eb5b87d, State: Initialized, Role: NON_PARTICIPANT
I20240502 02:00:45.928951 17872 consensus_queue.cc:260] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 212, Last appended: 2.212, Last appended by leader: 212, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eca624f1c9147d29ad9449bbe4e7169" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 38343 } }
I20240502 02:00:45.929528 17859 heartbeater.cc:503] Master 127.16.79.254:35511 was elected leader, sending a full tablet report...
I20240502 02:00:45.929701 17872 ts_tablet_manager.cc:1398] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20240502 02:00:45.930385 18051 tablet_copy_service.cc:342] P 8eca624f1c9147d29ad9449bbe4e7169: Request end of tablet copy session c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce received from {username='slave'} at 127.16.79.194:35907
I20240502 02:00:45.930476 18051 tablet_copy_service.cc:433] P 8eca624f1c9147d29ad9449bbe4e7169: ending tablet copy session c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce on tablet 8986350f57d240be8b7660810e6ff8ce with peer c71d0db6ea364ba5ac0646bb1eb5b87d
W20240502 02:00:45.944628 17872 ts_tablet_manager.cc:701] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Tablet Copy: Invalid argument: Leader has replica of tablet 8986350f57d240be8b7660810e6ff8ce with term 0, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20240502 02:00:45.956264 17872 ts_tablet_manager.cc:701] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Tablet Copy: Invalid argument: Leader has replica of tablet 8986350f57d240be8b7660810e6ff8ce with term 0, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20240502 02:00:45.974103 17872 ts_tablet_manager.cc:701] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Tablet Copy: Invalid argument: Leader has replica of tablet 8986350f57d240be8b7660810e6ff8ce with term 0, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
I20240502 02:00:45.975565 17793 tablet_service.cc:1514] Processing DeleteTablet for tablet 8986350f57d240be8b7660810e6ff8ce with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:57940
I20240502 02:00:45.976140 18279 tablet_replica.cc:330] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: stopping tablet replica
I20240502 02:00:45.976399 18279 raft_consensus.cc:2229] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d [term 3 NON_PARTICIPANT]: Raft consensus shutting down.
I20240502 02:00:45.976601 18279 raft_consensus.cc:2258] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d [term 3 NON_PARTICIPANT]: Raft consensus is shut down!
I20240502 02:00:45.977700 18279 ts_tablet_manager.cc:1875] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20240502 02:00:45.979316 18279 ts_tablet_manager.cc:1888] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.212
I20240502 02:00:45.979390 18279 log.cc:1196] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Deleting WAL directory at /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/wal/wals/8986350f57d240be8b7660810e6ff8ce
I20240502 02:00:45.979642 18279 ts_tablet_manager.cc:1909] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Deleting consensus metadata
I20240502 02:00:45.980650 16703 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task3rm6An/build/debug/bin/kudu with pid 17731
I20240502 02:00:45.986245 16703 external_mini_cluster.cc:1326] Running /tmp/dist-test-task3rm6An/build/debug/bin/kudu
/tmp/dist-test-task3rm6An/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.79.194:42067
--local_ip_for_outbound_sockets=127.16.79.194
--tserver_master_addrs=127.16.79.254:35511
--webserver_port=45971
--webserver_interface=127.16.79.194
--builtin_ntp_servers=127.16.79.212:44323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240502 02:00:46.084668 18280 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 02:00:46.084841 18280 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 02:00:46.084885 18280 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 02:00:46.087917 18280 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 02:00:46.088012 18280 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.79.194
I20240502 02:00:46.091567 18280 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.79.212:44323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.79.194:42067
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.79.194
--webserver_port=45971
--tserver_master_addrs=127.16.79.254:35511
--never_fsync=true
--heap_profile_path=/tmp/kudu.18280
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.79.194
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 02:00:46.092243 18280 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 02:00:46.093207 18280 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 02:00:46.100590 18285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:46.100839 18288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:46.101461 18286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 02:00:46.101969 18280 server_base.cc:1034] running on GCE node
I20240502 02:00:46.102298 18280 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 02:00:46.102797 18280 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 02:00:46.103936 18280 hybrid_clock.cc:648] HybridClock initialized: now 1714615246103915 us; error 37 us; skew 500 ppm
I20240502 02:00:46.105397 18280 webserver.cc:460] Webserver started at http://127.16.79.194:45971/ using document root <none> and password file <none>
I20240502 02:00:46.105912 18280 fs_manager.cc:359] Metadata directory not provided
I20240502 02:00:46.105970 18280 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 02:00:46.108832 18280 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:46.110528 18294 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:46.111496 18280 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:46.111588 18280 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data,/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/wal
uuid: "c71d0db6ea364ba5ac0646bb1eb5b87d"
format_stamp: "Formatted at 2024-05-02 02:00:42 on dist-test-slave-tj0m"
I20240502 02:00:46.111964 18280 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 02:00:46.124130 18280 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 02:00:46.124559 18280 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 02:00:46.124693 18280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 02:00:46.125111 18280 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 02:00:46.125887 18280 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 02:00:46.125932 18280 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:46.125979 18280 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 02:00:46.126008 18280 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:46.133383 18280 rpc_server.cc:307] RPC server started. Bound to: 127.16.79.194:42067
I20240502 02:00:46.133405 18407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.79.194:42067 every 8 connection(s)
I20240502 02:00:46.134253 18280 server_base.cc:1166] Dumped server information to /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data/info.pb
I20240502 02:00:46.140442 16703 external_mini_cluster.cc:1388] Started /tmp/dist-test-task3rm6An/build/debug/bin/kudu as pid 18280
I20240502 02:00:46.140583 16703 tablet_copy_client_session-itest.cc:139] Starting loop 2
I20240502 02:00:46.140632 16703 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task3rm6An/build/debug/bin/kudu with pid 17868
I20240502 02:00:46.143258 18408 heartbeater.cc:347] Connected to a master server at 127.16.79.254:35511
I20240502 02:00:46.143436 18408 heartbeater.cc:464] Registering TS with master...
I20240502 02:00:46.143862 18408 heartbeater.cc:511] Master 127.16.79.254:35511 requested a full tablet report, sending...
I20240502 02:00:46.144716 17100 ts_manager.cc:194] Re-registered known tserver with Master: c71d0db6ea364ba5ac0646bb1eb5b87d (127.16.79.194:42067)
I20240502 02:00:46.145220 17100 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.79.194:35373
I20240502 02:00:46.146648 16703 external_mini_cluster.cc:1326] Running /tmp/dist-test-task3rm6An/build/debug/bin/kudu
/tmp/dist-test-task3rm6An/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.79.193:38343
--local_ip_for_outbound_sockets=127.16.79.193
--tserver_master_addrs=127.16.79.254:35511
--webserver_port=44157
--webserver_interface=127.16.79.193
--builtin_ntp_servers=127.16.79.212:44323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240502 02:00:46.153187 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.153924 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.174223 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.174569 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.184316 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.184621 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.186645 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.186972 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.188452 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.188741 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.190832 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.191159 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.197610 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.197953 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.222357 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.222682 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.225983 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.226300 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.229890 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.230201 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.236011 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.236317 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.241417 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.241793 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.249635 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.249967 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
W20240502 02:00:46.250666 18416 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 02:00:46.250869 18416 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 02:00:46.250933 18416 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 02:00:46.253931 18416 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 02:00:46.254026 18416 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.79.193
I20240502 02:00:46.257025 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.257350 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.257455 18416 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.79.212:44323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.79.193:38343
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.79.193
--webserver_port=44157
--tserver_master_addrs=127.16.79.254:35511
--never_fsync=true
--heap_profile_path=/tmp/kudu.18416
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.79.193
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 02:00:46.258291 18416 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 02:00:46.259302 18416 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 02:00:46.266250 18483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:46.266491 18486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:46.266945 18484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 02:00:46.267522 18416 server_base.cc:1034] running on GCE node
I20240502 02:00:46.267843 18416 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 02:00:46.268172 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.268416 18416 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 02:00:46.268505 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.269579 18416 hybrid_clock.cc:648] HybridClock initialized: now 1714615246269525 us; error 68 us; skew 500 ppm
I20240502 02:00:46.271185 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.271186 18416 webserver.cc:460] Webserver started at http://127.16.79.193:44157/ using document root <none> and password file <none>
I20240502 02:00:46.271520 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.271766 18416 fs_manager.cc:359] Metadata directory not provided
I20240502 02:00:46.271816 18416 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 02:00:46.274827 18416 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20240502 02:00:46.276453 18500 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:46.277101 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.277415 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.277447 18416 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:46.277544 18416 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/data,/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/wal
uuid: "8eca624f1c9147d29ad9449bbe4e7169"
format_stamp: "Formatted at 2024-05-02 02:00:42 on dist-test-slave-tj0m"
I20240502 02:00:46.277987 18416 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 02:00:46.290588 18416 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 02:00:46.291049 18416 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 02:00:46.291182 18416 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 02:00:46.291427 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.291718 18416 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 02:00:46.291769 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.292796 18515 ts_tablet_manager.cc:516] Loading tablet metadata (0/1 complete)
I20240502 02:00:46.295433 18416 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240502 02:00:46.295491 18416 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.003s user 0.000s sys 0.000s
I20240502 02:00:46.295536 18416 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240502 02:00:46.296753 18416 ts_tablet_manager.cc:590] Registered 1 tablets
I20240502 02:00:46.296797 18416 ts_tablet_manager.cc:569] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20240502 02:00:46.296989 18515 tablet_bootstrap.cc:492] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169: Bootstrap starting.
I20240502 02:00:46.298355 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.298693 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.306330 18416 rpc_server.cc:307] RPC server started. Bound to: 127.16.79.193:38343
I20240502 02:00:46.306368 18626 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.79.193:38343 every 8 connection(s)
I20240502 02:00:46.307353 18416 server_base.cc:1166] Dumped server information to /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-0/data/info.pb
I20240502 02:00:46.311363 16703 external_mini_cluster.cc:1388] Started /tmp/dist-test-task3rm6An/build/debug/bin/kudu as pid 18416
I20240502 02:00:46.311427 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.311785 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.316495 18627 heartbeater.cc:347] Connected to a master server at 127.16.79.254:35511
I20240502 02:00:46.316700 18627 heartbeater.cc:464] Registering TS with master...
I20240502 02:00:46.317224 18627 heartbeater.cc:511] Master 127.16.79.254:35511 requested a full tablet report, sending...
I20240502 02:00:46.318111 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.318238 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.318719 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.320202 17100 ts_manager.cc:194] Re-registered known tserver with Master: 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.321162 17100 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.79.193:39157
I20240502 02:00:46.332850 18515 log.cc:824] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169: Log is configured to *not* fsync() on all Append() calls
I20240502 02:00:46.343626 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.343978 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.344360 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.344434 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.344496 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.354832 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.355190 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.355558 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.355639 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.355713 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.358916 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.359254 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.359635 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.359704 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.359761 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.367477 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.367786 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.368151 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.368224 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.368281 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.380828 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.381142 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.381515 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.381593 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.381666 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.388099 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.388401 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.388773 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.388850 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.388927 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.403306 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.403613 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.403985 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.404055 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.404111 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.406337 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.406647 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.407019 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.407090 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.407164 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.408231 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.408566 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.408929 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.409003 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.409073 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.411809 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.412132 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.412883 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.412986 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.413064 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.416499 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.416851 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.417234 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.417317 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.417394 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.419040 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.419348 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.419719 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.419793 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.419868 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.424885 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.425209 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.425570 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.425647 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.425719 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.432673 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.432981 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.433346 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.433418 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.433475 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.453462 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.453794 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.454165 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.454238 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.454308 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.466125 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.466464 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.466861 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.466936 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.467015 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.469139 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.469481 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.469877 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.469952 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.470028 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.473253 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.473587 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.473973 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.474053 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.474134 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.479331 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.479655 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.480003 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.480072 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.480139 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.492643 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.492956 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.493335 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.493422 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.493499 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.494803 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.495119 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.495501 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.495585 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.495662 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.508136 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.508491 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.508908 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.508989 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.509071 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.514482 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.514803 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.515179 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.515271 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.515345 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.527273 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.527611 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.527997 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.528080 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.528160 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.541667 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.542032 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.542409 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.542491 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.542567 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.545148 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.545487 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.545909 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.545989 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.546052 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.555639 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.555991 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.556393 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.556483 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.556563 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.565963 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.566295 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.566666 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.566740 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.566816 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.580261 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.580565 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.580947 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.581020 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.581099 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.583112 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.583429 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.583789 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.583861 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.583925 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.587989 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.588294 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.588798 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.588886 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.588963 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.599654 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.599992 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.600353 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.600433 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.600508 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.606178 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.606540 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.606920 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.606997 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.607074 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.630671 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.631140 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.631599 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.631712 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.631793 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.636642 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.637012 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.637401 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.637483 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
W20240502 02:00:46.637565 18601 tablet_copy_service.cc:478] P 8eca624f1c9147d29ad9449bbe4e7169: Error handling TabletCopyService RPC request from {username='slave'} at 127.16.79.194:45889: Error beginning tablet copy session for tablet 8986350f57d240be8b7660810e6ff8ce: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 02:00:46.638957 18515 tablet_bootstrap.cc:492] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169: Bootstrap replayed 1/1 log segments. Stats: ops{read=213 overwritten=0 applied=213 ignored=0} inserts{seen=10500 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 02:00:46.639297 18515 tablet_bootstrap.cc:492] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169: Bootstrap complete.
I20240502 02:00:46.640190 18515 ts_tablet_manager.cc:1367] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169: Time spent bootstrapping tablet: real 0.343s user 0.328s sys 0.012s
I20240502 02:00:46.642316 18515 raft_consensus.cc:348] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eca624f1c9147d29ad9449bbe4e7169" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 38343 } }
I20240502 02:00:46.642741 18515 raft_consensus.cc:729] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8eca624f1c9147d29ad9449bbe4e7169, State: Initialized, Role: FOLLOWER
I20240502 02:00:46.643195 18515 consensus_queue.cc:260] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 213, Last appended: 3.213, Last appended by leader: 213, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eca624f1c9147d29ad9449bbe4e7169" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 38343 } }
I20240502 02:00:46.643307 18515 raft_consensus.cc:388] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [term 3 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:46.643370 18515 raft_consensus.cc:482] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [term 3 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:46.643465 18515 raft_consensus.cc:3037] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [term 3 FOLLOWER]: Advancing to term 4
I20240502 02:00:46.644922 18515 raft_consensus.cc:504] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eca624f1c9147d29ad9449bbe4e7169" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 38343 } }
I20240502 02:00:46.645222 18515 leader_election.cc:302] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8eca624f1c9147d29ad9449bbe4e7169; no voters:
I20240502 02:00:46.645485 18515 leader_election.cc:288] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [CANDIDATE]: Term 4 election: Requested vote from peers
I20240502 02:00:46.645594 18776 raft_consensus.cc:2781] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [term 4 FOLLOWER]: Leader election won for term 4
I20240502 02:00:46.645823 18776 raft_consensus.cc:686] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [term 4 LEADER]: Becoming Leader. State: Replica: 8eca624f1c9147d29ad9449bbe4e7169, State: Running, Role: LEADER
I20240502 02:00:46.646124 18627 heartbeater.cc:503] Master 127.16.79.254:35511 was elected leader, sending a full tablet report...
I20240502 02:00:46.646138 18776 consensus_queue.cc:237] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 213, Committed index: 213, Last appended: 3.213, Last appended by leader: 213, Current term: 4, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eca624f1c9147d29ad9449bbe4e7169" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 38343 } }
I20240502 02:00:46.646345 18515 ts_tablet_manager.cc:1398] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20240502 02:00:46.646871 18420 ts_tablet_manager.cc:902] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Initiating tablet copy from peer 8eca624f1c9147d29ad9449bbe4e7169 (127.16.79.193:38343)
I20240502 02:00:46.647167 18420 tablet_copy_client.cc:308] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:38343
I20240502 02:00:46.647604 18601 tablet_copy_service.cc:140] P 8eca624f1c9147d29ad9449bbe4e7169: Received BeginTabletCopySession request for tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d ({username='slave'} at 127.16.79.194:45889)
I20240502 02:00:46.647694 18601 tablet_copy_service.cc:161] P 8eca624f1c9147d29ad9449bbe4e7169: Beginning new tablet copy session on tablet 8986350f57d240be8b7660810e6ff8ce from peer c71d0db6ea364ba5ac0646bb1eb5b87d at {username='slave'} at 127.16.79.194:45889: session id = c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce
I20240502 02:00:46.648239 17100 catalog_manager.cc:5484] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169 reported cstate change: term changed from 3 to 4. New cstate: current_term: 4 leader_uuid: "8eca624f1c9147d29ad9449bbe4e7169" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eca624f1c9147d29ad9449bbe4e7169" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 38343 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:46.648475 18601 tablet_copy_source_session.cc:205] T 8986350f57d240be8b7660810e6ff8ce P 8eca624f1c9147d29ad9449bbe4e7169: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 02:00:46.651858 18420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8986350f57d240be8b7660810e6ff8ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:46.657063 18420 tablet_copy_client.cc:783] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Starting download of 0 data blocks...
I20240502 02:00:46.657246 18420 tablet_copy_client.cc:647] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Starting download of 1 WAL segments...
I20240502 02:00:46.660494 18420 tablet_copy_client.cc:523] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 02:00:46.661769 18420 tablet_bootstrap.cc:492] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Bootstrap starting.
I20240502 02:00:46.682600 18420 log.cc:824] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Log is configured to *not* fsync() on all Append() calls
I20240502 02:00:46.976991 18420 tablet_bootstrap.cc:492] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Bootstrap replayed 1/1 log segments. Stats: ops{read=214 overwritten=0 applied=213 ignored=0} inserts{seen=10500 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20240502 02:00:46.977456 18420 tablet_bootstrap.cc:492] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Bootstrap complete.
I20240502 02:00:46.977864 18420 ts_tablet_manager.cc:1367] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Time spent bootstrapping tablet: real 0.316s user 0.300s sys 0.017s
I20240502 02:00:46.979911 18420 raft_consensus.cc:348] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d [term 4 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eca624f1c9147d29ad9449bbe4e7169" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 38343 } }
I20240502 02:00:46.980309 18420 raft_consensus.cc:729] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d [term 4 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: c71d0db6ea364ba5ac0646bb1eb5b87d, State: Initialized, Role: NON_PARTICIPANT
I20240502 02:00:46.980638 18420 consensus_queue.cc:260] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 213, Last appended: 4.214, Last appended by leader: 214, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eca624f1c9147d29ad9449bbe4e7169" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 38343 } }
I20240502 02:00:46.981215 18408 heartbeater.cc:503] Master 127.16.79.254:35511 was elected leader, sending a full tablet report...
I20240502 02:00:46.981424 18420 ts_tablet_manager.cc:1398] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20240502 02:00:46.982098 18601 tablet_copy_service.cc:342] P 8eca624f1c9147d29ad9449bbe4e7169: Request end of tablet copy session c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce received from {username='slave'} at 127.16.79.194:45889
I20240502 02:00:46.982179 18601 tablet_copy_service.cc:433] P 8eca624f1c9147d29ad9449bbe4e7169: ending tablet copy session c71d0db6ea364ba5ac0646bb1eb5b87d-8986350f57d240be8b7660810e6ff8ce on tablet 8986350f57d240be8b7660810e6ff8ce with peer c71d0db6ea364ba5ac0646bb1eb5b87d
W20240502 02:00:46.984752 18420 ts_tablet_manager.cc:701] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Tablet Copy: Invalid argument: Leader has replica of tablet 8986350f57d240be8b7660810e6ff8ce with term 0, which is lower than last-logged term 4 on local replica. Rejecting tablet copy request
W20240502 02:00:46.992105 18420 ts_tablet_manager.cc:701] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Tablet Copy: Invalid argument: Leader has replica of tablet 8986350f57d240be8b7660810e6ff8ce with term 0, which is lower than last-logged term 4 on local replica. Rejecting tablet copy request
W20240502 02:00:46.995802 18420 ts_tablet_manager.cc:701] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Tablet Copy: Invalid argument: Leader has replica of tablet 8986350f57d240be8b7660810e6ff8ce with term 0, which is lower than last-logged term 4 on local replica. Rejecting tablet copy request
I20240502 02:00:46.997193 18342 tablet_service.cc:1514] Processing DeleteTablet for tablet 8986350f57d240be8b7660810e6ff8ce with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:57942
I20240502 02:00:46.997514 18791 tablet_replica.cc:330] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: stopping tablet replica
I20240502 02:00:46.997771 18791 raft_consensus.cc:2229] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d [term 4 NON_PARTICIPANT]: Raft consensus shutting down.
I20240502 02:00:46.997948 18791 pending_rounds.cc:62] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Trying to abort 1 pending ops.
I20240502 02:00:46.998009 18791 pending_rounds.cc:68] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Aborting op as it isn't in flight: id { term: 4 index: 214 } timestamp: 7023064050263220224 op_type: NO_OP noop_request { }
I20240502 02:00:46.998104 18791 raft_consensus.cc:2866] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d [term 4 NON_PARTICIPANT]: NO_OP replication failed: Aborted: Op aborted
I20240502 02:00:46.998170 18791 raft_consensus.cc:2258] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d [term 4 NON_PARTICIPANT]: Raft consensus is shut down!
I20240502 02:00:46.999176 18791 ts_tablet_manager.cc:1875] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20240502 02:00:47.000824 18791 ts_tablet_manager.cc:1888] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 4.214
I20240502 02:00:47.000896 18791 log.cc:1196] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Deleting WAL directory at /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/wal/wals/8986350f57d240be8b7660810e6ff8ce
I20240502 02:00:47.001183 18791 ts_tablet_manager.cc:1909] T 8986350f57d240be8b7660810e6ff8ce P c71d0db6ea364ba5ac0646bb1eb5b87d: Deleting consensus metadata
I20240502 02:00:47.002254 16703 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task3rm6An/build/debug/bin/kudu with pid 18280
I20240502 02:00:47.008323 16703 external_mini_cluster.cc:1326] Running /tmp/dist-test-task3rm6An/build/debug/bin/kudu
/tmp/dist-test-task3rm6An/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.79.194:42067
--local_ip_for_outbound_sockets=127.16.79.194
--tserver_master_addrs=127.16.79.254:35511
--webserver_port=45971
--webserver_interface=127.16.79.194
--builtin_ntp_servers=127.16.79.212:44323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240502 02:00:47.107755 18792 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 02:00:47.107952 18792 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 02:00:47.108011 18792 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 02:00:47.111027 18792 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 02:00:47.111127 18792 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.79.194
I20240502 02:00:47.114557 18792 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.79.212:44323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.79.194:42067
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.79.194
--webserver_port=45971
--tserver_master_addrs=127.16.79.254:35511
--never_fsync=true
--heap_profile_path=/tmp/kudu.18792
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.79.194
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 02:00:47.115316 18792 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 02:00:47.116384 18792 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 02:00:47.123739 18797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:47.124385 18800 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:47.124862 18798 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 02:00:47.125381 18792 server_base.cc:1034] running on GCE node
I20240502 02:00:47.125766 18792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 02:00:47.126271 18792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 02:00:47.127413 18792 hybrid_clock.cc:648] HybridClock initialized: now 1714615247127407 us; error 25 us; skew 500 ppm
I20240502 02:00:47.132967 18792 webserver.cc:460] Webserver started at http://127.16.79.194:45971/ using document root <none> and password file <none>
I20240502 02:00:47.133451 18792 fs_manager.cc:359] Metadata directory not provided
I20240502 02:00:47.133507 18792 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 02:00:47.136472 18792 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:47.138141 18806 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:47.139029 18792 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:47.139124 18792 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data,/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/wal
uuid: "c71d0db6ea364ba5ac0646bb1eb5b87d"
format_stamp: "Formatted at 2024-05-02 02:00:42 on dist-test-slave-tj0m"
I20240502 02:00:47.139482 18792 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 02:00:47.157475 18792 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 02:00:47.157980 18792 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 02:00:47.158105 18792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 02:00:47.158546 18792 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 02:00:47.159304 18792 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 02:00:47.159350 18792 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:47.159396 18792 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 02:00:47.159422 18792 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:47.166847 18792 rpc_server.cc:307] RPC server started. Bound to: 127.16.79.194:42067
I20240502 02:00:47.166867 18919 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.79.194:42067 every 8 connection(s)
I20240502 02:00:47.167707 18792 server_base.cc:1166] Dumped server information to /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714615241968978-16703-0/minicluster-data/ts-1/data/info.pb
I20240502 02:00:47.172576 16703 external_mini_cluster.cc:1388] Started /tmp/dist-test-task3rm6An/build/debug/bin/kudu as pid 18792
I20240502 02:00:47.172804 16703 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task3rm6An/build/debug/bin/kudu with pid 18416
I20240502 02:00:47.176697 18921 heartbeater.cc:347] Connected to a master server at 127.16.79.254:35511
I20240502 02:00:47.176887 18921 heartbeater.cc:464] Registering TS with master...
I20240502 02:00:47.177417 18921 heartbeater.cc:511] Master 127.16.79.254:35511 requested a full tablet report, sending...
I20240502 02:00:47.178400 17100 ts_manager.cc:194] Re-registered known tserver with Master: c71d0db6ea364ba5ac0646bb1eb5b87d (127.16.79.194:42067)
I20240502 02:00:47.178908 17100 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.79.194:34937
I20240502 02:00:47.179698 16703 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task3rm6An/build/debug/bin/kudu with pid 18792
I20240502 02:00:47.184787 16703 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task3rm6An/build/debug/bin/kudu with pid 17071
2024-05-02T02:00:47Z chronyd exiting
[ OK ] TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping (5225 ms)
[ RUN ] TabletCopyClientSessionITest.TestStartTabletCopy
2024-05-02T02:00:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-02T02:00:47Z Disabled control of system clock
I20240502 02:00:47.210098 16703 external_mini_cluster.cc:1326] Running /tmp/dist-test-task3rm6An/build/debug/bin/kudu
/tmp/dist-test-task3rm6An/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.79.254:44591
--webserver_interface=127.16.79.254
--webserver_port=0
--builtin_ntp_servers=127.16.79.212:36445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.79.254:44591
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240502 02:00:47.304991 18929 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 02:00:47.305153 18929 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 02:00:47.305210 18929 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 02:00:47.308127 18929 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 02:00:47.308173 18929 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 02:00:47.308200 18929 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 02:00:47.308233 18929 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 02:00:47.311645 18929 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.79.212:36445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.16.79.254:44591
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.79.254:44591
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.79.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.18929
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 02:00:47.312289 18929 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 02:00:47.313201 18929 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 02:00:47.319453 18934 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:47.319766 18938 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:47.320120 18935 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 02:00:47.320744 18929 server_base.cc:1034] running on GCE node
I20240502 02:00:47.321142 18929 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 02:00:47.321900 18929 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 02:00:47.323040 18929 hybrid_clock.cc:648] HybridClock initialized: now 1714615247323028 us; error 24 us; skew 500 ppm
I20240502 02:00:47.324563 18929 webserver.cc:460] Webserver started at http://127.16.79.254:42237/ using document root <none> and password file <none>
I20240502 02:00:47.325014 18929 fs_manager.cc:359] Metadata directory not provided
I20240502 02:00:47.325065 18929 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 02:00:47.325225 18929 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 02:00:47.326660 18929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/master-0/data/instance:
uuid: "68498d564ba142028516d988de162e5c"
format_stamp: "Formatted at 2024-05-02 02:00:47 on dist-test-slave-tj0m"
I20240502 02:00:47.327069 18929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/master-0/wal/instance:
uuid: "68498d564ba142028516d988de162e5c"
format_stamp: "Formatted at 2024-05-02 02:00:47 on dist-test-slave-tj0m"
I20240502 02:00:47.329864 18929 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20240502 02:00:47.331663 18944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:47.332473 18929 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:47.332572 18929 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/master-0/data,/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/master-0/wal
uuid: "68498d564ba142028516d988de162e5c"
format_stamp: "Formatted at 2024-05-02 02:00:47 on dist-test-slave-tj0m"
I20240502 02:00:47.332650 18929 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 02:00:47.355661 18929 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 02:00:47.356113 18929 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 02:00:47.356241 18929 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 02:00:47.361654 18929 rpc_server.cc:307] RPC server started. Bound to: 127.16.79.254:44591
I20240502 02:00:47.361658 18996 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.79.254:44591 every 8 connection(s)
I20240502 02:00:47.362425 18929 server_base.cc:1166] Dumped server information to /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/master-0/data/info.pb
I20240502 02:00:47.363744 16703 external_mini_cluster.cc:1388] Started /tmp/dist-test-task3rm6An/build/debug/bin/kudu as pid 18929
I20240502 02:00:47.363827 16703 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/master-0/wal/instance
I20240502 02:00:47.364697 18997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:47.369689 18997 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c: Bootstrap starting.
I20240502 02:00:47.371549 18997 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c: Neither blocks nor log segments found. Creating new log.
I20240502 02:00:47.372138 18997 log.cc:824] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c: Log is configured to *not* fsync() on all Append() calls
I20240502 02:00:47.373431 18997 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c: No bootstrap required, opened a new log
I20240502 02:00:47.375599 18997 raft_consensus.cc:348] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68498d564ba142028516d988de162e5c" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 44591 } }
I20240502 02:00:47.375757 18997 raft_consensus.cc:374] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 02:00:47.375823 18997 raft_consensus.cc:729] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68498d564ba142028516d988de162e5c, State: Initialized, Role: FOLLOWER
I20240502 02:00:47.376154 18997 consensus_queue.cc:260] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68498d564ba142028516d988de162e5c" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 44591 } }
I20240502 02:00:47.376259 18997 raft_consensus.cc:388] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:47.376315 18997 raft_consensus.cc:482] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:47.376407 18997 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c [term 0 FOLLOWER]: Advancing to term 1
I20240502 02:00:47.377007 18997 raft_consensus.cc:504] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68498d564ba142028516d988de162e5c" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 44591 } }
I20240502 02:00:47.377274 18997 leader_election.cc:302] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 68498d564ba142028516d988de162e5c; no voters:
I20240502 02:00:47.377496 18997 leader_election.cc:288] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 02:00:47.377573 19002 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c [term 1 FOLLOWER]: Leader election won for term 1
I20240502 02:00:47.377790 19002 raft_consensus.cc:686] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c [term 1 LEADER]: Becoming Leader. State: Replica: 68498d564ba142028516d988de162e5c, State: Running, Role: LEADER
I20240502 02:00:47.378082 19002 consensus_queue.cc:237] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68498d564ba142028516d988de162e5c" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 44591 } }
I20240502 02:00:47.378494 18997 sys_catalog.cc:564] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c [sys.catalog]: configured and running, proceeding with master startup.
I20240502 02:00:47.379109 19002 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 68498d564ba142028516d988de162e5c. Latest consensus state: current_term: 1 leader_uuid: "68498d564ba142028516d988de162e5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68498d564ba142028516d988de162e5c" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 44591 } } }
I20240502 02:00:47.379292 19002 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c [sys.catalog]: This master's current role is: LEADER
I20240502 02:00:47.379397 19003 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "68498d564ba142028516d988de162e5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68498d564ba142028516d988de162e5c" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 44591 } } }
I20240502 02:00:47.379503 19003 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c [sys.catalog]: This master's current role is: LEADER
I20240502 02:00:47.379706 19007 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 02:00:47.382364 19007 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 02:00:47.386938 19007 catalog_manager.cc:1347] Generated new cluster ID: baf33e25d43443948932d322dec4ee66
I20240502 02:00:47.386989 19007 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 02:00:47.394963 19007 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 02:00:47.395660 19007 catalog_manager.cc:1504] Loading token signing keys...
I20240502 02:00:47.403478 19007 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c: Generated new TSK 0
I20240502 02:00:47.403975 19007 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 02:00:47.415103 16703 external_mini_cluster.cc:1326] Running /tmp/dist-test-task3rm6An/build/debug/bin/kudu
/tmp/dist-test-task3rm6An/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.79.193:0
--local_ip_for_outbound_sockets=127.16.79.193
--webserver_interface=127.16.79.193
--webserver_port=0
--tserver_master_addrs=127.16.79.254:44591
--builtin_ntp_servers=127.16.79.212:36445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240502 02:00:47.526679 19021 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 02:00:47.526839 19021 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 02:00:47.526885 19021 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 02:00:47.529821 19021 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 02:00:47.529915 19021 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.79.193
I20240502 02:00:47.533270 19021 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.79.212:36445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.79.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.79.193
--webserver_port=0
--tserver_master_addrs=127.16.79.254:44591
--never_fsync=true
--heap_profile_path=/tmp/kudu.19021
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.79.193
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 02:00:47.533978 19021 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 02:00:47.534920 19021 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 02:00:47.542456 19026 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:47.542946 19029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:47.543366 19027 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 02:00:47.543818 19021 server_base.cc:1034] running on GCE node
I20240502 02:00:47.544169 19021 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 02:00:47.544626 19021 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 02:00:47.545781 19021 hybrid_clock.cc:648] HybridClock initialized: now 1714615247545769 us; error 23 us; skew 500 ppm
I20240502 02:00:47.547334 19021 webserver.cc:460] Webserver started at http://127.16.79.193:33801/ using document root <none> and password file <none>
I20240502 02:00:47.547780 19021 fs_manager.cc:359] Metadata directory not provided
I20240502 02:00:47.547827 19021 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 02:00:47.547967 19021 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 02:00:47.549355 19021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-0/data/instance:
uuid: "e683ded9f12c4b58b540aa5f0062ba24"
format_stamp: "Formatted at 2024-05-02 02:00:47 on dist-test-slave-tj0m"
I20240502 02:00:47.549782 19021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-0/wal/instance:
uuid: "e683ded9f12c4b58b540aa5f0062ba24"
format_stamp: "Formatted at 2024-05-02 02:00:47 on dist-test-slave-tj0m"
I20240502 02:00:47.552629 19021 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20240502 02:00:47.554591 19035 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:47.555413 19021 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240502 02:00:47.555514 19021 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-0/data,/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-0/wal
uuid: "e683ded9f12c4b58b540aa5f0062ba24"
format_stamp: "Formatted at 2024-05-02 02:00:47 on dist-test-slave-tj0m"
I20240502 02:00:47.555609 19021 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 02:00:47.599256 19021 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 02:00:47.599737 19021 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 02:00:47.599870 19021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 02:00:47.600311 19021 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 02:00:47.601212 19021 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 02:00:47.601267 19021 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:47.601315 19021 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 02:00:47.601344 19021 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:47.609053 19021 rpc_server.cc:307] RPC server started. Bound to: 127.16.79.193:39403
I20240502 02:00:47.609102 19148 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.79.193:39403 every 8 connection(s)
I20240502 02:00:47.609941 19021 server_base.cc:1166] Dumped server information to /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-0/data/info.pb
I20240502 02:00:47.610811 16703 external_mini_cluster.cc:1388] Started /tmp/dist-test-task3rm6An/build/debug/bin/kudu as pid 19021
I20240502 02:00:47.610900 16703 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-0/wal/instance
I20240502 02:00:47.612705 16703 external_mini_cluster.cc:1326] Running /tmp/dist-test-task3rm6An/build/debug/bin/kudu
/tmp/dist-test-task3rm6An/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.79.194:0
--local_ip_for_outbound_sockets=127.16.79.194
--webserver_interface=127.16.79.194
--webserver_port=0
--tserver_master_addrs=127.16.79.254:44591
--builtin_ntp_servers=127.16.79.212:36445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240502 02:00:47.618057 19149 heartbeater.cc:347] Connected to a master server at 127.16.79.254:44591
I20240502 02:00:47.618239 19149 heartbeater.cc:464] Registering TS with master...
I20240502 02:00:47.618670 19149 heartbeater.cc:511] Master 127.16.79.254:44591 requested a full tablet report, sending...
I20240502 02:00:47.619896 18961 ts_manager.cc:194] Registered new tserver with Master: e683ded9f12c4b58b540aa5f0062ba24 (127.16.79.193:39403)
I20240502 02:00:47.620929 18961 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.79.193:50243
W20240502 02:00:47.709404 19152 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 02:00:47.709563 19152 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 02:00:47.709614 19152 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 02:00:47.712505 19152 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 02:00:47.712612 19152 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.79.194
I20240502 02:00:47.715952 19152 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.79.212:36445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.79.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.79.194
--webserver_port=0
--tserver_master_addrs=127.16.79.254:44591
--never_fsync=true
--heap_profile_path=/tmp/kudu.19152
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.79.194
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 02:00:47.716593 19152 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 02:00:47.717455 19152 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 02:00:47.724339 19157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:47.724563 19160 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:47.724962 19158 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 02:00:47.725591 19152 server_base.cc:1034] running on GCE node
I20240502 02:00:47.725903 19152 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 02:00:47.726356 19152 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 02:00:47.727506 19152 hybrid_clock.cc:648] HybridClock initialized: now 1714615247727483 us; error 37 us; skew 500 ppm
I20240502 02:00:47.729017 19152 webserver.cc:460] Webserver started at http://127.16.79.194:41705/ using document root <none> and password file <none>
I20240502 02:00:47.729472 19152 fs_manager.cc:359] Metadata directory not provided
I20240502 02:00:47.729528 19152 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 02:00:47.729671 19152 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 02:00:47.731073 19152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-1/data/instance:
uuid: "ecdc3fa649524fc6ba6b280bc86ff67d"
format_stamp: "Formatted at 2024-05-02 02:00:47 on dist-test-slave-tj0m"
I20240502 02:00:47.731487 19152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-1/wal/instance:
uuid: "ecdc3fa649524fc6ba6b280bc86ff67d"
format_stamp: "Formatted at 2024-05-02 02:00:47 on dist-test-slave-tj0m"
I20240502 02:00:47.734268 19152 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20240502 02:00:47.736182 19166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:47.737090 19152 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:47.737195 19152 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-1/data,/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-1/wal
uuid: "ecdc3fa649524fc6ba6b280bc86ff67d"
format_stamp: "Formatted at 2024-05-02 02:00:47 on dist-test-slave-tj0m"
I20240502 02:00:47.737265 19152 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 02:00:47.756649 19152 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 02:00:47.757081 19152 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 02:00:47.757215 19152 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 02:00:47.757619 19152 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 02:00:47.758368 19152 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 02:00:47.758414 19152 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:47.758458 19152 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 02:00:47.758487 19152 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:47.765645 19152 rpc_server.cc:307] RPC server started. Bound to: 127.16.79.194:35939
I20240502 02:00:47.765676 19279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.79.194:35939 every 8 connection(s)
I20240502 02:00:47.766373 19152 server_base.cc:1166] Dumped server information to /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-1/data/info.pb
I20240502 02:00:47.767462 16703 external_mini_cluster.cc:1388] Started /tmp/dist-test-task3rm6An/build/debug/bin/kudu as pid 19152
I20240502 02:00:47.767549 16703 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-1/wal/instance
I20240502 02:00:47.773541 19280 heartbeater.cc:347] Connected to a master server at 127.16.79.254:44591
I20240502 02:00:47.773712 19280 heartbeater.cc:464] Registering TS with master...
I20240502 02:00:47.774158 19280 heartbeater.cc:511] Master 127.16.79.254:44591 requested a full tablet report, sending...
I20240502 02:00:47.774971 18961 ts_manager.cc:194] Registered new tserver with Master: ecdc3fa649524fc6ba6b280bc86ff67d (127.16.79.194:35939)
I20240502 02:00:47.775467 18961 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.79.194:58633
I20240502 02:00:47.781008 16703 external_mini_cluster.cc:930] 2 TS(s) registered with all masters
I20240502 02:00:47.787778 16703 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task3rm6An/build/debug/bin/kudu with pid 19152
I20240502 02:00:47.792738 16703 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task3rm6An/build/debug/bin/kudu with pid 18929
I20240502 02:00:47.798146 16703 external_mini_cluster.cc:1326] Running /tmp/dist-test-task3rm6An/build/debug/bin/kudu
/tmp/dist-test-task3rm6An/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.79.254:44591
--webserver_interface=127.16.79.254
--webserver_port=42237
--builtin_ntp_servers=127.16.79.212:36445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.79.254:44591
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240502 02:00:47.897802 19288 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 02:00:47.897962 19288 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 02:00:47.898000 19288 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 02:00:47.900838 19288 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 02:00:47.900882 19288 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 02:00:47.900899 19288 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 02:00:47.900924 19288 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 02:00:47.904402 19288 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.79.212:36445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.16.79.254:44591
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.79.254:44591
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.79.254
--webserver_port=42237
--never_fsync=true
--heap_profile_path=/tmp/kudu.19288
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 02:00:47.905015 19288 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 02:00:47.905925 19288 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 02:00:47.912170 19293 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:47.912695 19294 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:47.913118 19296 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 02:00:47.913564 19288 server_base.cc:1034] running on GCE node
I20240502 02:00:47.913985 19288 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 02:00:47.914711 19288 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 02:00:47.915859 19288 hybrid_clock.cc:648] HybridClock initialized: now 1714615247915836 us; error 33 us; skew 500 ppm
I20240502 02:00:47.917363 19288 webserver.cc:460] Webserver started at http://127.16.79.254:42237/ using document root <none> and password file <none>
I20240502 02:00:47.917850 19288 fs_manager.cc:359] Metadata directory not provided
I20240502 02:00:47.917922 19288 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 02:00:47.920697 19288 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:47.922312 19302 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:47.923130 19288 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:47.923234 19288 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/master-0/data,/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/master-0/wal
uuid: "68498d564ba142028516d988de162e5c"
format_stamp: "Formatted at 2024-05-02 02:00:47 on dist-test-slave-tj0m"
I20240502 02:00:47.923545 19288 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 02:00:47.941125 19288 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 02:00:47.941563 19288 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 02:00:47.941696 19288 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 02:00:47.947189 19288 rpc_server.cc:307] RPC server started. Bound to: 127.16.79.254:44591
I20240502 02:00:47.947201 19354 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.79.254:44591 every 8 connection(s)
I20240502 02:00:47.948041 19288 server_base.cc:1166] Dumped server information to /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/master-0/data/info.pb
I20240502 02:00:47.951476 19355 sys_catalog.cc:263] Verifying existing consensus state
I20240502 02:00:47.952762 19355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c: Bootstrap starting.
I20240502 02:00:47.956449 16703 external_mini_cluster.cc:1388] Started /tmp/dist-test-task3rm6An/build/debug/bin/kudu as pid 19288
I20240502 02:00:47.965312 19355 log.cc:824] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c: Log is configured to *not* fsync() on all Append() calls
I20240502 02:00:47.970240 19355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 02:00:47.970556 19355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c: Bootstrap complete.
I20240502 02:00:47.973392 19355 raft_consensus.cc:348] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68498d564ba142028516d988de162e5c" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 44591 } }
I20240502 02:00:47.973685 19355 raft_consensus.cc:729] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68498d564ba142028516d988de162e5c, State: Initialized, Role: FOLLOWER
I20240502 02:00:47.974095 19355 consensus_queue.cc:260] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68498d564ba142028516d988de162e5c" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 44591 } }
I20240502 02:00:47.974206 19355 raft_consensus.cc:388] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:47.974263 19355 raft_consensus.cc:482] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:47.974354 19355 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c [term 1 FOLLOWER]: Advancing to term 2
I20240502 02:00:47.975848 19355 raft_consensus.cc:504] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68498d564ba142028516d988de162e5c" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 44591 } }
I20240502 02:00:47.976168 19355 leader_election.cc:302] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 68498d564ba142028516d988de162e5c; no voters:
I20240502 02:00:47.976405 19355 leader_election.cc:288] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 02:00:47.976502 19360 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c [term 2 FOLLOWER]: Leader election won for term 2
I20240502 02:00:47.976678 19360 raft_consensus.cc:686] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c [term 2 LEADER]: Becoming Leader. State: Replica: 68498d564ba142028516d988de162e5c, State: Running, Role: LEADER
I20240502 02:00:47.976939 19360 consensus_queue.cc:237] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68498d564ba142028516d988de162e5c" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 44591 } }
I20240502 02:00:47.977319 19355 sys_catalog.cc:564] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c [sys.catalog]: configured and running, proceeding with master startup.
I20240502 02:00:47.977681 19362 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 68498d564ba142028516d988de162e5c. Latest consensus state: current_term: 2 leader_uuid: "68498d564ba142028516d988de162e5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68498d564ba142028516d988de162e5c" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 44591 } } }
I20240502 02:00:47.977885 19362 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c [sys.catalog]: This master's current role is: LEADER
I20240502 02:00:47.978051 19361 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "68498d564ba142028516d988de162e5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68498d564ba142028516d988de162e5c" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 44591 } } }
I20240502 02:00:47.978159 19361 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c [sys.catalog]: This master's current role is: LEADER
I20240502 02:00:47.978754 19366 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 02:00:47.981352 19366 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 02:00:47.982033 19366 catalog_manager.cc:1259] Loaded cluster ID: baf33e25d43443948932d322dec4ee66
I20240502 02:00:47.982077 19366 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 02:00:47.983630 19366 catalog_manager.cc:1504] Loading token signing keys...
I20240502 02:00:47.984140 19366 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 68498d564ba142028516d988de162e5c: Loaded TSK: 0
I20240502 02:00:47.984987 19366 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 02:00:48.622736 19149 heartbeater.cc:503] Master 127.16.79.254:44591 was elected leader, sending a full tablet report...
I20240502 02:00:48.626844 19319 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "e683ded9f12c4b58b540aa5f0062ba24" instance_seqno: 1714615247606940) as {username='slave'} at 127.16.79.193:49297; Asking this server to re-register.
I20240502 02:00:48.627377 19149 heartbeater.cc:464] Registering TS with master...
I20240502 02:00:48.627534 19149 heartbeater.cc:511] Master 127.16.79.254:44591 requested a full tablet report, sending...
I20240502 02:00:48.628399 19319 ts_manager.cc:194] Registered new tserver with Master: e683ded9f12c4b58b540aa5f0062ba24 (127.16.79.193:39403)
I20240502 02:00:48.632033 16703 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20240502 02:00:48.632108 16703 test_util.cc:268] Using random seed: -120440532
I20240502 02:00:48.641510 19319 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51816:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20240502 02:00:48.655210 19083 tablet_service.cc:1467] Processing CreateTablet for tablet 711f9146de8249bf9e253aa972f664bf (DEFAULT_TABLE table=test-workload [id=141ffb05a5e64421809bc0e1770cf86f]), partition=RANGE (key) PARTITION UNBOUNDED
I20240502 02:00:48.655975 19083 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 711f9146de8249bf9e253aa972f664bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:48.660477 19390 tablet_bootstrap.cc:492] T 711f9146de8249bf9e253aa972f664bf P e683ded9f12c4b58b540aa5f0062ba24: Bootstrap starting.
I20240502 02:00:48.662267 19390 tablet_bootstrap.cc:654] T 711f9146de8249bf9e253aa972f664bf P e683ded9f12c4b58b540aa5f0062ba24: Neither blocks nor log segments found. Creating new log.
I20240502 02:00:48.662882 19390 log.cc:824] T 711f9146de8249bf9e253aa972f664bf P e683ded9f12c4b58b540aa5f0062ba24: Log is configured to *not* fsync() on all Append() calls
I20240502 02:00:48.664162 19390 tablet_bootstrap.cc:492] T 711f9146de8249bf9e253aa972f664bf P e683ded9f12c4b58b540aa5f0062ba24: No bootstrap required, opened a new log
I20240502 02:00:48.664311 19390 ts_tablet_manager.cc:1367] T 711f9146de8249bf9e253aa972f664bf P e683ded9f12c4b58b540aa5f0062ba24: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240502 02:00:48.667049 19390 raft_consensus.cc:348] T 711f9146de8249bf9e253aa972f664bf P e683ded9f12c4b58b540aa5f0062ba24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e683ded9f12c4b58b540aa5f0062ba24" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 39403 } }
I20240502 02:00:48.667200 19390 raft_consensus.cc:374] T 711f9146de8249bf9e253aa972f664bf P e683ded9f12c4b58b540aa5f0062ba24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 02:00:48.667248 19390 raft_consensus.cc:729] T 711f9146de8249bf9e253aa972f664bf P e683ded9f12c4b58b540aa5f0062ba24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e683ded9f12c4b58b540aa5f0062ba24, State: Initialized, Role: FOLLOWER
I20240502 02:00:48.667596 19390 consensus_queue.cc:260] T 711f9146de8249bf9e253aa972f664bf P e683ded9f12c4b58b540aa5f0062ba24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e683ded9f12c4b58b540aa5f0062ba24" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 39403 } }
I20240502 02:00:48.667717 19390 raft_consensus.cc:388] T 711f9146de8249bf9e253aa972f664bf P e683ded9f12c4b58b540aa5f0062ba24 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:48.667773 19390 raft_consensus.cc:482] T 711f9146de8249bf9e253aa972f664bf P e683ded9f12c4b58b540aa5f0062ba24 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:48.667867 19390 raft_consensus.cc:3037] T 711f9146de8249bf9e253aa972f664bf P e683ded9f12c4b58b540aa5f0062ba24 [term 0 FOLLOWER]: Advancing to term 1
I20240502 02:00:48.668484 19390 raft_consensus.cc:504] T 711f9146de8249bf9e253aa972f664bf P e683ded9f12c4b58b540aa5f0062ba24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e683ded9f12c4b58b540aa5f0062ba24" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 39403 } }
I20240502 02:00:48.668771 19390 leader_election.cc:302] T 711f9146de8249bf9e253aa972f664bf P e683ded9f12c4b58b540aa5f0062ba24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e683ded9f12c4b58b540aa5f0062ba24; no voters:
I20240502 02:00:48.669003 19390 leader_election.cc:288] T 711f9146de8249bf9e253aa972f664bf P e683ded9f12c4b58b540aa5f0062ba24 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 02:00:48.669087 19392 raft_consensus.cc:2781] T 711f9146de8249bf9e253aa972f664bf P e683ded9f12c4b58b540aa5f0062ba24 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 02:00:48.669282 19392 raft_consensus.cc:686] T 711f9146de8249bf9e253aa972f664bf P e683ded9f12c4b58b540aa5f0062ba24 [term 1 LEADER]: Becoming Leader. State: Replica: e683ded9f12c4b58b540aa5f0062ba24, State: Running, Role: LEADER
I20240502 02:00:48.669549 19392 consensus_queue.cc:237] T 711f9146de8249bf9e253aa972f664bf P e683ded9f12c4b58b540aa5f0062ba24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e683ded9f12c4b58b540aa5f0062ba24" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 39403 } }
I20240502 02:00:48.669716 19390 ts_tablet_manager.cc:1398] T 711f9146de8249bf9e253aa972f664bf P e683ded9f12c4b58b540aa5f0062ba24: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20240502 02:00:48.672276 19319 catalog_manager.cc:5484] T 711f9146de8249bf9e253aa972f664bf P e683ded9f12c4b58b540aa5f0062ba24 reported cstate change: term changed from 0 to 1, leader changed from <none> to e683ded9f12c4b58b540aa5f0062ba24 (127.16.79.193). New cstate: current_term: 1 leader_uuid: "e683ded9f12c4b58b540aa5f0062ba24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e683ded9f12c4b58b540aa5f0062ba24" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 39403 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:49.049465 16703 external_mini_cluster.cc:1326] Running /tmp/dist-test-task3rm6An/build/debug/bin/kudu
/tmp/dist-test-task3rm6An/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.79.194:35939
--local_ip_for_outbound_sockets=127.16.79.194
--tserver_master_addrs=127.16.79.254:44591
--webserver_port=41705
--webserver_interface=127.16.79.194
--builtin_ntp_servers=127.16.79.212:36445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240502 02:00:49.145677 19407 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 02:00:49.145856 19407 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 02:00:49.145895 19407 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 02:00:49.148712 19407 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 02:00:49.148797 19407 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.79.194
I20240502 02:00:49.152119 19407 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.79.212:36445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.79.194:35939
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.79.194
--webserver_port=41705
--tserver_master_addrs=127.16.79.254:44591
--never_fsync=true
--heap_profile_path=/tmp/kudu.19407
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.79.194
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 02:00:49.152737 19407 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 02:00:49.153609 19407 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 02:00:49.160457 19415 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:49.160856 19412 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:49.161213 19413 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 02:00:49.161841 19407 server_base.cc:1034] running on GCE node
I20240502 02:00:49.162160 19407 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 02:00:49.162614 19407 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 02:00:49.163762 19407 hybrid_clock.cc:648] HybridClock initialized: now 1714615249163747 us; error 25 us; skew 500 ppm
I20240502 02:00:49.165289 19407 webserver.cc:460] Webserver started at http://127.16.79.194:41705/ using document root <none> and password file <none>
I20240502 02:00:49.165769 19407 fs_manager.cc:359] Metadata directory not provided
I20240502 02:00:49.165843 19407 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 02:00:49.168659 19407 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:49.170275 19421 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:49.171109 19407 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:49.171203 19407 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-1/data,/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-1/wal
uuid: "ecdc3fa649524fc6ba6b280bc86ff67d"
format_stamp: "Formatted at 2024-05-02 02:00:47 on dist-test-slave-tj0m"
I20240502 02:00:49.171519 19407 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 02:00:49.188680 19407 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 02:00:49.189105 19407 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 02:00:49.189232 19407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 02:00:49.189651 19407 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 02:00:49.190384 19407 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 02:00:49.190430 19407 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:49.190474 19407 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 02:00:49.190501 19407 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:49.197676 19407 rpc_server.cc:307] RPC server started. Bound to: 127.16.79.194:35939
I20240502 02:00:49.197695 19536 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.79.194:35939 every 8 connection(s)
I20240502 02:00:49.198482 19407 server_base.cc:1166] Dumped server information to /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-1/data/info.pb
I20240502 02:00:49.203672 16703 external_mini_cluster.cc:1388] Started /tmp/dist-test-task3rm6An/build/debug/bin/kudu as pid 19407
I20240502 02:00:49.206225 19537 heartbeater.cc:347] Connected to a master server at 127.16.79.254:44591
I20240502 02:00:49.206413 19537 heartbeater.cc:464] Registering TS with master...
I20240502 02:00:49.206898 19537 heartbeater.cc:511] Master 127.16.79.254:44591 requested a full tablet report, sending...
I20240502 02:00:49.207834 19318 ts_manager.cc:194] Registered new tserver with Master: ecdc3fa649524fc6ba6b280bc86ff67d (127.16.79.194:35939)
I20240502 02:00:49.208829 19318 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.79.194:41937
I20240502 02:00:49.210613 19542 ts_tablet_manager.cc:902] T 711f9146de8249bf9e253aa972f664bf P ecdc3fa649524fc6ba6b280bc86ff67d: Initiating tablet copy from peer e683ded9f12c4b58b540aa5f0062ba24 (127.16.79.193:39403)
I20240502 02:00:49.211133 19542 tablet_copy_client.cc:308] T 711f9146de8249bf9e253aa972f664bf P ecdc3fa649524fc6ba6b280bc86ff67d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:39403
I20240502 02:00:49.214082 19123 tablet_copy_service.cc:140] P e683ded9f12c4b58b540aa5f0062ba24: Received BeginTabletCopySession request for tablet 711f9146de8249bf9e253aa972f664bf from peer ecdc3fa649524fc6ba6b280bc86ff67d ({username='slave'} at 127.16.79.194:36021)
I20240502 02:00:49.214195 19123 tablet_copy_service.cc:161] P e683ded9f12c4b58b540aa5f0062ba24: Beginning new tablet copy session on tablet 711f9146de8249bf9e253aa972f664bf from peer ecdc3fa649524fc6ba6b280bc86ff67d at {username='slave'} at 127.16.79.194:36021: session id = ecdc3fa649524fc6ba6b280bc86ff67d-711f9146de8249bf9e253aa972f664bf
I20240502 02:00:49.215179 19123 tablet_copy_source_session.cc:205] T 711f9146de8249bf9e253aa972f664bf P e683ded9f12c4b58b540aa5f0062ba24: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 02:00:49.217486 19542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 711f9146de8249bf9e253aa972f664bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:49.222028 19542 tablet_copy_client.cc:783] T 711f9146de8249bf9e253aa972f664bf P ecdc3fa649524fc6ba6b280bc86ff67d: tablet copy: Starting download of 0 data blocks...
I20240502 02:00:49.222198 19542 tablet_copy_client.cc:647] T 711f9146de8249bf9e253aa972f664bf P ecdc3fa649524fc6ba6b280bc86ff67d: tablet copy: Starting download of 1 WAL segments...
I20240502 02:00:49.225795 19542 tablet_copy_client.cc:523] T 711f9146de8249bf9e253aa972f664bf P ecdc3fa649524fc6ba6b280bc86ff67d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 02:00:49.226953 19542 tablet_bootstrap.cc:492] T 711f9146de8249bf9e253aa972f664bf P ecdc3fa649524fc6ba6b280bc86ff67d: Bootstrap starting.
I20240502 02:00:49.246848 19542 log.cc:824] T 711f9146de8249bf9e253aa972f664bf P ecdc3fa649524fc6ba6b280bc86ff67d: Log is configured to *not* fsync() on all Append() calls
I20240502 02:00:49.537400 19542 tablet_bootstrap.cc:492] T 711f9146de8249bf9e253aa972f664bf P ecdc3fa649524fc6ba6b280bc86ff67d: Bootstrap replayed 1/1 log segments. Stats: ops{read=214 overwritten=0 applied=214 ignored=0} inserts{seen=10650 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 02:00:49.537748 19542 tablet_bootstrap.cc:492] T 711f9146de8249bf9e253aa972f664bf P ecdc3fa649524fc6ba6b280bc86ff67d: Bootstrap complete.
I20240502 02:00:49.538112 19542 ts_tablet_manager.cc:1367] T 711f9146de8249bf9e253aa972f664bf P ecdc3fa649524fc6ba6b280bc86ff67d: Time spent bootstrapping tablet: real 0.311s user 0.312s sys 0.000s
I20240502 02:00:49.540086 19542 raft_consensus.cc:348] T 711f9146de8249bf9e253aa972f664bf P ecdc3fa649524fc6ba6b280bc86ff67d [term 1 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e683ded9f12c4b58b540aa5f0062ba24" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 39403 } }
I20240502 02:00:49.540278 19542 raft_consensus.cc:729] T 711f9146de8249bf9e253aa972f664bf P ecdc3fa649524fc6ba6b280bc86ff67d [term 1 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: ecdc3fa649524fc6ba6b280bc86ff67d, State: Initialized, Role: NON_PARTICIPANT
I20240502 02:00:49.540589 19542 consensus_queue.cc:260] T 711f9146de8249bf9e253aa972f664bf P ecdc3fa649524fc6ba6b280bc86ff67d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 214, Last appended: 1.214, Last appended by leader: 214, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e683ded9f12c4b58b540aa5f0062ba24" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 39403 } }
I20240502 02:00:49.541204 19537 heartbeater.cc:503] Master 127.16.79.254:44591 was elected leader, sending a full tablet report...
I20240502 02:00:49.541410 19542 ts_tablet_manager.cc:1398] T 711f9146de8249bf9e253aa972f664bf P ecdc3fa649524fc6ba6b280bc86ff67d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20240502 02:00:49.542088 19123 tablet_copy_service.cc:342] P e683ded9f12c4b58b540aa5f0062ba24: Request end of tablet copy session ecdc3fa649524fc6ba6b280bc86ff67d-711f9146de8249bf9e253aa972f664bf received from {username='slave'} at 127.16.79.194:36021
I20240502 02:00:49.542181 19123 tablet_copy_service.cc:433] P e683ded9f12c4b58b540aa5f0062ba24: ending tablet copy session ecdc3fa649524fc6ba6b280bc86ff67d-711f9146de8249bf9e253aa972f664bf on tablet 711f9146de8249bf9e253aa972f664bf with peer ecdc3fa649524fc6ba6b280bc86ff67d
I20240502 02:00:49.548635 19469 tablet_service.cc:1514] Processing DeleteTablet for tablet 711f9146de8249bf9e253aa972f664bf with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:44882
I20240502 02:00:49.548967 19549 tablet_replica.cc:330] T 711f9146de8249bf9e253aa972f664bf P ecdc3fa649524fc6ba6b280bc86ff67d: stopping tablet replica
I20240502 02:00:49.549193 19549 raft_consensus.cc:2229] T 711f9146de8249bf9e253aa972f664bf P ecdc3fa649524fc6ba6b280bc86ff67d [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20240502 02:00:49.549373 19549 raft_consensus.cc:2258] T 711f9146de8249bf9e253aa972f664bf P ecdc3fa649524fc6ba6b280bc86ff67d [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20240502 02:00:49.550431 19549 ts_tablet_manager.cc:1875] T 711f9146de8249bf9e253aa972f664bf P ecdc3fa649524fc6ba6b280bc86ff67d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 02:00:49.552109 19549 ts_tablet_manager.cc:1888] T 711f9146de8249bf9e253aa972f664bf P ecdc3fa649524fc6ba6b280bc86ff67d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.214
I20240502 02:00:49.552176 19549 log.cc:1196] T 711f9146de8249bf9e253aa972f664bf P ecdc3fa649524fc6ba6b280bc86ff67d: Deleting WAL directory at /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714615241968978-16703-0/minicluster-data/ts-1/wal/wals/711f9146de8249bf9e253aa972f664bf
I20240502 02:00:49.553157 19542 ts_tablet_manager.cc:902] T 711f9146de8249bf9e253aa972f664bf P ecdc3fa649524fc6ba6b280bc86ff67d: Initiating tablet copy from peer e683ded9f12c4b58b540aa5f0062ba24 (127.16.79.193:39403)
I20240502 02:00:49.553494 19542 tablet_copy_client.cc:308] T 711f9146de8249bf9e253aa972f664bf P ecdc3fa649524fc6ba6b280bc86ff67d: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:39403
I20240502 02:00:49.553905 19123 tablet_copy_service.cc:140] P e683ded9f12c4b58b540aa5f0062ba24: Received BeginTabletCopySession request for tablet 711f9146de8249bf9e253aa972f664bf from peer ecdc3fa649524fc6ba6b280bc86ff67d ({username='slave'} at 127.16.79.194:36021)
I20240502 02:00:49.553992 19123 tablet_copy_service.cc:161] P e683ded9f12c4b58b540aa5f0062ba24: Beginning new tablet copy session on tablet 711f9146de8249bf9e253aa972f664bf from peer ecdc3fa649524fc6ba6b280bc86ff67d at {username='slave'} at 127.16.79.194:36021: session id = ecdc3fa649524fc6ba6b280bc86ff67d-711f9146de8249bf9e253aa972f664bf
I20240502 02:00:49.554607 19123 tablet_copy_source_session.cc:205] T 711f9146de8249bf9e253aa972f664bf P e683ded9f12c4b58b540aa5f0062ba24: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 02:00:49.555101 19542 ts_tablet_manager.cc:1875] T 711f9146de8249bf9e253aa972f664bf P ecdc3fa649524fc6ba6b280bc86ff67d: Deleting tablet data with delete state TABLET_DATA_COPYING
I20240502 02:00:49.556392 19542 ts_tablet_manager.cc:1888] T 711f9146de8249bf9e253aa972f664bf P ecdc3fa649524fc6ba6b280bc86ff67d: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.214
I20240502 02:00:49.556529 19542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 711f9146de8249bf9e253aa972f664bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:49.557269 19542 tablet_copy_client.cc:783] T 711f9146de8249bf9e253aa972f664bf P ecdc3fa649524fc6ba6b280bc86ff67d: tablet copy: Starting download of 0 data blocks...
I20240502 02:00:49.557385 19542 tablet_copy_client.cc:647] T 711f9146de8249bf9e253aa972f664bf P ecdc3fa649524fc6ba6b280bc86ff67d: tablet copy: Starting download of 1 WAL segments...
I20240502 02:00:49.559365 19542 tablet_copy_client.cc:523] T 711f9146de8249bf9e253aa972f664bf P ecdc3fa649524fc6ba6b280bc86ff67d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 02:00:49.560189 19542 tablet_bootstrap.cc:492] T 711f9146de8249bf9e253aa972f664bf P ecdc3fa649524fc6ba6b280bc86ff67d: Bootstrap starting.
I20240502 02:00:49.860102 19542 tablet_bootstrap.cc:492] T 711f9146de8249bf9e253aa972f664bf P ecdc3fa649524fc6ba6b280bc86ff67d: Bootstrap replayed 1/1 log segments. Stats: ops{read=214 overwritten=0 applied=214 ignored=0} inserts{seen=10650 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 02:00:49.860366 19542 tablet_bootstrap.cc:492] T 711f9146de8249bf9e253aa972f664bf P ecdc3fa649524fc6ba6b280bc86ff67d: Bootstrap complete.
I20240502 02:00:49.860606 19542 ts_tablet_manager.cc:1367] T 711f9146de8249bf9e253aa972f664bf P ecdc3fa649524fc6ba6b280bc86ff67d: Time spent bootstrapping tablet: real 0.300s user 0.278s sys 0.020s
I20240502 02:00:49.861109 19542 raft_consensus.cc:348] T 711f9146de8249bf9e253aa972f664bf P ecdc3fa649524fc6ba6b280bc86ff67d [term 1 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e683ded9f12c4b58b540aa5f0062ba24" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 39403 } }
I20240502 02:00:49.861212 19542 raft_consensus.cc:729] T 711f9146de8249bf9e253aa972f664bf P ecdc3fa649524fc6ba6b280bc86ff67d [term 1 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: ecdc3fa649524fc6ba6b280bc86ff67d, State: Initialized, Role: NON_PARTICIPANT
I20240502 02:00:49.861303 19542 consensus_queue.cc:260] T 711f9146de8249bf9e253aa972f664bf P ecdc3fa649524fc6ba6b280bc86ff67d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 214, Last appended: 1.214, Last appended by leader: 214, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e683ded9f12c4b58b540aa5f0062ba24" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 39403 } }
I20240502 02:00:49.861524 19542 ts_tablet_manager.cc:1398] T 711f9146de8249bf9e253aa972f664bf P ecdc3fa649524fc6ba6b280bc86ff67d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 02:00:49.862017 19123 tablet_copy_service.cc:342] P e683ded9f12c4b58b540aa5f0062ba24: Request end of tablet copy session ecdc3fa649524fc6ba6b280bc86ff67d-711f9146de8249bf9e253aa972f664bf received from {username='slave'} at 127.16.79.194:36021
I20240502 02:00:49.862107 19123 tablet_copy_service.cc:433] P e683ded9f12c4b58b540aa5f0062ba24: ending tablet copy session ecdc3fa649524fc6ba6b280bc86ff67d-711f9146de8249bf9e253aa972f664bf on tablet 711f9146de8249bf9e253aa972f664bf with peer ecdc3fa649524fc6ba6b280bc86ff67d
I20240502 02:00:49.871484 16703 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task3rm6An/build/debug/bin/kudu with pid 19021
I20240502 02:00:49.877457 16703 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task3rm6An/build/debug/bin/kudu with pid 19407
I20240502 02:00:49.882359 16703 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task3rm6An/build/debug/bin/kudu with pid 19288
2024-05-02T02:00:49Z chronyd exiting
[ OK ] TabletCopyClientSessionITest.TestStartTabletCopy (2697 ms)
[ RUN ] TabletCopyClientSessionITest.TestCopyFromCrashedSource
2024-05-02T02:00:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-02T02:00:49Z Disabled control of system clock
I20240502 02:00:49.907953 16703 external_mini_cluster.cc:1326] Running /tmp/dist-test-task3rm6An/build/debug/bin/kudu
/tmp/dist-test-task3rm6An/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.79.254:39187
--webserver_interface=127.16.79.254
--webserver_port=0
--builtin_ntp_servers=127.16.79.212:40439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.79.254:39187
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240502 02:00:50.004110 19558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 02:00:50.004297 19558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 02:00:50.004359 19558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 02:00:50.007333 19558 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 02:00:50.007378 19558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 02:00:50.007398 19558 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 02:00:50.007427 19558 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 02:00:50.010926 19558 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.79.212:40439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.16.79.254:39187
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.79.254:39187
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.79.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.19558
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 02:00:50.011596 19558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 02:00:50.012497 19558 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 02:00:50.018546 19563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:50.018976 19564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:50.019492 19566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 02:00:50.020001 19558 server_base.cc:1034] running on GCE node
I20240502 02:00:50.020399 19558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 02:00:50.021138 19558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 02:00:50.022279 19558 hybrid_clock.cc:648] HybridClock initialized: now 1714615250022269 us; error 22 us; skew 500 ppm
I20240502 02:00:50.023854 19558 webserver.cc:460] Webserver started at http://127.16.79.254:40637/ using document root <none> and password file <none>
I20240502 02:00:50.024312 19558 fs_manager.cc:359] Metadata directory not provided
I20240502 02:00:50.024365 19558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 02:00:50.024515 19558 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 02:00:50.025945 19558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/master-0/data/instance:
uuid: "fbb1f93dd987486a99f317fda119f7cb"
format_stamp: "Formatted at 2024-05-02 02:00:50 on dist-test-slave-tj0m"
I20240502 02:00:50.026355 19558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/master-0/wal/instance:
uuid: "fbb1f93dd987486a99f317fda119f7cb"
format_stamp: "Formatted at 2024-05-02 02:00:50 on dist-test-slave-tj0m"
I20240502 02:00:50.029155 19558 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20240502 02:00:50.031028 19572 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:50.031863 19558 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240502 02:00:50.031968 19558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/master-0/data,/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/master-0/wal
uuid: "fbb1f93dd987486a99f317fda119f7cb"
format_stamp: "Formatted at 2024-05-02 02:00:50 on dist-test-slave-tj0m"
I20240502 02:00:50.032038 19558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 02:00:50.045053 19558 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 02:00:50.045511 19558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 02:00:50.045636 19558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 02:00:50.051312 19558 rpc_server.cc:307] RPC server started. Bound to: 127.16.79.254:39187
I20240502 02:00:50.051319 19625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.79.254:39187 every 8 connection(s)
I20240502 02:00:50.052079 19558 server_base.cc:1166] Dumped server information to /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/master-0/data/info.pb
I20240502 02:00:50.054253 19626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:50.058459 19626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb: Bootstrap starting.
I20240502 02:00:50.060338 19626 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb: Neither blocks nor log segments found. Creating new log.
I20240502 02:00:50.060901 19626 log.cc:824] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb: Log is configured to *not* fsync() on all Append() calls
I20240502 02:00:50.061699 16703 external_mini_cluster.cc:1388] Started /tmp/dist-test-task3rm6An/build/debug/bin/kudu as pid 19558
I20240502 02:00:50.061823 16703 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/master-0/wal/instance
I20240502 02:00:50.062345 19626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb: No bootstrap required, opened a new log
I20240502 02:00:50.065599 19626 raft_consensus.cc:348] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbb1f93dd987486a99f317fda119f7cb" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 39187 } }
I20240502 02:00:50.065815 19626 raft_consensus.cc:374] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 02:00:50.065874 19626 raft_consensus.cc:729] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbb1f93dd987486a99f317fda119f7cb, State: Initialized, Role: FOLLOWER
I20240502 02:00:50.066258 19626 consensus_queue.cc:260] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbb1f93dd987486a99f317fda119f7cb" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 39187 } }
I20240502 02:00:50.066385 19626 raft_consensus.cc:388] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:50.066445 19626 raft_consensus.cc:482] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:50.066548 19626 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb [term 0 FOLLOWER]: Advancing to term 1
I20240502 02:00:50.067189 19626 raft_consensus.cc:504] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbb1f93dd987486a99f317fda119f7cb" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 39187 } }
I20240502 02:00:50.067519 19626 leader_election.cc:302] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fbb1f93dd987486a99f317fda119f7cb; no voters:
I20240502 02:00:50.067777 19626 leader_election.cc:288] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 02:00:50.067857 19631 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb [term 1 FOLLOWER]: Leader election won for term 1
I20240502 02:00:50.068411 19631 raft_consensus.cc:686] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb [term 1 LEADER]: Becoming Leader. State: Replica: fbb1f93dd987486a99f317fda119f7cb, State: Running, Role: LEADER
I20240502 02:00:50.068720 19631 consensus_queue.cc:237] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbb1f93dd987486a99f317fda119f7cb" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 39187 } }
I20240502 02:00:50.068805 19626 sys_catalog.cc:564] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb [sys.catalog]: configured and running, proceeding with master startup.
I20240502 02:00:50.069842 19631 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb [sys.catalog]: SysCatalogTable state changed. Reason: New leader fbb1f93dd987486a99f317fda119f7cb. Latest consensus state: current_term: 1 leader_uuid: "fbb1f93dd987486a99f317fda119f7cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbb1f93dd987486a99f317fda119f7cb" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 39187 } } }
I20240502 02:00:50.070501 19631 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb [sys.catalog]: This master's current role is: LEADER
I20240502 02:00:50.070382 19632 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fbb1f93dd987486a99f317fda119f7cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbb1f93dd987486a99f317fda119f7cb" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 39187 } } }
I20240502 02:00:50.070801 19632 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb [sys.catalog]: This master's current role is: LEADER
I20240502 02:00:50.070868 19645 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 02:00:50.073220 19645 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 02:00:50.077522 19645 catalog_manager.cc:1347] Generated new cluster ID: 27a2646f393f49a1b263047cd297185e
I20240502 02:00:50.077579 19645 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 02:00:50.095731 19645 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 02:00:50.096418 19645 catalog_manager.cc:1504] Loading token signing keys...
I20240502 02:00:50.106007 19645 catalog_manager.cc:5857] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb: Generated new TSK 0
I20240502 02:00:50.106515 19645 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 02:00:50.117344 16703 external_mini_cluster.cc:1326] Running /tmp/dist-test-task3rm6An/build/debug/bin/kudu
/tmp/dist-test-task3rm6An/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.79.193:0
--local_ip_for_outbound_sockets=127.16.79.193
--webserver_interface=127.16.79.193
--webserver_port=0
--tserver_master_addrs=127.16.79.254:39187
--builtin_ntp_servers=127.16.79.212:40439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240502 02:00:50.225726 19650 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 02:00:50.225916 19650 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 02:00:50.225963 19650 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 02:00:50.228837 19650 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 02:00:50.228925 19650 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.79.193
I20240502 02:00:50.232329 19650 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.79.212:40439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.79.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.79.193
--webserver_port=0
--tserver_master_addrs=127.16.79.254:39187
--never_fsync=true
--heap_profile_path=/tmp/kudu.19650
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.79.193
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 02:00:50.233004 19650 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 02:00:50.233952 19650 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 02:00:50.240880 19656 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:50.241217 19655 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:50.241807 19658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 02:00:50.242290 19650 server_base.cc:1034] running on GCE node
I20240502 02:00:50.242571 19650 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 02:00:50.242981 19650 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 02:00:50.244112 19650 hybrid_clock.cc:648] HybridClock initialized: now 1714615250244099 us; error 26 us; skew 500 ppm
I20240502 02:00:50.245669 19650 webserver.cc:460] Webserver started at http://127.16.79.193:42309/ using document root <none> and password file <none>
I20240502 02:00:50.246141 19650 fs_manager.cc:359] Metadata directory not provided
I20240502 02:00:50.246199 19650 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 02:00:50.246362 19650 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 02:00:50.247746 19650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-0/data/instance:
uuid: "b97be70f2302490b9aa9382861fa9841"
format_stamp: "Formatted at 2024-05-02 02:00:50 on dist-test-slave-tj0m"
I20240502 02:00:50.248149 19650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-0/wal/instance:
uuid: "b97be70f2302490b9aa9382861fa9841"
format_stamp: "Formatted at 2024-05-02 02:00:50 on dist-test-slave-tj0m"
I20240502 02:00:50.250994 19650 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20240502 02:00:50.252784 19664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:50.253643 19650 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:50.253793 19650 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-0/data,/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-0/wal
uuid: "b97be70f2302490b9aa9382861fa9841"
format_stamp: "Formatted at 2024-05-02 02:00:50 on dist-test-slave-tj0m"
I20240502 02:00:50.253867 19650 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 02:00:50.272529 19650 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 02:00:50.272954 19650 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 02:00:50.273080 19650 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 02:00:50.273499 19650 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 02:00:50.274268 19650 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 02:00:50.274312 19650 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:50.274358 19650 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 02:00:50.274387 19650 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:50.281663 19650 rpc_server.cc:307] RPC server started. Bound to: 127.16.79.193:37461
I20240502 02:00:50.281715 19779 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.79.193:37461 every 8 connection(s)
I20240502 02:00:50.282414 19650 server_base.cc:1166] Dumped server information to /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-0/data/info.pb
I20240502 02:00:50.289848 19780 heartbeater.cc:347] Connected to a master server at 127.16.79.254:39187
I20240502 02:00:50.290028 19780 heartbeater.cc:464] Registering TS with master...
I20240502 02:00:50.290453 19780 heartbeater.cc:511] Master 127.16.79.254:39187 requested a full tablet report, sending...
I20240502 02:00:50.291697 19590 ts_manager.cc:194] Registered new tserver with Master: b97be70f2302490b9aa9382861fa9841 (127.16.79.193:37461)
I20240502 02:00:50.292388 16703 external_mini_cluster.cc:1388] Started /tmp/dist-test-task3rm6An/build/debug/bin/kudu as pid 19650
I20240502 02:00:50.292502 16703 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-0/wal/instance
I20240502 02:00:50.293010 19590 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.79.193:56179
I20240502 02:00:50.294476 16703 external_mini_cluster.cc:1326] Running /tmp/dist-test-task3rm6An/build/debug/bin/kudu
/tmp/dist-test-task3rm6An/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.79.194:0
--local_ip_for_outbound_sockets=127.16.79.194
--webserver_interface=127.16.79.194
--webserver_port=0
--tserver_master_addrs=127.16.79.254:39187
--builtin_ntp_servers=127.16.79.212:40439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240502 02:00:50.390153 19783 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 02:00:50.390317 19783 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 02:00:50.390372 19783 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 02:00:50.393242 19783 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 02:00:50.393348 19783 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.79.194
I20240502 02:00:50.396710 19783 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.79.212:40439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.79.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.79.194
--webserver_port=0
--tserver_master_addrs=127.16.79.254:39187
--never_fsync=true
--heap_profile_path=/tmp/kudu.19783
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.79.194
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 02:00:50.397367 19783 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 02:00:50.398284 19783 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 02:00:50.405090 19791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:50.405490 19788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:50.406044 19789 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 02:00:50.406566 19783 server_base.cc:1034] running on GCE node
I20240502 02:00:50.406875 19783 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 02:00:50.407306 19783 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 02:00:50.408449 19783 hybrid_clock.cc:648] HybridClock initialized: now 1714615250408441 us; error 23 us; skew 500 ppm
I20240502 02:00:50.409966 19783 webserver.cc:460] Webserver started at http://127.16.79.194:41493/ using document root <none> and password file <none>
I20240502 02:00:50.410408 19783 fs_manager.cc:359] Metadata directory not provided
I20240502 02:00:50.410461 19783 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 02:00:50.410616 19783 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 02:00:50.411970 19783 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-1/data/instance:
uuid: "0abd3eeb083a4ae785956f25bbdfeeb5"
format_stamp: "Formatted at 2024-05-02 02:00:50 on dist-test-slave-tj0m"
I20240502 02:00:50.412365 19783 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-1/wal/instance:
uuid: "0abd3eeb083a4ae785956f25bbdfeeb5"
format_stamp: "Formatted at 2024-05-02 02:00:50 on dist-test-slave-tj0m"
I20240502 02:00:50.415135 19783 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20240502 02:00:50.416870 19797 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:50.417681 19783 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:50.417804 19783 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-1/data,/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-1/wal
uuid: "0abd3eeb083a4ae785956f25bbdfeeb5"
format_stamp: "Formatted at 2024-05-02 02:00:50 on dist-test-slave-tj0m"
I20240502 02:00:50.417873 19783 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 02:00:50.447737 19783 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 02:00:50.448153 19783 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 02:00:50.448279 19783 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 02:00:50.448678 19783 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 02:00:50.449384 19783 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 02:00:50.449429 19783 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:50.449474 19783 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 02:00:50.449501 19783 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:50.456777 19783 rpc_server.cc:307] RPC server started. Bound to: 127.16.79.194:35761
I20240502 02:00:50.456805 19912 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.79.194:35761 every 8 connection(s)
I20240502 02:00:50.457537 19783 server_base.cc:1166] Dumped server information to /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-1/data/info.pb
I20240502 02:00:50.458557 16703 external_mini_cluster.cc:1388] Started /tmp/dist-test-task3rm6An/build/debug/bin/kudu as pid 19783
I20240502 02:00:50.458673 16703 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-1/wal/instance
I20240502 02:00:50.465052 19913 heartbeater.cc:347] Connected to a master server at 127.16.79.254:39187
I20240502 02:00:50.465222 19913 heartbeater.cc:464] Registering TS with master...
I20240502 02:00:50.465626 19913 heartbeater.cc:511] Master 127.16.79.254:39187 requested a full tablet report, sending...
I20240502 02:00:50.466475 19589 ts_manager.cc:194] Registered new tserver with Master: 0abd3eeb083a4ae785956f25bbdfeeb5 (127.16.79.194:35761)
I20240502 02:00:50.466979 19589 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.79.194:40687
I20240502 02:00:50.472100 16703 external_mini_cluster.cc:930] 2 TS(s) registered with all masters
I20240502 02:00:50.478456 16703 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task3rm6An/build/debug/bin/kudu with pid 19783
I20240502 02:00:50.484330 16703 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task3rm6An/build/debug/bin/kudu with pid 19558
I20240502 02:00:50.490188 16703 external_mini_cluster.cc:1326] Running /tmp/dist-test-task3rm6An/build/debug/bin/kudu
/tmp/dist-test-task3rm6An/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.79.254:39187
--webserver_interface=127.16.79.254
--webserver_port=40637
--builtin_ntp_servers=127.16.79.212:40439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.79.254:39187
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240502 02:00:50.586374 19921 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 02:00:50.586555 19921 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 02:00:50.586607 19921 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 02:00:50.589483 19921 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 02:00:50.589537 19921 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 02:00:50.589565 19921 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 02:00:50.589592 19921 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 02:00:50.593021 19921 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.79.212:40439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.16.79.254:39187
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.79.254:39187
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.79.254
--webserver_port=40637
--never_fsync=true
--heap_profile_path=/tmp/kudu.19921
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 02:00:50.593694 19921 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 02:00:50.594610 19921 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 02:00:50.600703 19926 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:50.601177 19927 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:50.601666 19929 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 02:00:50.602147 19921 server_base.cc:1034] running on GCE node
I20240502 02:00:50.602553 19921 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 02:00:50.603377 19921 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 02:00:50.604555 19921 hybrid_clock.cc:648] HybridClock initialized: now 1714615250604542 us; error 29 us; skew 500 ppm
I20240502 02:00:50.606174 19921 webserver.cc:460] Webserver started at http://127.16.79.254:40637/ using document root <none> and password file <none>
I20240502 02:00:50.606603 19921 fs_manager.cc:359] Metadata directory not provided
I20240502 02:00:50.606662 19921 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 02:00:50.609472 19921 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20240502 02:00:50.611151 19935 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:50.611971 19921 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240502 02:00:50.612076 19921 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/master-0/data,/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/master-0/wal
uuid: "fbb1f93dd987486a99f317fda119f7cb"
format_stamp: "Formatted at 2024-05-02 02:00:50 on dist-test-slave-tj0m"
I20240502 02:00:50.612388 19921 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 02:00:50.636368 19921 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 02:00:50.636799 19921 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 02:00:50.636907 19921 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 02:00:50.642556 19921 rpc_server.cc:307] RPC server started. Bound to: 127.16.79.254:39187
I20240502 02:00:50.642566 19988 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.79.254:39187 every 8 connection(s)
I20240502 02:00:50.643400 19921 server_base.cc:1166] Dumped server information to /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/master-0/data/info.pb
I20240502 02:00:50.644026 16703 external_mini_cluster.cc:1388] Started /tmp/dist-test-task3rm6An/build/debug/bin/kudu as pid 19921
I20240502 02:00:50.646773 19989 sys_catalog.cc:263] Verifying existing consensus state
I20240502 02:00:50.648078 19989 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb: Bootstrap starting.
I20240502 02:00:50.660387 19989 log.cc:824] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb: Log is configured to *not* fsync() on all Append() calls
I20240502 02:00:50.665540 19989 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 02:00:50.665853 19989 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb: Bootstrap complete.
I20240502 02:00:50.668525 19989 raft_consensus.cc:348] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbb1f93dd987486a99f317fda119f7cb" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 39187 } }
I20240502 02:00:50.668798 19989 raft_consensus.cc:729] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbb1f93dd987486a99f317fda119f7cb, State: Initialized, Role: FOLLOWER
I20240502 02:00:50.669179 19989 consensus_queue.cc:260] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbb1f93dd987486a99f317fda119f7cb" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 39187 } }
I20240502 02:00:50.669287 19989 raft_consensus.cc:388] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:50.669345 19989 raft_consensus.cc:482] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:50.669440 19989 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb [term 1 FOLLOWER]: Advancing to term 2
I20240502 02:00:50.670763 19989 raft_consensus.cc:504] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbb1f93dd987486a99f317fda119f7cb" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 39187 } }
I20240502 02:00:50.671036 19989 leader_election.cc:302] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fbb1f93dd987486a99f317fda119f7cb; no voters:
I20240502 02:00:50.671268 19989 leader_election.cc:288] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 02:00:50.671350 19994 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb [term 2 FOLLOWER]: Leader election won for term 2
I20240502 02:00:50.671581 19994 raft_consensus.cc:686] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb [term 2 LEADER]: Becoming Leader. State: Replica: fbb1f93dd987486a99f317fda119f7cb, State: Running, Role: LEADER
I20240502 02:00:50.671835 19994 consensus_queue.cc:237] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbb1f93dd987486a99f317fda119f7cb" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 39187 } }
I20240502 02:00:50.672149 19989 sys_catalog.cc:564] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb [sys.catalog]: configured and running, proceeding with master startup.
I20240502 02:00:50.672962 19995 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "fbb1f93dd987486a99f317fda119f7cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbb1f93dd987486a99f317fda119f7cb" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 39187 } } }
I20240502 02:00:50.673180 19996 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb [sys.catalog]: SysCatalogTable state changed. Reason: New leader fbb1f93dd987486a99f317fda119f7cb. Latest consensus state: current_term: 2 leader_uuid: "fbb1f93dd987486a99f317fda119f7cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbb1f93dd987486a99f317fda119f7cb" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 39187 } } }
I20240502 02:00:50.673285 19995 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb [sys.catalog]: This master's current role is: LEADER
I20240502 02:00:50.673323 19996 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb [sys.catalog]: This master's current role is: LEADER
I20240502 02:00:50.673699 20004 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 02:00:50.676143 20004 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 02:00:50.676726 20004 catalog_manager.cc:1259] Loaded cluster ID: 27a2646f393f49a1b263047cd297185e
I20240502 02:00:50.676774 20004 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 02:00:50.678336 20004 catalog_manager.cc:1504] Loading token signing keys...
I20240502 02:00:50.678855 20004 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fbb1f93dd987486a99f317fda119f7cb: Loaded TSK: 0
I20240502 02:00:50.679704 20004 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 02:00:51.294960 19780 heartbeater.cc:503] Master 127.16.79.254:39187 was elected leader, sending a full tablet report...
I20240502 02:00:51.299124 19952 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "b97be70f2302490b9aa9382861fa9841" instance_seqno: 1714615250279722) as {username='slave'} at 127.16.79.193:49909; Asking this server to re-register.
I20240502 02:00:51.299623 19780 heartbeater.cc:464] Registering TS with master...
I20240502 02:00:51.299778 19780 heartbeater.cc:511] Master 127.16.79.254:39187 requested a full tablet report, sending...
I20240502 02:00:51.300601 19952 ts_manager.cc:194] Registered new tserver with Master: b97be70f2302490b9aa9382861fa9841 (127.16.79.193:37461)
I20240502 02:00:51.309556 16703 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20240502 02:00:51.309629 16703 test_util.cc:268] Using random seed: -117763010
I20240502 02:00:51.318430 19952 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55224:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20240502 02:00:51.331918 19713 tablet_service.cc:1467] Processing CreateTablet for tablet f50c566dd5a44f5d89f3eb9373bb1cbc (DEFAULT_TABLE table=test-workload [id=d58a8254d3fc4560b0f7c93b600f3b82]), partition=RANGE (key) PARTITION UNBOUNDED
I20240502 02:00:51.332665 19713 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f50c566dd5a44f5d89f3eb9373bb1cbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:51.337133 20025 tablet_bootstrap.cc:492] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841: Bootstrap starting.
I20240502 02:00:51.338927 20025 tablet_bootstrap.cc:654] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841: Neither blocks nor log segments found. Creating new log.
I20240502 02:00:51.339553 20025 log.cc:824] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841: Log is configured to *not* fsync() on all Append() calls
I20240502 02:00:51.340832 20025 tablet_bootstrap.cc:492] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841: No bootstrap required, opened a new log
I20240502 02:00:51.340983 20025 ts_tablet_manager.cc:1367] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240502 02:00:51.343793 20025 raft_consensus.cc:348] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b97be70f2302490b9aa9382861fa9841" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 37461 } }
I20240502 02:00:51.343937 20025 raft_consensus.cc:374] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 02:00:51.343983 20025 raft_consensus.cc:729] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b97be70f2302490b9aa9382861fa9841, State: Initialized, Role: FOLLOWER
I20240502 02:00:51.344357 20025 consensus_queue.cc:260] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b97be70f2302490b9aa9382861fa9841" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 37461 } }
I20240502 02:00:51.344467 20025 raft_consensus.cc:388] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:51.344524 20025 raft_consensus.cc:482] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:51.344619 20025 raft_consensus.cc:3037] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841 [term 0 FOLLOWER]: Advancing to term 1
I20240502 02:00:51.345256 20025 raft_consensus.cc:504] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b97be70f2302490b9aa9382861fa9841" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 37461 } }
I20240502 02:00:51.345533 20025 leader_election.cc:302] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b97be70f2302490b9aa9382861fa9841; no voters:
I20240502 02:00:51.345795 20025 leader_election.cc:288] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 02:00:51.345882 20027 raft_consensus.cc:2781] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 02:00:51.346076 20027 raft_consensus.cc:686] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841 [term 1 LEADER]: Becoming Leader. State: Replica: b97be70f2302490b9aa9382861fa9841, State: Running, Role: LEADER
I20240502 02:00:51.346385 20027 consensus_queue.cc:237] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b97be70f2302490b9aa9382861fa9841" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 37461 } }
I20240502 02:00:51.346832 20025 ts_tablet_manager.cc:1398] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20240502 02:00:51.349416 19952 catalog_manager.cc:5484] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841 reported cstate change: term changed from 0 to 1, leader changed from <none> to b97be70f2302490b9aa9382861fa9841 (127.16.79.193). New cstate: current_term: 1 leader_uuid: "b97be70f2302490b9aa9382861fa9841" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b97be70f2302490b9aa9382861fa9841" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 37461 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:51.730787 16703 external_mini_cluster.cc:1326] Running /tmp/dist-test-task3rm6An/build/debug/bin/kudu
/tmp/dist-test-task3rm6An/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.79.194:35761
--local_ip_for_outbound_sockets=127.16.79.194
--tserver_master_addrs=127.16.79.254:39187
--webserver_port=41493
--webserver_interface=127.16.79.194
--builtin_ntp_servers=127.16.79.212:40439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240502 02:00:51.830369 20042 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 02:00:51.830523 20042 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 02:00:51.830595 20042 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 02:00:51.833833 20042 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 02:00:51.833943 20042 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.79.194
I20240502 02:00:51.838174 20042 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.79.212:40439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.79.194:35761
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.79.194
--webserver_port=41493
--tserver_master_addrs=127.16.79.254:39187
--never_fsync=true
--heap_profile_path=/tmp/kudu.20042
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.79.194
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 02:00:51.838840 20042 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 02:00:51.839736 20042 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 02:00:51.846586 20050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:51.846966 20048 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:51.847548 20047 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 02:00:51.848009 20042 server_base.cc:1034] running on GCE node
I20240502 02:00:51.848332 20042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 02:00:51.848791 20042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 02:00:51.849934 20042 hybrid_clock.cc:648] HybridClock initialized: now 1714615251849910 us; error 34 us; skew 500 ppm
I20240502 02:00:51.851537 20042 webserver.cc:460] Webserver started at http://127.16.79.194:41493/ using document root <none> and password file <none>
I20240502 02:00:51.851997 20042 fs_manager.cc:359] Metadata directory not provided
I20240502 02:00:51.852067 20042 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 02:00:51.854943 20042 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20240502 02:00:51.856572 20056 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:51.857452 20042 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:51.857573 20042 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-1/data,/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-1/wal
uuid: "0abd3eeb083a4ae785956f25bbdfeeb5"
format_stamp: "Formatted at 2024-05-02 02:00:50 on dist-test-slave-tj0m"
I20240502 02:00:51.857956 20042 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 02:00:51.868748 20042 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 02:00:51.869175 20042 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 02:00:51.869302 20042 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 02:00:51.869721 20042 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 02:00:51.870491 20042 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 02:00:51.870550 20042 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:51.870597 20042 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 02:00:51.870622 20042 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:51.878468 20042 rpc_server.cc:307] RPC server started. Bound to: 127.16.79.194:35761
I20240502 02:00:51.878500 20171 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.79.194:35761 every 8 connection(s)
I20240502 02:00:51.879277 20042 server_base.cc:1166] Dumped server information to /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-1/data/info.pb
I20240502 02:00:51.885443 16703 external_mini_cluster.cc:1388] Started /tmp/dist-test-task3rm6An/build/debug/bin/kudu as pid 20042
I20240502 02:00:51.887039 20172 heartbeater.cc:347] Connected to a master server at 127.16.79.254:39187
I20240502 02:00:51.887219 20172 heartbeater.cc:464] Registering TS with master...
I20240502 02:00:51.887692 20172 heartbeater.cc:511] Master 127.16.79.254:39187 requested a full tablet report, sending...
W20240502 02:00:51.887710 19774 generic_service.cc:139] {username='slave'} at 127.0.0.1:46898 forcing change of non-runtime-safe flag fault_crash_on_handle_tc_fetch_data
I20240502 02:00:51.887804 19774 generic_service.cc:175] {username='slave'} at 127.0.0.1:46898 changed flags via RPC: fault_crash_on_handle_tc_fetch_data from '0' to '1.0'
I20240502 02:00:51.888653 19948 ts_manager.cc:194] Registered new tserver with Master: 0abd3eeb083a4ae785956f25bbdfeeb5 (127.16.79.194:35761)
I20240502 02:00:51.889678 19948 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.79.194:53093
I20240502 02:00:51.893491 20177 ts_tablet_manager.cc:902] T f50c566dd5a44f5d89f3eb9373bb1cbc P 0abd3eeb083a4ae785956f25bbdfeeb5: Initiating tablet copy from peer b97be70f2302490b9aa9382861fa9841 (127.16.79.193:37461)
I20240502 02:00:51.894054 20177 tablet_copy_client.cc:308] T f50c566dd5a44f5d89f3eb9373bb1cbc P 0abd3eeb083a4ae785956f25bbdfeeb5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:37461
I20240502 02:00:51.897020 19754 tablet_copy_service.cc:140] P b97be70f2302490b9aa9382861fa9841: Received BeginTabletCopySession request for tablet f50c566dd5a44f5d89f3eb9373bb1cbc from peer 0abd3eeb083a4ae785956f25bbdfeeb5 ({username='slave'} at 127.16.79.194:52907)
I20240502 02:00:51.897130 19754 tablet_copy_service.cc:161] P b97be70f2302490b9aa9382861fa9841: Beginning new tablet copy session on tablet f50c566dd5a44f5d89f3eb9373bb1cbc from peer 0abd3eeb083a4ae785956f25bbdfeeb5 at {username='slave'} at 127.16.79.194:52907: session id = 0abd3eeb083a4ae785956f25bbdfeeb5-f50c566dd5a44f5d89f3eb9373bb1cbc
I20240502 02:00:51.898185 19754 tablet_copy_source_session.cc:205] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 02:00:51.900524 20177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f50c566dd5a44f5d89f3eb9373bb1cbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:51.905104 20177 tablet_copy_client.cc:783] T f50c566dd5a44f5d89f3eb9373bb1cbc P 0abd3eeb083a4ae785956f25bbdfeeb5: tablet copy: Starting download of 0 data blocks...
I20240502 02:00:51.905273 20177 tablet_copy_client.cc:647] T f50c566dd5a44f5d89f3eb9373bb1cbc P 0abd3eeb083a4ae785956f25bbdfeeb5: tablet copy: Starting download of 1 WAL segments...
W20240502 02:00:51.906025 19754 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20240502 02:00:51.906066 19754 fault_injection.cc:44] THIS SERVER MAY CRASH!
E20240502 02:00:51.906081 19754 fault_injection.cc:59] injecting fault for kudu (pid 19650): FLAGS_fault_crash_on_handle_tc_fetch_data (process will exit)
W20240502 02:00:51.912423 20177 ts_tablet_manager.cc:980] T f50c566dd5a44f5d89f3eb9373bb1cbc P 0abd3eeb083a4ae785956f25bbdfeeb5: Tablet Copy: Unable to fetch data from remote peer b97be70f2302490b9aa9382861fa9841 (127.16.79.193:37461): Network error: Unable to download WAL segment with seq. number 1: unable to fetch data from remote: recv got EOF from 127.16.79.193:37461 (error 108)
I20240502 02:00:51.912487 20177 tablet_replica.cc:330] T f50c566dd5a44f5d89f3eb9373bb1cbc P 0abd3eeb083a4ae785956f25bbdfeeb5: stopping tablet replica
I20240502 02:00:51.912618 20177 raft_consensus.cc:2229] T f50c566dd5a44f5d89f3eb9373bb1cbc P 0abd3eeb083a4ae785956f25bbdfeeb5 [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20240502 02:00:51.912707 20177 raft_consensus.cc:2258] T f50c566dd5a44f5d89f3eb9373bb1cbc P 0abd3eeb083a4ae785956f25bbdfeeb5 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
W20240502 02:00:51.913295 20177 tablet_copy_client.cc:1107] T f50c566dd5a44f5d89f3eb9373bb1cbc P 0abd3eeb083a4ae785956f25bbdfeeb5: tablet copy: Unable to close tablet copy session: Network error: failure ending tablet copy session: Client connection negotiation failed: client connection to 127.16.79.193:37461: connect: Connection refused (error 111)
W20240502 02:00:51.913727 20177 tablet_metadata.cc:474] failed to load DataDirGroup from superblock: Already present: tried to load directory group for tablet f50c566dd5a44f5d89f3eb9373bb1cbc but one is already registered
I20240502 02:00:51.913920 20177 ts_tablet_manager.cc:1875] T f50c566dd5a44f5d89f3eb9373bb1cbc P 0abd3eeb083a4ae785956f25bbdfeeb5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 02:00:51.915447 20177 ts_tablet_manager.cc:1888] T f50c566dd5a44f5d89f3eb9373bb1cbc P 0abd3eeb083a4ae785956f25bbdfeeb5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.0
I20240502 02:00:51.915519 20177 log.cc:1196] T f50c566dd5a44f5d89f3eb9373bb1cbc P 0abd3eeb083a4ae785956f25bbdfeeb5: Deleting WAL directory at /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-1/wal/wals/f50c566dd5a44f5d89f3eb9373bb1cbc
I20240502 02:00:51.917711 16703 external_mini_cluster.cc:1326] Running /tmp/dist-test-task3rm6An/build/debug/bin/kudu
/tmp/dist-test-task3rm6An/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.79.193:37461
--local_ip_for_outbound_sockets=127.16.79.193
--tserver_master_addrs=127.16.79.254:39187
--webserver_port=42309
--webserver_interface=127.16.79.193
--builtin_ntp_servers=127.16.79.212:40439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240502 02:00:52.012944 20182 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 02:00:52.013118 20182 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 02:00:52.013186 20182 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 02:00:52.016155 20182 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 02:00:52.016258 20182 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.79.193
I20240502 02:00:52.019632 20182 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.79.212:40439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.79.193:37461
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.79.193
--webserver_port=42309
--tserver_master_addrs=127.16.79.254:39187
--never_fsync=true
--heap_profile_path=/tmp/kudu.20182
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.79.193
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 02:00:52.020323 20182 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 02:00:52.021232 20182 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 02:00:52.028307 20190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:52.028537 20188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:52.029192 20187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 02:00:52.029727 20182 server_base.cc:1034] running on GCE node
I20240502 02:00:52.030088 20182 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 02:00:52.030540 20182 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 02:00:52.031687 20182 hybrid_clock.cc:648] HybridClock initialized: now 1714615252031674 us; error 23 us; skew 500 ppm
I20240502 02:00:52.033221 20182 webserver.cc:460] Webserver started at http://127.16.79.193:42309/ using document root <none> and password file <none>
I20240502 02:00:52.033679 20182 fs_manager.cc:359] Metadata directory not provided
I20240502 02:00:52.033766 20182 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 02:00:52.036527 20182 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.002s
I20240502 02:00:52.038172 20196 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:52.038988 20182 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:52.039083 20182 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-0/data,/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-0/wal
uuid: "b97be70f2302490b9aa9382861fa9841"
format_stamp: "Formatted at 2024-05-02 02:00:50 on dist-test-slave-tj0m"
I20240502 02:00:52.039384 20182 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 02:00:52.058346 20182 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 02:00:52.058789 20182 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 02:00:52.058912 20182 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 02:00:52.059321 20182 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 02:00:52.060220 20203 ts_tablet_manager.cc:516] Loading tablet metadata (0/1 complete)
I20240502 02:00:52.062755 20182 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240502 02:00:52.062806 20182 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.003s user 0.000s sys 0.000s
I20240502 02:00:52.062872 20182 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240502 02:00:52.064054 20182 ts_tablet_manager.cc:590] Registered 1 tablets
I20240502 02:00:52.064095 20182 ts_tablet_manager.cc:569] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20240502 02:00:52.064282 20203 tablet_bootstrap.cc:492] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841: Bootstrap starting.
I20240502 02:00:52.072768 20182 rpc_server.cc:307] RPC server started. Bound to: 127.16.79.193:37461
I20240502 02:00:52.072829 20311 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.79.193:37461 every 8 connection(s)
I20240502 02:00:52.073591 20182 server_base.cc:1166] Dumped server information to /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714615241968978-16703-0/minicluster-data/ts-0/data/info.pb
I20240502 02:00:52.081283 20312 heartbeater.cc:347] Connected to a master server at 127.16.79.254:39187
I20240502 02:00:52.081457 20312 heartbeater.cc:464] Registering TS with master...
I20240502 02:00:52.081756 16703 external_mini_cluster.cc:1388] Started /tmp/dist-test-task3rm6An/build/debug/bin/kudu as pid 20182
I20240502 02:00:52.081938 20312 heartbeater.cc:511] Master 127.16.79.254:39187 requested a full tablet report, sending...
I20240502 02:00:52.083578 19948 ts_manager.cc:194] Re-registered known tserver with Master: b97be70f2302490b9aa9382861fa9841 (127.16.79.193:37461)
I20240502 02:00:52.084306 19948 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.79.193:60831
I20240502 02:00:52.098243 20203 log.cc:824] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841: Log is configured to *not* fsync() on all Append() calls
I20240502 02:00:52.382308 20203 tablet_bootstrap.cc:492] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841: Bootstrap replayed 1/1 log segments. Stats: ops{read=213 overwritten=0 applied=213 ignored=0} inserts{seen=10600 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 02:00:52.382649 20203 tablet_bootstrap.cc:492] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841: Bootstrap complete.
I20240502 02:00:52.383527 20203 ts_tablet_manager.cc:1367] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841: Time spent bootstrapping tablet: real 0.319s user 0.309s sys 0.008s
I20240502 02:00:52.385841 20203 raft_consensus.cc:348] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b97be70f2302490b9aa9382861fa9841" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 37461 } }
I20240502 02:00:52.386173 20203 raft_consensus.cc:729] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b97be70f2302490b9aa9382861fa9841, State: Initialized, Role: FOLLOWER
I20240502 02:00:52.386574 20203 consensus_queue.cc:260] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 213, Last appended: 1.213, Last appended by leader: 213, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b97be70f2302490b9aa9382861fa9841" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 37461 } }
I20240502 02:00:52.386679 20203 raft_consensus.cc:388] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:52.386749 20203 raft_consensus.cc:482] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:52.386852 20203 raft_consensus.cc:3037] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841 [term 1 FOLLOWER]: Advancing to term 2
I20240502 02:00:52.388342 20203 raft_consensus.cc:504] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b97be70f2302490b9aa9382861fa9841" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 37461 } }
I20240502 02:00:52.388631 20203 leader_election.cc:302] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b97be70f2302490b9aa9382861fa9841; no voters:
I20240502 02:00:52.388875 20203 leader_election.cc:288] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 02:00:52.388975 20317 raft_consensus.cc:2781] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 02:00:52.389166 20317 raft_consensus.cc:686] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841 [term 2 LEADER]: Becoming Leader. State: Replica: b97be70f2302490b9aa9382861fa9841, State: Running, Role: LEADER
I20240502 02:00:52.389442 20312 heartbeater.cc:503] Master 127.16.79.254:39187 was elected leader, sending a full tablet report...
I20240502 02:00:52.389449 20317 consensus_queue.cc:237] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 213, Committed index: 213, Last appended: 1.213, Last appended by leader: 213, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b97be70f2302490b9aa9382861fa9841" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 37461 } }
I20240502 02:00:52.389657 20203 ts_tablet_manager.cc:1398] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20240502 02:00:52.391502 19948 catalog_manager.cc:5484] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "b97be70f2302490b9aa9382861fa9841" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b97be70f2302490b9aa9382861fa9841" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 37461 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:52.393321 20177 ts_tablet_manager.cc:902] T f50c566dd5a44f5d89f3eb9373bb1cbc P 0abd3eeb083a4ae785956f25bbdfeeb5: Initiating tablet copy from peer b97be70f2302490b9aa9382861fa9841 (127.16.79.193:37461)
I20240502 02:00:52.393783 20177 tablet_copy_client.cc:308] T f50c566dd5a44f5d89f3eb9373bb1cbc P 0abd3eeb083a4ae785956f25bbdfeeb5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:37461
I20240502 02:00:52.397228 20286 tablet_copy_service.cc:140] P b97be70f2302490b9aa9382861fa9841: Received BeginTabletCopySession request for tablet f50c566dd5a44f5d89f3eb9373bb1cbc from peer 0abd3eeb083a4ae785956f25bbdfeeb5 ({username='slave'} at 127.16.79.194:46067)
I20240502 02:00:52.397339 20286 tablet_copy_service.cc:161] P b97be70f2302490b9aa9382861fa9841: Beginning new tablet copy session on tablet f50c566dd5a44f5d89f3eb9373bb1cbc from peer 0abd3eeb083a4ae785956f25bbdfeeb5 at {username='slave'} at 127.16.79.194:46067: session id = 0abd3eeb083a4ae785956f25bbdfeeb5-f50c566dd5a44f5d89f3eb9373bb1cbc
I20240502 02:00:52.398212 20286 tablet_copy_source_session.cc:205] T f50c566dd5a44f5d89f3eb9373bb1cbc P b97be70f2302490b9aa9382861fa9841: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 02:00:52.399057 20177 ts_tablet_manager.cc:1875] T f50c566dd5a44f5d89f3eb9373bb1cbc P 0abd3eeb083a4ae785956f25bbdfeeb5: Deleting tablet data with delete state TABLET_DATA_COPYING
I20240502 02:00:52.400488 20177 ts_tablet_manager.cc:1888] T f50c566dd5a44f5d89f3eb9373bb1cbc P 0abd3eeb083a4ae785956f25bbdfeeb5: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.0
I20240502 02:00:52.400635 20177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f50c566dd5a44f5d89f3eb9373bb1cbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:52.401465 20177 tablet_copy_client.cc:783] T f50c566dd5a44f5d89f3eb9373bb1cbc P 0abd3eeb083a4ae785956f25bbdfeeb5: tablet copy: Starting download of 0 data blocks...
I20240502 02:00:52.401582 20177 tablet_copy_client.cc:647] T f50c566dd5a44f5d89f3eb9373bb1cbc P 0abd3eeb083a4ae785956f25bbdfeeb5: tablet copy: Starting download of 1 WAL segments...
I20240502 02:00:52.404927 20177 tablet_copy_client.cc:523] T f50c566dd5a44f5d89f3eb9373bb1cbc P 0abd3eeb083a4ae785956f25bbdfeeb5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 02:00:52.405881 20177 tablet_bootstrap.cc:492] T f50c566dd5a44f5d89f3eb9373bb1cbc P 0abd3eeb083a4ae785956f25bbdfeeb5: Bootstrap starting.
I20240502 02:00:52.426249 20177 log.cc:824] T f50c566dd5a44f5d89f3eb9373bb1cbc P 0abd3eeb083a4ae785956f25bbdfeeb5: Log is configured to *not* fsync() on all Append() calls
I20240502 02:00:52.715272 20177 tablet_bootstrap.cc:492] T f50c566dd5a44f5d89f3eb9373bb1cbc P 0abd3eeb083a4ae785956f25bbdfeeb5: Bootstrap replayed 1/1 log segments. Stats: ops{read=214 overwritten=0 applied=214 ignored=0} inserts{seen=10600 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 02:00:52.715538 20177 tablet_bootstrap.cc:492] T f50c566dd5a44f5d89f3eb9373bb1cbc P 0abd3eeb083a4ae785956f25bbdfeeb5: Bootstrap complete.
I20240502 02:00:52.715878 20177 ts_tablet_manager.cc:1367] T f50c566dd5a44f5d89f3eb9373bb1cbc P 0abd3eeb083a4ae785956f25bbdfeeb5: Time spent bootstrapping tablet: real 0.310s user 0.292s sys 0.016s
I20240502 02:00:52.718586 20177 raft_consensus.cc:348] T f50c566dd5a44f5d89f3eb9373bb1cbc P 0abd3eeb083a4ae785956f25bbdfeeb5 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b97be70f2302490b9aa9382861fa9841" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 37461 } }
I20240502 02:00:52.718780 20177 raft_consensus.cc:729] T f50c566dd5a44f5d89f3eb9373bb1cbc P 0abd3eeb083a4ae785956f25bbdfeeb5 [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 0abd3eeb083a4ae785956f25bbdfeeb5, State: Initialized, Role: NON_PARTICIPANT
I20240502 02:00:52.719100 20177 consensus_queue.cc:260] T f50c566dd5a44f5d89f3eb9373bb1cbc P 0abd3eeb083a4ae785956f25bbdfeeb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 214, Last appended: 2.214, Last appended by leader: 214, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b97be70f2302490b9aa9382861fa9841" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 37461 } }
I20240502 02:00:52.719722 20172 heartbeater.cc:503] Master 127.16.79.254:39187 was elected leader, sending a full tablet report...
I20240502 02:00:52.719827 20177 ts_tablet_manager.cc:1398] T f50c566dd5a44f5d89f3eb9373bb1cbc P 0abd3eeb083a4ae785956f25bbdfeeb5: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20240502 02:00:52.720460 20286 tablet_copy_service.cc:342] P b97be70f2302490b9aa9382861fa9841: Request end of tablet copy session 0abd3eeb083a4ae785956f25bbdfeeb5-f50c566dd5a44f5d89f3eb9373bb1cbc received from {username='slave'} at 127.16.79.194:46067
I20240502 02:00:52.720568 20286 tablet_copy_service.cc:433] P b97be70f2302490b9aa9382861fa9841: ending tablet copy session 0abd3eeb083a4ae785956f25bbdfeeb5-f50c566dd5a44f5d89f3eb9373bb1cbc on tablet f50c566dd5a44f5d89f3eb9373bb1cbc with peer 0abd3eeb083a4ae785956f25bbdfeeb5
I20240502 02:00:52.727622 16703 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task3rm6An/build/debug/bin/kudu with pid 20182
I20240502 02:00:52.733199 16703 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task3rm6An/build/debug/bin/kudu with pid 20042
I20240502 02:00:52.738116 16703 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task3rm6An/build/debug/bin/kudu with pid 19921
2024-05-02T02:00:52Z chronyd exiting
[ OK ] TabletCopyClientSessionITest.TestCopyFromCrashedSource (2854 ms)
[ RUN ] TabletCopyClientSessionITest.TestTabletCopyWithBusySource
2024-05-02T02:00:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-02T02:00:52Z Disabled control of system clock
I20240502 02:00:52.763268 16703 external_mini_cluster.cc:1326] Running /tmp/dist-test-task3rm6An/build/debug/bin/kudu
/tmp/dist-test-task3rm6An/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.79.254:41035
--webserver_interface=127.16.79.254
--webserver_port=0
--builtin_ntp_servers=127.16.79.212:36407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.79.254:41035
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240502 02:00:52.859508 20336 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 02:00:52.859680 20336 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 02:00:52.859732 20336 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 02:00:52.862618 20336 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 02:00:52.862665 20336 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 02:00:52.862691 20336 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 02:00:52.862715 20336 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 02:00:52.866189 20336 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.79.212:36407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.16.79.254:41035
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.79.254:41035
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.79.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.20336
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 02:00:52.866869 20336 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 02:00:52.867789 20336 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 02:00:52.874011 20344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:52.874480 20342 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:52.874943 20341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 02:00:52.875358 20336 server_base.cc:1034] running on GCE node
I20240502 02:00:52.875788 20336 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 02:00:52.876561 20336 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 02:00:52.877712 20336 hybrid_clock.cc:648] HybridClock initialized: now 1714615252877685 us; error 37 us; skew 500 ppm
I20240502 02:00:52.883644 20336 webserver.cc:460] Webserver started at http://127.16.79.254:33511/ using document root <none> and password file <none>
I20240502 02:00:52.884109 20336 fs_manager.cc:359] Metadata directory not provided
I20240502 02:00:52.884159 20336 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 02:00:52.884322 20336 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 02:00:52.885769 20336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/master-0/data/instance:
uuid: "e7d9a41b76224760b672d13dea26cf4a"
format_stamp: "Formatted at 2024-05-02 02:00:52 on dist-test-slave-tj0m"
I20240502 02:00:52.886214 20336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/master-0/wal/instance:
uuid: "e7d9a41b76224760b672d13dea26cf4a"
format_stamp: "Formatted at 2024-05-02 02:00:52 on dist-test-slave-tj0m"
I20240502 02:00:52.889029 20336 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20240502 02:00:52.890992 20350 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:52.891832 20336 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240502 02:00:52.891945 20336 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/master-0/data,/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/master-0/wal
uuid: "e7d9a41b76224760b672d13dea26cf4a"
format_stamp: "Formatted at 2024-05-02 02:00:52 on dist-test-slave-tj0m"
I20240502 02:00:52.892017 20336 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 02:00:52.909384 20336 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 02:00:52.909906 20336 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 02:00:52.910044 20336 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 02:00:52.915912 20336 rpc_server.cc:307] RPC server started. Bound to: 127.16.79.254:41035
I20240502 02:00:52.915918 20403 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.79.254:41035 every 8 connection(s)
I20240502 02:00:52.916692 20336 server_base.cc:1166] Dumped server information to /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/master-0/data/info.pb
I20240502 02:00:52.918875 20404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:52.923135 20404 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a: Bootstrap starting.
I20240502 02:00:52.925066 20404 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a: Neither blocks nor log segments found. Creating new log.
I20240502 02:00:52.925670 20404 log.cc:824] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a: Log is configured to *not* fsync() on all Append() calls
I20240502 02:00:52.926921 16703 external_mini_cluster.cc:1388] Started /tmp/dist-test-task3rm6An/build/debug/bin/kudu as pid 20336
I20240502 02:00:52.927006 16703 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/master-0/wal/instance
I20240502 02:00:52.927139 20404 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a: No bootstrap required, opened a new log
I20240502 02:00:52.930145 20404 raft_consensus.cc:348] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7d9a41b76224760b672d13dea26cf4a" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 41035 } }
I20240502 02:00:52.930336 20404 raft_consensus.cc:374] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 02:00:52.930406 20404 raft_consensus.cc:729] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7d9a41b76224760b672d13dea26cf4a, State: Initialized, Role: FOLLOWER
I20240502 02:00:52.930845 20404 consensus_queue.cc:260] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7d9a41b76224760b672d13dea26cf4a" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 41035 } }
I20240502 02:00:52.930992 20404 raft_consensus.cc:388] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:52.931057 20404 raft_consensus.cc:482] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:52.931157 20404 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a [term 0 FOLLOWER]: Advancing to term 1
I20240502 02:00:52.931953 20404 raft_consensus.cc:504] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7d9a41b76224760b672d13dea26cf4a" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 41035 } }
I20240502 02:00:52.932257 20404 leader_election.cc:302] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e7d9a41b76224760b672d13dea26cf4a; no voters:
I20240502 02:00:52.932500 20404 leader_election.cc:288] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 02:00:52.932826 20409 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a [term 1 FOLLOWER]: Leader election won for term 1
I20240502 02:00:52.933331 20409 raft_consensus.cc:686] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a [term 1 LEADER]: Becoming Leader. State: Replica: e7d9a41b76224760b672d13dea26cf4a, State: Running, Role: LEADER
I20240502 02:00:52.933528 20404 sys_catalog.cc:564] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a [sys.catalog]: configured and running, proceeding with master startup.
I20240502 02:00:52.933593 20409 consensus_queue.cc:237] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7d9a41b76224760b672d13dea26cf4a" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 41035 } }
I20240502 02:00:52.934644 20412 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e7d9a41b76224760b672d13dea26cf4a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7d9a41b76224760b672d13dea26cf4a" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 41035 } } }
I20240502 02:00:52.934775 20412 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a [sys.catalog]: This master's current role is: LEADER
I20240502 02:00:52.934655 20409 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a [sys.catalog]: SysCatalogTable state changed. Reason: New leader e7d9a41b76224760b672d13dea26cf4a. Latest consensus state: current_term: 1 leader_uuid: "e7d9a41b76224760b672d13dea26cf4a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7d9a41b76224760b672d13dea26cf4a" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 41035 } } }
I20240502 02:00:52.934976 20409 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a [sys.catalog]: This master's current role is: LEADER
W20240502 02:00:52.937873 20425 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20240502 02:00:52.937947 20425 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20240502 02:00:52.938014 20419 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 02:00:52.938685 20419 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 02:00:52.942613 20419 catalog_manager.cc:1347] Generated new cluster ID: 92704e16b4284c3e83bf9019c8500ebc
I20240502 02:00:52.942672 20419 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 02:00:52.962046 20419 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 02:00:52.962852 20419 catalog_manager.cc:1504] Loading token signing keys...
I20240502 02:00:52.972843 20419 catalog_manager.cc:5857] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a: Generated new TSK 0
I20240502 02:00:52.973352 20419 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 02:00:52.983327 16703 external_mini_cluster.cc:1326] Running /tmp/dist-test-task3rm6An/build/debug/bin/kudu
/tmp/dist-test-task3rm6An/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.79.193:0
--local_ip_for_outbound_sockets=127.16.79.193
--webserver_interface=127.16.79.193
--webserver_port=0
--tserver_master_addrs=127.16.79.254:41035
--builtin_ntp_servers=127.16.79.212:36407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=20 with env {}
W20240502 02:00:53.092941 20429 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 02:00:53.093102 20429 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 02:00:53.093144 20429 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 02:00:53.096181 20429 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 02:00:53.096279 20429 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.79.193
I20240502 02:00:53.099709 20429 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.79.212:36407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.79.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.79.193
--webserver_port=0
--tserver_master_addrs=127.16.79.254:41035
--num_tablets_to_copy_simultaneously=20
--never_fsync=true
--heap_profile_path=/tmp/kudu.20429
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.79.193
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 02:00:53.100399 20429 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 02:00:53.101348 20429 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 02:00:53.108500 20435 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:53.108783 20437 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:53.109346 20434 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 02:00:53.109915 20429 server_base.cc:1034] running on GCE node
I20240502 02:00:53.110266 20429 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 02:00:53.110731 20429 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 02:00:53.111873 20429 hybrid_clock.cc:648] HybridClock initialized: now 1714615253111859 us; error 25 us; skew 500 ppm
I20240502 02:00:53.113406 20429 webserver.cc:460] Webserver started at http://127.16.79.193:45991/ using document root <none> and password file <none>
I20240502 02:00:53.113900 20429 fs_manager.cc:359] Metadata directory not provided
I20240502 02:00:53.113956 20429 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 02:00:53.114109 20429 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 02:00:53.115502 20429 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-0/data/instance:
uuid: "ecdee71f76b04c42b4621aa6951fa139"
format_stamp: "Formatted at 2024-05-02 02:00:53 on dist-test-slave-tj0m"
I20240502 02:00:53.115931 20429 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-0/wal/instance:
uuid: "ecdee71f76b04c42b4621aa6951fa139"
format_stamp: "Formatted at 2024-05-02 02:00:53 on dist-test-slave-tj0m"
I20240502 02:00:53.118775 20429 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20240502 02:00:53.120587 20443 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:53.121448 20429 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:53.121537 20429 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-0/data,/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-0/wal
uuid: "ecdee71f76b04c42b4621aa6951fa139"
format_stamp: "Formatted at 2024-05-02 02:00:53 on dist-test-slave-tj0m"
I20240502 02:00:53.121608 20429 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 02:00:53.134766 20429 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 02:00:53.135190 20429 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 02:00:53.135326 20429 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 02:00:53.135749 20429 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 02:00:53.136487 20429 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 02:00:53.136533 20429 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:53.136579 20429 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 02:00:53.136607 20429 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:53.143782 20429 rpc_server.cc:307] RPC server started. Bound to: 127.16.79.193:44765
I20240502 02:00:53.143828 20557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.79.193:44765 every 8 connection(s)
I20240502 02:00:53.144513 20429 server_base.cc:1166] Dumped server information to /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-0/data/info.pb
I20240502 02:00:53.148483 16703 external_mini_cluster.cc:1388] Started /tmp/dist-test-task3rm6An/build/debug/bin/kudu as pid 20429
I20240502 02:00:53.148584 16703 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-0/wal/instance
I20240502 02:00:53.150650 16703 external_mini_cluster.cc:1326] Running /tmp/dist-test-task3rm6An/build/debug/bin/kudu
/tmp/dist-test-task3rm6An/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.79.194:0
--local_ip_for_outbound_sockets=127.16.79.194
--webserver_interface=127.16.79.194
--webserver_port=0
--tserver_master_addrs=127.16.79.254:41035
--builtin_ntp_servers=127.16.79.212:36407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=20 with env {}
I20240502 02:00:53.152309 20558 heartbeater.cc:347] Connected to a master server at 127.16.79.254:41035
I20240502 02:00:53.152484 20558 heartbeater.cc:464] Registering TS with master...
I20240502 02:00:53.152993 20558 heartbeater.cc:511] Master 127.16.79.254:41035 requested a full tablet report, sending...
I20240502 02:00:53.154304 20367 ts_manager.cc:194] Registered new tserver with Master: ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193:44765)
I20240502 02:00:53.155352 20367 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.79.193:50789
W20240502 02:00:53.246301 20561 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 02:00:53.246461 20561 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 02:00:53.246512 20561 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 02:00:53.249367 20561 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 02:00:53.249470 20561 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.79.194
I20240502 02:00:53.252846 20561 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.79.212:36407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.79.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.79.194
--webserver_port=0
--tserver_master_addrs=127.16.79.254:41035
--num_tablets_to_copy_simultaneously=20
--never_fsync=true
--heap_profile_path=/tmp/kudu.20561
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.79.194
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 02:00:53.253476 20561 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 02:00:53.254380 20561 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 02:00:53.261276 20567 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:53.261503 20566 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:53.262238 20569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 02:00:53.262742 20561 server_base.cc:1034] running on GCE node
I20240502 02:00:53.263056 20561 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 02:00:53.263505 20561 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 02:00:53.264658 20561 hybrid_clock.cc:648] HybridClock initialized: now 1714615253264631 us; error 31 us; skew 500 ppm
I20240502 02:00:53.266232 20561 webserver.cc:460] Webserver started at http://127.16.79.194:40525/ using document root <none> and password file <none>
I20240502 02:00:53.266695 20561 fs_manager.cc:359] Metadata directory not provided
I20240502 02:00:53.266748 20561 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 02:00:53.266897 20561 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 02:00:53.268270 20561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-1/data/instance:
uuid: "3150ab3728ad4a57bb02f6673b3148d2"
format_stamp: "Formatted at 2024-05-02 02:00:53 on dist-test-slave-tj0m"
I20240502 02:00:53.268697 20561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-1/wal/instance:
uuid: "3150ab3728ad4a57bb02f6673b3148d2"
format_stamp: "Formatted at 2024-05-02 02:00:53 on dist-test-slave-tj0m"
I20240502 02:00:53.271510 20561 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20240502 02:00:53.273411 20575 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:53.274255 20561 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:53.274348 20561 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-1/data,/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-1/wal
uuid: "3150ab3728ad4a57bb02f6673b3148d2"
format_stamp: "Formatted at 2024-05-02 02:00:53 on dist-test-slave-tj0m"
I20240502 02:00:53.274420 20561 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 02:00:53.288836 20561 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 02:00:53.289258 20561 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 02:00:53.289384 20561 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 02:00:53.289844 20561 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 02:00:53.290576 20561 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 02:00:53.290620 20561 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:53.290673 20561 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 02:00:53.290701 20561 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:53.298166 20561 rpc_server.cc:307] RPC server started. Bound to: 127.16.79.194:41805
I20240502 02:00:53.298192 20688 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.79.194:41805 every 8 connection(s)
I20240502 02:00:53.298898 20561 server_base.cc:1166] Dumped server information to /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-1/data/info.pb
I20240502 02:00:53.305402 16703 external_mini_cluster.cc:1388] Started /tmp/dist-test-task3rm6An/build/debug/bin/kudu as pid 20561
I20240502 02:00:53.305509 16703 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-1/wal/instance
I20240502 02:00:53.306033 20689 heartbeater.cc:347] Connected to a master server at 127.16.79.254:41035
I20240502 02:00:53.306234 20689 heartbeater.cc:464] Registering TS with master...
I20240502 02:00:53.306672 20689 heartbeater.cc:511] Master 127.16.79.254:41035 requested a full tablet report, sending...
I20240502 02:00:53.307564 20366 ts_manager.cc:194] Registered new tserver with Master: 3150ab3728ad4a57bb02f6673b3148d2 (127.16.79.194:41805)
I20240502 02:00:53.308101 20366 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.79.194:53121
I20240502 02:00:53.318980 16703 external_mini_cluster.cc:930] 2 TS(s) registered with all masters
I20240502 02:00:53.325469 16703 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task3rm6An/build/debug/bin/kudu with pid 20561
I20240502 02:00:53.331727 16703 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task3rm6An/build/debug/bin/kudu with pid 20336
I20240502 02:00:53.337137 16703 external_mini_cluster.cc:1326] Running /tmp/dist-test-task3rm6An/build/debug/bin/kudu
/tmp/dist-test-task3rm6An/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.79.254:41035
--webserver_interface=127.16.79.254
--webserver_port=33511
--builtin_ntp_servers=127.16.79.212:36407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.79.254:41035
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240502 02:00:53.440891 20697 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 02:00:53.441063 20697 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 02:00:53.441113 20697 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 02:00:53.444012 20697 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 02:00:53.444067 20697 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 02:00:53.444090 20697 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 02:00:53.444136 20697 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 02:00:53.447583 20697 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.79.212:36407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.16.79.254:41035
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.79.254:41035
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.79.254
--webserver_port=33511
--never_fsync=true
--heap_profile_path=/tmp/kudu.20697
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 02:00:53.448261 20697 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 02:00:53.449151 20697 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 02:00:53.455214 20705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:53.455587 20703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:53.455991 20702 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 02:00:53.456552 20697 server_base.cc:1034] running on GCE node
I20240502 02:00:53.456925 20697 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 02:00:53.457650 20697 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 02:00:53.458784 20697 hybrid_clock.cc:648] HybridClock initialized: now 1714615253458770 us; error 27 us; skew 500 ppm
I20240502 02:00:53.460340 20697 webserver.cc:460] Webserver started at http://127.16.79.254:33511/ using document root <none> and password file <none>
I20240502 02:00:53.460772 20697 fs_manager.cc:359] Metadata directory not provided
I20240502 02:00:53.460829 20697 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 02:00:53.463599 20697 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20240502 02:00:53.465226 20711 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:53.466084 20697 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:53.466171 20697 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/master-0/data,/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/master-0/wal
uuid: "e7d9a41b76224760b672d13dea26cf4a"
format_stamp: "Formatted at 2024-05-02 02:00:52 on dist-test-slave-tj0m"
I20240502 02:00:53.466472 20697 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 02:00:53.488324 20697 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 02:00:53.488762 20697 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 02:00:53.488869 20697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 02:00:53.494513 20697 rpc_server.cc:307] RPC server started. Bound to: 127.16.79.254:41035
I20240502 02:00:53.494529 20764 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.79.254:41035 every 8 connection(s)
I20240502 02:00:53.495350 20697 server_base.cc:1166] Dumped server information to /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/master-0/data/info.pb
I20240502 02:00:53.498805 20765 sys_catalog.cc:263] Verifying existing consensus state
I20240502 02:00:53.500068 20765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a: Bootstrap starting.
I20240502 02:00:53.501097 16703 external_mini_cluster.cc:1388] Started /tmp/dist-test-task3rm6An/build/debug/bin/kudu as pid 20697
I20240502 02:00:53.512830 20765 log.cc:824] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a: Log is configured to *not* fsync() on all Append() calls
I20240502 02:00:53.517659 20765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 02:00:53.517966 20765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a: Bootstrap complete.
I20240502 02:00:53.521055 20765 raft_consensus.cc:348] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7d9a41b76224760b672d13dea26cf4a" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 41035 } }
I20240502 02:00:53.521365 20765 raft_consensus.cc:729] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7d9a41b76224760b672d13dea26cf4a, State: Initialized, Role: FOLLOWER
I20240502 02:00:53.521703 20765 consensus_queue.cc:260] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7d9a41b76224760b672d13dea26cf4a" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 41035 } }
I20240502 02:00:53.521834 20765 raft_consensus.cc:388] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:53.521879 20765 raft_consensus.cc:482] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:53.521946 20765 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a [term 1 FOLLOWER]: Advancing to term 2
I20240502 02:00:53.523272 20765 raft_consensus.cc:504] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7d9a41b76224760b672d13dea26cf4a" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 41035 } }
I20240502 02:00:53.523525 20765 leader_election.cc:302] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e7d9a41b76224760b672d13dea26cf4a; no voters:
I20240502 02:00:53.523733 20765 leader_election.cc:288] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 02:00:53.523816 20770 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a [term 2 FOLLOWER]: Leader election won for term 2
I20240502 02:00:53.523991 20770 raft_consensus.cc:686] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a [term 2 LEADER]: Becoming Leader. State: Replica: e7d9a41b76224760b672d13dea26cf4a, State: Running, Role: LEADER
I20240502 02:00:53.524250 20770 consensus_queue.cc:237] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7d9a41b76224760b672d13dea26cf4a" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 41035 } }
I20240502 02:00:53.524690 20765 sys_catalog.cc:564] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a [sys.catalog]: configured and running, proceeding with master startup.
I20240502 02:00:53.524999 20772 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a [sys.catalog]: SysCatalogTable state changed. Reason: New leader e7d9a41b76224760b672d13dea26cf4a. Latest consensus state: current_term: 2 leader_uuid: "e7d9a41b76224760b672d13dea26cf4a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7d9a41b76224760b672d13dea26cf4a" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 41035 } } }
I20240502 02:00:53.525187 20772 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a [sys.catalog]: This master's current role is: LEADER
I20240502 02:00:53.525336 20771 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "e7d9a41b76224760b672d13dea26cf4a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7d9a41b76224760b672d13dea26cf4a" member_type: VOTER last_known_addr { host: "127.16.79.254" port: 41035 } } }
I20240502 02:00:53.525420 20771 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a [sys.catalog]: This master's current role is: LEADER
I20240502 02:00:53.525897 20776 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 02:00:53.528429 20776 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 02:00:53.529006 20776 catalog_manager.cc:1259] Loaded cluster ID: 92704e16b4284c3e83bf9019c8500ebc
I20240502 02:00:53.529074 20776 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 02:00:53.531330 20776 catalog_manager.cc:1504] Loading token signing keys...
I20240502 02:00:53.531956 20776 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e7d9a41b76224760b672d13dea26cf4a: Loaded TSK: 0
I20240502 02:00:53.533071 20776 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 02:00:54.157577 20558 heartbeater.cc:503] Master 127.16.79.254:41035 was elected leader, sending a full tablet report...
I20240502 02:00:54.161607 20728 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" instance_seqno: 1714615253141868) as {username='slave'} at 127.16.79.193:37105; Asking this server to re-register.
I20240502 02:00:54.162171 20558 heartbeater.cc:464] Registering TS with master...
I20240502 02:00:54.162324 20558 heartbeater.cc:511] Master 127.16.79.254:41035 requested a full tablet report, sending...
I20240502 02:00:54.163142 20728 ts_manager.cc:194] Registered new tserver with Master: ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193:44765)
I20240502 02:00:54.166096 16703 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20240502 02:00:54.166172 16703 test_util.cc:268] Using random seed: -114906468
I20240502 02:00:54.175470 20728 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45524:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "<redacted>""\004\001\000fff\006\004\001\000\314\314\314\014\004\001\000233\023\004\001\000\230\231\231\031\004\001\000\376\377\377\037\004\001\000dff&\004\001\000\312\314\314,\004\001\0000333\004\001\000\226\231\2319\004\001\000\374\377\377?\004\001\000bffF\004\001\000\310\314\314L\004\001\000.33S\004\001\000\224\231\231Y\004\001\000\372\377\377_\004\001\000`fff\004\001\000\306\314\314l\004\001\000,33s\004\001\000\222\231\231y"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20240502 02:00:54.194125 20490 tablet_service.cc:1467] Processing CreateTablet for tablet 40d985f7eb9848798a35c154f6156cc1 (DEFAULT_TABLE table=test-workload [id=0cdeb57b2b23491897a7515d0b9d3f62]), partition=RANGE (key) PARTITION 107374182 <= VALUES < 214748364
I20240502 02:00:54.194514 20478 tablet_service.cc:1467] Processing CreateTablet for tablet f228a61b3ba8418792a60b33588208c2 (DEFAULT_TABLE table=test-workload [id=0cdeb57b2b23491897a7515d0b9d3f62]), partition=RANGE (key) PARTITION 1395864366 <= VALUES < 1503238548
I20240502 02:00:54.194833 20491 tablet_service.cc:1467] Processing CreateTablet for tablet 2d52144ee76b409dbef9df26ced28059 (DEFAULT_TABLE table=test-workload [id=0cdeb57b2b23491897a7515d0b9d3f62]), partition=RANGE (key) PARTITION VALUES < 107374182
I20240502 02:00:54.194948 20485 tablet_service.cc:1467] Processing CreateTablet for tablet f05c4ec5116541419948ae4af1bcb34a (DEFAULT_TABLE table=test-workload [id=0cdeb57b2b23491897a7515d0b9d3f62]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 751619274
I20240502 02:00:54.194121 20477 tablet_service.cc:1467] Processing CreateTablet for tablet cfae387b6b6c4e5da9bc0c265dd9a701 (DEFAULT_TABLE table=test-workload [id=0cdeb57b2b23491897a7515d0b9d3f62]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1610612730
I20240502 02:00:54.195274 20484 tablet_service.cc:1467] Processing CreateTablet for tablet caf7c697404b4b6b8f476dd27066c340 (DEFAULT_TABLE table=test-workload [id=0cdeb57b2b23491897a7515d0b9d3f62]), partition=RANGE (key) PARTITION 751619274 <= VALUES < 858993456
I20240502 02:00:54.195386 20490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40d985f7eb9848798a35c154f6156cc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:54.195636 20483 tablet_service.cc:1467] Processing CreateTablet for tablet 7d1da903cf7749a5bb454cef5a01fd55 (DEFAULT_TABLE table=test-workload [id=0cdeb57b2b23491897a7515d0b9d3f62]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 966367638
I20240502 02:00:54.195708 20491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d52144ee76b409dbef9df26ced28059. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:54.195847 20483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d1da903cf7749a5bb454cef5a01fd55. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:54.195987 20485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f05c4ec5116541419948ae4af1bcb34a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:54.196506 20478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f228a61b3ba8418792a60b33588208c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:54.196516 20482 tablet_service.cc:1467] Processing CreateTablet for tablet ed1661390ffa447e89f9c24a048fc4ca (DEFAULT_TABLE table=test-workload [id=0cdeb57b2b23491897a7515d0b9d3f62]), partition=RANGE (key) PARTITION 966367638 <= VALUES < 1073741820
I20240502 02:00:54.196780 20482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed1661390ffa447e89f9c24a048fc4ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:54.194200 20475 tablet_service.cc:1467] Processing CreateTablet for tablet d74fab82aa3a42fa897e7d649ac57815 (DEFAULT_TABLE table=test-workload [id=0cdeb57b2b23491897a7515d0b9d3f62]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1825361094
I20240502 02:00:54.196902 20481 tablet_service.cc:1467] Processing CreateTablet for tablet 57e25b6fdfdd4f669ab15be5a174417d (DEFAULT_TABLE table=test-workload [id=0cdeb57b2b23491897a7515d0b9d3f62]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1181116002
I20240502 02:00:54.197084 20475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d74fab82aa3a42fa897e7d649ac57815. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:54.197258 20480 tablet_service.cc:1467] Processing CreateTablet for tablet 9cb2471a4bbc492c85a197875f1ceade (DEFAULT_TABLE table=test-workload [id=0cdeb57b2b23491897a7515d0b9d3f62]), partition=RANGE (key) PARTITION 1181116002 <= VALUES < 1288490184
I20240502 02:00:54.197471 20480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cb2471a4bbc492c85a197875f1ceade. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:54.197780 20477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfae387b6b6c4e5da9bc0c265dd9a701. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:54.198805 20479 tablet_service.cc:1467] Processing CreateTablet for tablet d474f34c74d0460799c6df42c2251d7d (DEFAULT_TABLE table=test-workload [id=0cdeb57b2b23491897a7515d0b9d3f62]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1395864366
I20240502 02:00:54.199012 20479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d474f34c74d0460799c6df42c2251d7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:54.194121 20473 tablet_service.cc:1467] Processing CreateTablet for tablet 1b8b1df2290d4731b5f467867d344475 (DEFAULT_TABLE table=test-workload [id=0cdeb57b2b23491897a7515d0b9d3f62]), partition=RANGE (key) PARTITION 1932735276 <= VALUES < 2040109458
I20240502 02:00:54.200635 20473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b8b1df2290d4731b5f467867d344475. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:54.201195 20476 tablet_service.cc:1467] Processing CreateTablet for tablet 323350c532bc4d90b1b999f5f6584e10 (DEFAULT_TABLE table=test-workload [id=0cdeb57b2b23491897a7515d0b9d3f62]), partition=RANGE (key) PARTITION 1610612730 <= VALUES < 1717986912
I20240502 02:00:54.201426 20476 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 323350c532bc4d90b1b999f5f6584e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:54.203218 20474 tablet_service.cc:1467] Processing CreateTablet for tablet 2473abe9970e4ce2b0c25f406f949bef (DEFAULT_TABLE table=test-workload [id=0cdeb57b2b23491897a7515d0b9d3f62]), partition=RANGE (key) PARTITION 1825361094 <= VALUES < 1932735276
I20240502 02:00:54.203449 20474 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2473abe9970e4ce2b0c25f406f949bef. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:54.205284 20472 tablet_service.cc:1467] Processing CreateTablet for tablet 16d1b68e36224267996e4beb5700027f (DEFAULT_TABLE table=test-workload [id=0cdeb57b2b23491897a7515d0b9d3f62]), partition=RANGE (key) PARTITION 2040109458 <= VALUES
I20240502 02:00:54.205509 20472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16d1b68e36224267996e4beb5700027f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:54.194334 20487 tablet_service.cc:1467] Processing CreateTablet for tablet fa88cc2aa982450ba0092d6e0256e45e (DEFAULT_TABLE table=test-workload [id=0cdeb57b2b23491897a7515d0b9d3f62]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 536870910
I20240502 02:00:54.206193 20487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa88cc2aa982450ba0092d6e0256e45e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:54.194603 20486 tablet_service.cc:1467] Processing CreateTablet for tablet 0c5168136f4647ee8aecf4e409e803a5 (DEFAULT_TABLE table=test-workload [id=0cdeb57b2b23491897a7515d0b9d3f62]), partition=RANGE (key) PARTITION 536870910 <= VALUES < 644245092
I20240502 02:00:54.207649 20486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c5168136f4647ee8aecf4e409e803a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:54.208890 20484 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet caf7c697404b4b6b8f476dd27066c340. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:54.209060 20481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57e25b6fdfdd4f669ab15be5a174417d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:54.194614 20489 tablet_service.cc:1467] Processing CreateTablet for tablet b9a270c4a93d44b0af03702f01143375 (DEFAULT_TABLE table=test-workload [id=0cdeb57b2b23491897a7515d0b9d3f62]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 322122546
I20240502 02:00:54.210829 20489 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9a270c4a93d44b0af03702f01143375. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:54.194125 20488 tablet_service.cc:1467] Processing CreateTablet for tablet 574ae199657e4e49ae96fc7485847959 (DEFAULT_TABLE table=test-workload [id=0cdeb57b2b23491897a7515d0b9d3f62]), partition=RANGE (key) PARTITION 322122546 <= VALUES < 429496728
I20240502 02:00:54.212244 20488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 574ae199657e4e49ae96fc7485847959. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:54.214797 20800 tablet_bootstrap.cc:492] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:54.216418 20800 tablet_bootstrap.cc:654] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139: Neither blocks nor log segments found. Creating new log.
I20240502 02:00:54.217017 20800 log.cc:824] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139: Log is configured to *not* fsync() on all Append() calls
I20240502 02:00:54.218392 20800 tablet_bootstrap.cc:492] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139: No bootstrap required, opened a new log
I20240502 02:00:54.218539 20800 ts_tablet_manager.cc:1367] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240502 02:00:54.221457 20800 raft_consensus.cc:348] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.221601 20800 raft_consensus.cc:374] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 02:00:54.221645 20800 raft_consensus.cc:729] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:54.222028 20800 consensus_queue.cc:260] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.222141 20800 raft_consensus.cc:388] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:54.222196 20800 raft_consensus.cc:482] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:54.222295 20800 raft_consensus.cc:3037] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Advancing to term 1
I20240502 02:00:54.222921 20800 raft_consensus.cc:504] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.223197 20800 leader_election.cc:302] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:54.223448 20800 leader_election.cc:288] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 02:00:54.223528 20802 raft_consensus.cc:2781] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 02:00:54.223717 20802 raft_consensus.cc:686] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139 [term 1 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:54.223977 20802 consensus_queue.cc:237] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.224408 20800 ts_tablet_manager.cc:1398] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20240502 02:00:54.224592 20800 tablet_bootstrap.cc:492] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:54.225467 20800 tablet_bootstrap.cc:654] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139: Neither blocks nor log segments found. Creating new log.
I20240502 02:00:54.226974 20800 tablet_bootstrap.cc:492] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139: No bootstrap required, opened a new log
I20240502 02:00:54.227061 20800 ts_tablet_manager.cc:1367] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 02:00:54.226931 20728 catalog_manager.cc:5484] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193). New cstate: current_term: 1 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:54.227456 20800 raft_consensus.cc:348] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.227516 20800 raft_consensus.cc:374] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 02:00:54.227536 20800 raft_consensus.cc:729] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:54.227674 20800 consensus_queue.cc:260] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.227763 20800 raft_consensus.cc:388] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:54.227802 20800 raft_consensus.cc:482] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:54.227845 20800 raft_consensus.cc:3037] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Advancing to term 1
I20240502 02:00:54.228412 20800 raft_consensus.cc:504] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.228519 20800 leader_election.cc:302] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:54.228646 20802 raft_consensus.cc:2781] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 02:00:54.228718 20802 raft_consensus.cc:686] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139 [term 1 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:54.228824 20802 consensus_queue.cc:237] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.229161 20800 leader_election.cc:288] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 02:00:54.229419 20800 ts_tablet_manager.cc:1398] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:54.229575 20800 tablet_bootstrap.cc:492] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:54.230098 20728 catalog_manager.cc:5484] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193). New cstate: current_term: 1 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:54.230306 20800 tablet_bootstrap.cc:654] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139: Neither blocks nor log segments found. Creating new log.
I20240502 02:00:54.231271 20800 tablet_bootstrap.cc:492] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139: No bootstrap required, opened a new log
I20240502 02:00:54.231352 20800 ts_tablet_manager.cc:1367] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 02:00:54.231693 20800 raft_consensus.cc:348] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.231765 20800 raft_consensus.cc:374] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 02:00:54.231792 20800 raft_consensus.cc:729] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:54.231892 20800 consensus_queue.cc:260] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.231943 20800 raft_consensus.cc:388] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:54.231962 20800 raft_consensus.cc:482] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:54.231986 20800 raft_consensus.cc:3037] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Advancing to term 1
I20240502 02:00:54.232494 20800 raft_consensus.cc:504] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.232586 20800 leader_election.cc:302] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:54.232671 20800 leader_election.cc:288] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 02:00:54.232723 20802 raft_consensus.cc:2781] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 02:00:54.232820 20802 raft_consensus.cc:686] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139 [term 1 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:54.232951 20800 ts_tablet_manager.cc:1398] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:54.232923 20802 consensus_queue.cc:237] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.233085 20800 tablet_bootstrap.cc:492] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:54.233819 20800 tablet_bootstrap.cc:654] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139: Neither blocks nor log segments found. Creating new log.
I20240502 02:00:54.234736 20800 tablet_bootstrap.cc:492] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139: No bootstrap required, opened a new log
I20240502 02:00:54.234804 20800 ts_tablet_manager.cc:1367] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20240502 02:00:54.235061 20728 catalog_manager.cc:5484] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193). New cstate: current_term: 1 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:54.235333 20800 raft_consensus.cc:348] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.235423 20800 raft_consensus.cc:374] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 02:00:54.235460 20800 raft_consensus.cc:729] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:54.235575 20800 consensus_queue.cc:260] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.235648 20800 raft_consensus.cc:388] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:54.235669 20800 raft_consensus.cc:482] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:54.235698 20800 raft_consensus.cc:3037] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Advancing to term 1
I20240502 02:00:54.236316 20800 raft_consensus.cc:504] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.236418 20800 leader_election.cc:302] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:54.236512 20800 leader_election.cc:288] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 02:00:54.236562 20802 raft_consensus.cc:2781] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 02:00:54.236635 20802 raft_consensus.cc:686] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139 [term 1 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:54.236781 20800 ts_tablet_manager.cc:1398] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240502 02:00:54.236763 20802 consensus_queue.cc:237] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.236915 20800 tablet_bootstrap.cc:492] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:54.237624 20800 tablet_bootstrap.cc:654] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139: Neither blocks nor log segments found. Creating new log.
I20240502 02:00:54.237857 20728 catalog_manager.cc:5484] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193). New cstate: current_term: 1 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:54.238576 20800 tablet_bootstrap.cc:492] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139: No bootstrap required, opened a new log
I20240502 02:00:54.238657 20800 ts_tablet_manager.cc:1367] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 02:00:54.238992 20800 raft_consensus.cc:348] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.239080 20800 raft_consensus.cc:374] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 02:00:54.239117 20800 raft_consensus.cc:729] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:54.239230 20800 consensus_queue.cc:260] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.239307 20800 raft_consensus.cc:388] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:54.239337 20800 raft_consensus.cc:482] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:54.239380 20800 raft_consensus.cc:3037] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Advancing to term 1
I20240502 02:00:54.239966 20800 raft_consensus.cc:504] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.240067 20800 leader_election.cc:302] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:54.240167 20800 leader_election.cc:288] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 02:00:54.240204 20802 raft_consensus.cc:2781] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 02:00:54.240350 20802 raft_consensus.cc:686] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139 [term 1 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:54.240358 20800 ts_tablet_manager.cc:1398] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:54.240527 20800 tablet_bootstrap.cc:492] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:54.240492 20802 consensus_queue.cc:237] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.241241 20800 tablet_bootstrap.cc:654] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139: Neither blocks nor log segments found. Creating new log.
I20240502 02:00:54.241859 20728 catalog_manager.cc:5484] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193). New cstate: current_term: 1 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:54.242137 20800 tablet_bootstrap.cc:492] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139: No bootstrap required, opened a new log
I20240502 02:00:54.242221 20800 ts_tablet_manager.cc:1367] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 02:00:54.242591 20800 raft_consensus.cc:348] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.242677 20800 raft_consensus.cc:374] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 02:00:54.242717 20800 raft_consensus.cc:729] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:54.242823 20800 consensus_queue.cc:260] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.242894 20800 raft_consensus.cc:388] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:54.242933 20800 raft_consensus.cc:482] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:54.242975 20800 raft_consensus.cc:3037] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Advancing to term 1
I20240502 02:00:54.243590 20800 raft_consensus.cc:504] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.243690 20800 leader_election.cc:302] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:54.243777 20800 leader_election.cc:288] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 02:00:54.243827 20802 raft_consensus.cc:2781] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 02:00:54.243912 20802 raft_consensus.cc:686] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139 [term 1 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:54.243986 20800 ts_tablet_manager.cc:1398] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 02:00:54.244004 20802 consensus_queue.cc:237] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.244120 20800 tablet_bootstrap.cc:492] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:54.244887 20800 tablet_bootstrap.cc:654] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139: Neither blocks nor log segments found. Creating new log.
I20240502 02:00:54.245033 20728 catalog_manager.cc:5484] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193). New cstate: current_term: 1 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:54.246129 20800 tablet_bootstrap.cc:492] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139: No bootstrap required, opened a new log
I20240502 02:00:54.246219 20800 ts_tablet_manager.cc:1367] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 02:00:54.246609 20800 raft_consensus.cc:348] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.246698 20800 raft_consensus.cc:374] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 02:00:54.246727 20800 raft_consensus.cc:729] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:54.246832 20800 consensus_queue.cc:260] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.246893 20800 raft_consensus.cc:388] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:54.246930 20800 raft_consensus.cc:482] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:54.246973 20800 raft_consensus.cc:3037] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Advancing to term 1
I20240502 02:00:54.247684 20800 raft_consensus.cc:504] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.247815 20800 leader_election.cc:302] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:54.247923 20800 leader_election.cc:288] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 02:00:54.247973 20802 raft_consensus.cc:2781] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 02:00:54.248066 20802 raft_consensus.cc:686] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139 [term 1 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:54.248117 20800 ts_tablet_manager.cc:1398] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:54.248185 20802 consensus_queue.cc:237] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.248258 20800 tablet_bootstrap.cc:492] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:54.248986 20800 tablet_bootstrap.cc:654] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139: Neither blocks nor log segments found. Creating new log.
I20240502 02:00:54.249332 20728 catalog_manager.cc:5484] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193). New cstate: current_term: 1 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:54.249956 20800 tablet_bootstrap.cc:492] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139: No bootstrap required, opened a new log
I20240502 02:00:54.250027 20800 ts_tablet_manager.cc:1367] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 02:00:54.250360 20800 raft_consensus.cc:348] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.250450 20800 raft_consensus.cc:374] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 02:00:54.250490 20800 raft_consensus.cc:729] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:54.250615 20800 consensus_queue.cc:260] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.250701 20800 raft_consensus.cc:388] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:54.250742 20800 raft_consensus.cc:482] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:54.250792 20800 raft_consensus.cc:3037] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Advancing to term 1
I20240502 02:00:54.251418 20800 raft_consensus.cc:504] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.251530 20800 leader_election.cc:302] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:54.251617 20800 leader_election.cc:288] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 02:00:54.251677 20804 raft_consensus.cc:2781] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 02:00:54.251765 20804 raft_consensus.cc:686] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139 [term 1 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:54.251827 20800 ts_tablet_manager.cc:1398] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240502 02:00:54.251869 20804 consensus_queue.cc:237] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.251977 20800 tablet_bootstrap.cc:492] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:54.252704 20800 tablet_bootstrap.cc:654] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139: Neither blocks nor log segments found. Creating new log.
I20240502 02:00:54.253259 20728 catalog_manager.cc:5484] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193). New cstate: current_term: 1 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:54.253654 20800 tablet_bootstrap.cc:492] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139: No bootstrap required, opened a new log
I20240502 02:00:54.253752 20800 ts_tablet_manager.cc:1367] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20240502 02:00:54.254060 20800 raft_consensus.cc:348] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.254130 20800 raft_consensus.cc:374] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 02:00:54.254166 20800 raft_consensus.cc:729] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:54.254274 20800 consensus_queue.cc:260] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.254345 20800 raft_consensus.cc:388] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:54.254374 20800 raft_consensus.cc:482] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:54.254417 20800 raft_consensus.cc:3037] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Advancing to term 1
I20240502 02:00:54.255056 20800 raft_consensus.cc:504] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.255167 20800 leader_election.cc:302] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:54.255263 20800 leader_election.cc:288] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 02:00:54.255311 20802 raft_consensus.cc:2781] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 02:00:54.255384 20802 raft_consensus.cc:686] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139 [term 1 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:54.255467 20800 ts_tablet_manager.cc:1398] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 02:00:54.255479 20802 consensus_queue.cc:237] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.255628 20800 tablet_bootstrap.cc:492] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:54.256351 20800 tablet_bootstrap.cc:654] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139: Neither blocks nor log segments found. Creating new log.
I20240502 02:00:54.256760 20728 catalog_manager.cc:5484] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193). New cstate: current_term: 1 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:54.257287 20800 tablet_bootstrap.cc:492] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139: No bootstrap required, opened a new log
I20240502 02:00:54.257345 20800 ts_tablet_manager.cc:1367] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 02:00:54.257916 20800 raft_consensus.cc:348] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.258003 20800 raft_consensus.cc:374] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 02:00:54.258033 20800 raft_consensus.cc:729] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:54.258137 20800 consensus_queue.cc:260] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.258237 20800 raft_consensus.cc:388] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:54.258275 20800 raft_consensus.cc:482] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:54.258317 20800 raft_consensus.cc:3037] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Advancing to term 1
I20240502 02:00:54.258889 20800 raft_consensus.cc:504] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.258984 20800 leader_election.cc:302] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:54.259083 20800 leader_election.cc:288] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 02:00:54.259136 20802 raft_consensus.cc:2781] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 02:00:54.259234 20802 raft_consensus.cc:686] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139 [term 1 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:54.259289 20800 ts_tablet_manager.cc:1398] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:54.259336 20802 consensus_queue.cc:237] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.259421 20800 tablet_bootstrap.cc:492] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:54.260224 20800 tablet_bootstrap.cc:654] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139: Neither blocks nor log segments found. Creating new log.
I20240502 02:00:54.260545 20728 catalog_manager.cc:5484] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193). New cstate: current_term: 1 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:54.261023 20800 tablet_bootstrap.cc:492] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139: No bootstrap required, opened a new log
I20240502 02:00:54.261087 20800 ts_tablet_manager.cc:1367] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 02:00:54.261453 20800 raft_consensus.cc:348] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.261536 20800 raft_consensus.cc:374] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 02:00:54.261574 20800 raft_consensus.cc:729] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:54.261682 20800 consensus_queue.cc:260] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.261786 20800 raft_consensus.cc:388] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:54.261828 20800 raft_consensus.cc:482] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:54.261873 20800 raft_consensus.cc:3037] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Advancing to term 1
I20240502 02:00:54.262493 20800 raft_consensus.cc:504] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.262588 20800 leader_election.cc:302] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:54.262655 20800 leader_election.cc:288] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 02:00:54.262713 20804 raft_consensus.cc:2781] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 02:00:54.262790 20804 raft_consensus.cc:686] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139 [term 1 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:54.262858 20800 ts_tablet_manager.cc:1398] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:54.262887 20804 consensus_queue.cc:237] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.262981 20800 tablet_bootstrap.cc:492] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:54.263706 20800 tablet_bootstrap.cc:654] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139: Neither blocks nor log segments found. Creating new log.
I20240502 02:00:54.264094 20728 catalog_manager.cc:5484] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193). New cstate: current_term: 1 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:54.264660 20800 tablet_bootstrap.cc:492] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139: No bootstrap required, opened a new log
I20240502 02:00:54.264731 20800 ts_tablet_manager.cc:1367] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 02:00:54.265048 20800 raft_consensus.cc:348] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.265137 20800 raft_consensus.cc:374] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 02:00:54.265190 20800 raft_consensus.cc:729] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:54.265305 20800 consensus_queue.cc:260] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.265395 20800 raft_consensus.cc:388] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:54.265440 20800 raft_consensus.cc:482] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:54.265486 20800 raft_consensus.cc:3037] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Advancing to term 1
I20240502 02:00:54.266155 20800 raft_consensus.cc:504] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.266249 20800 leader_election.cc:302] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:54.266345 20800 leader_election.cc:288] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 02:00:54.266384 20804 raft_consensus.cc:2781] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 02:00:54.266479 20804 raft_consensus.cc:686] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139 [term 1 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:54.266575 20804 consensus_queue.cc:237] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.266624 20800 ts_tablet_manager.cc:1398] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:54.266763 20800 tablet_bootstrap.cc:492] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:54.267511 20800 tablet_bootstrap.cc:654] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139: Neither blocks nor log segments found. Creating new log.
I20240502 02:00:54.268074 20728 catalog_manager.cc:5484] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193). New cstate: current_term: 1 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:54.268457 20800 tablet_bootstrap.cc:492] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139: No bootstrap required, opened a new log
I20240502 02:00:54.268539 20800 ts_tablet_manager.cc:1367] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 02:00:54.268918 20800 raft_consensus.cc:348] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.269062 20800 raft_consensus.cc:374] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 02:00:54.269095 20800 raft_consensus.cc:729] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:54.269201 20800 consensus_queue.cc:260] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.269295 20800 raft_consensus.cc:388] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:54.269326 20800 raft_consensus.cc:482] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:54.269359 20800 raft_consensus.cc:3037] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Advancing to term 1
I20240502 02:00:54.269989 20800 raft_consensus.cc:504] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.270104 20800 leader_election.cc:302] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:54.270181 20800 leader_election.cc:288] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 02:00:54.270236 20804 raft_consensus.cc:2781] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 02:00:54.270326 20804 raft_consensus.cc:686] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139 [term 1 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:54.270354 20800 ts_tablet_manager.cc:1398] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:54.270431 20804 consensus_queue.cc:237] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.270493 20800 tablet_bootstrap.cc:492] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:54.271296 20800 tablet_bootstrap.cc:654] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139: Neither blocks nor log segments found. Creating new log.
I20240502 02:00:54.271669 20728 catalog_manager.cc:5484] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193). New cstate: current_term: 1 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:54.272193 20800 tablet_bootstrap.cc:492] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139: No bootstrap required, opened a new log
I20240502 02:00:54.272264 20800 ts_tablet_manager.cc:1367] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 02:00:54.272614 20800 raft_consensus.cc:348] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.272697 20800 raft_consensus.cc:374] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 02:00:54.272727 20800 raft_consensus.cc:729] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:54.272830 20800 consensus_queue.cc:260] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.272900 20800 raft_consensus.cc:388] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:54.272934 20800 raft_consensus.cc:482] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:54.272974 20800 raft_consensus.cc:3037] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Advancing to term 1
I20240502 02:00:54.273594 20800 raft_consensus.cc:504] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.273698 20800 leader_election.cc:302] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:54.273804 20800 leader_election.cc:288] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 02:00:54.273852 20803 raft_consensus.cc:2781] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 02:00:54.273932 20803 raft_consensus.cc:686] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139 [term 1 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:54.274003 20800 ts_tablet_manager.cc:1398] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:54.274031 20803 consensus_queue.cc:237] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.274163 20800 tablet_bootstrap.cc:492] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:54.274843 20800 tablet_bootstrap.cc:654] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139: Neither blocks nor log segments found. Creating new log.
I20240502 02:00:54.275148 20728 catalog_manager.cc:5484] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193). New cstate: current_term: 1 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:54.275774 20800 tablet_bootstrap.cc:492] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139: No bootstrap required, opened a new log
I20240502 02:00:54.275856 20800 ts_tablet_manager.cc:1367] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 02:00:54.276216 20800 raft_consensus.cc:348] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.276286 20800 raft_consensus.cc:374] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 02:00:54.276305 20800 raft_consensus.cc:729] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:54.276396 20800 consensus_queue.cc:260] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.276459 20800 raft_consensus.cc:388] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:54.276489 20800 raft_consensus.cc:482] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:54.276532 20800 raft_consensus.cc:3037] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Advancing to term 1
I20240502 02:00:54.277046 20800 raft_consensus.cc:504] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.277158 20800 leader_election.cc:302] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:54.277245 20800 leader_election.cc:288] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 02:00:54.277298 20803 raft_consensus.cc:2781] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 02:00:54.277387 20803 raft_consensus.cc:686] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139 [term 1 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:54.277499 20803 consensus_queue.cc:237] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.277518 20800 ts_tablet_manager.cc:1398] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:54.277719 20800 tablet_bootstrap.cc:492] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:54.278384 20800 tablet_bootstrap.cc:654] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139: Neither blocks nor log segments found. Creating new log.
I20240502 02:00:54.278913 20728 catalog_manager.cc:5484] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193). New cstate: current_term: 1 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:54.279266 20800 tablet_bootstrap.cc:492] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139: No bootstrap required, opened a new log
I20240502 02:00:54.279347 20800 ts_tablet_manager.cc:1367] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20240502 02:00:54.279738 20800 raft_consensus.cc:348] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.279809 20800 raft_consensus.cc:374] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 02:00:54.279837 20800 raft_consensus.cc:729] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:54.279943 20800 consensus_queue.cc:260] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.280009 20800 raft_consensus.cc:388] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:54.280047 20800 raft_consensus.cc:482] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:54.280094 20800 raft_consensus.cc:3037] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Advancing to term 1
I20240502 02:00:54.280714 20800 raft_consensus.cc:504] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.280817 20800 leader_election.cc:302] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:54.280897 20800 leader_election.cc:288] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 02:00:54.280944 20803 raft_consensus.cc:2781] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 02:00:54.281035 20803 raft_consensus.cc:686] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139 [term 1 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:54.281073 20800 ts_tablet_manager.cc:1398] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 02:00:54.281128 20803 consensus_queue.cc:237] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.281213 20800 tablet_bootstrap.cc:492] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:54.282464 20728 catalog_manager.cc:5484] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193). New cstate: current_term: 1 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:54.301810 20800 tablet_bootstrap.cc:654] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139: Neither blocks nor log segments found. Creating new log.
I20240502 02:00:54.302619 20800 tablet_bootstrap.cc:492] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139: No bootstrap required, opened a new log
I20240502 02:00:54.302691 20800 ts_tablet_manager.cc:1367] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.000s
I20240502 02:00:54.303009 20800 raft_consensus.cc:348] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.303079 20800 raft_consensus.cc:374] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 02:00:54.303107 20800 raft_consensus.cc:729] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:54.303225 20800 consensus_queue.cc:260] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.303287 20800 raft_consensus.cc:388] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:54.303321 20800 raft_consensus.cc:482] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:54.303364 20800 raft_consensus.cc:3037] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Advancing to term 1
I20240502 02:00:54.303891 20800 raft_consensus.cc:504] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.303993 20800 leader_election.cc:302] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:54.304077 20800 leader_election.cc:288] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 02:00:54.304136 20803 raft_consensus.cc:2781] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 02:00:54.304234 20803 raft_consensus.cc:686] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139 [term 1 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:54.304265 20800 ts_tablet_manager.cc:1398] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 02:00:54.304322 20803 consensus_queue.cc:237] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.304391 20800 tablet_bootstrap.cc:492] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:54.305160 20800 tablet_bootstrap.cc:654] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139: Neither blocks nor log segments found. Creating new log.
I20240502 02:00:54.305507 20728 catalog_manager.cc:5484] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193). New cstate: current_term: 1 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:54.306033 20800 tablet_bootstrap.cc:492] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139: No bootstrap required, opened a new log
I20240502 02:00:54.306105 20800 ts_tablet_manager.cc:1367] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 02:00:54.306490 20800 raft_consensus.cc:348] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.306562 20800 raft_consensus.cc:374] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 02:00:54.306589 20800 raft_consensus.cc:729] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:54.306694 20800 consensus_queue.cc:260] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.306805 20800 raft_consensus.cc:388] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:54.306864 20800 raft_consensus.cc:482] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:54.306900 20800 raft_consensus.cc:3037] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Advancing to term 1
I20240502 02:00:54.307572 20800 raft_consensus.cc:504] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.307679 20800 leader_election.cc:302] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:54.307767 20800 leader_election.cc:288] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 02:00:54.307822 20802 raft_consensus.cc:2781] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 02:00:54.307914 20802 raft_consensus.cc:686] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139 [term 1 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:54.307971 20800 ts_tablet_manager.cc:1398] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:54.308020 20802 consensus_queue.cc:237] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.308101 20800 tablet_bootstrap.cc:492] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:54.308830 20800 tablet_bootstrap.cc:654] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139: Neither blocks nor log segments found. Creating new log.
I20240502 02:00:54.309484 20728 catalog_manager.cc:5484] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193). New cstate: current_term: 1 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:54.309790 20800 tablet_bootstrap.cc:492] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139: No bootstrap required, opened a new log
I20240502 02:00:54.309861 20800 ts_tablet_manager.cc:1367] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 02:00:54.310243 20800 raft_consensus.cc:348] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.310331 20800 raft_consensus.cc:374] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 02:00:54.310369 20800 raft_consensus.cc:729] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:54.310475 20800 consensus_queue.cc:260] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.310554 20800 raft_consensus.cc:388] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:54.310588 20800 raft_consensus.cc:482] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:54.310634 20800 raft_consensus.cc:3037] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Advancing to term 1
I20240502 02:00:54.311169 20800 raft_consensus.cc:504] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.311280 20800 leader_election.cc:302] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:54.311364 20800 leader_election.cc:288] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 02:00:54.311407 20803 raft_consensus.cc:2781] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 02:00:54.311503 20803 raft_consensus.cc:686] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139 [term 1 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:54.311558 20800 ts_tablet_manager.cc:1398] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 02:00:54.311626 20803 consensus_queue.cc:237] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.311682 20800 tablet_bootstrap.cc:492] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:54.312530 20800 tablet_bootstrap.cc:654] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139: Neither blocks nor log segments found. Creating new log.
I20240502 02:00:54.312739 20728 catalog_manager.cc:5484] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193). New cstate: current_term: 1 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:54.313419 20800 tablet_bootstrap.cc:492] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139: No bootstrap required, opened a new log
I20240502 02:00:54.313501 20800 ts_tablet_manager.cc:1367] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 02:00:54.313916 20800 raft_consensus.cc:348] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.314009 20800 raft_consensus.cc:374] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 02:00:54.314040 20800 raft_consensus.cc:729] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:54.314155 20800 consensus_queue.cc:260] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.314239 20800 raft_consensus.cc:388] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:54.314280 20800 raft_consensus.cc:482] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:54.314324 20800 raft_consensus.cc:3037] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139 [term 0 FOLLOWER]: Advancing to term 1
I20240502 02:00:54.315038 20800 raft_consensus.cc:504] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.315151 20800 leader_election.cc:302] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:54.315279 20802 raft_consensus.cc:2781] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 02:00:54.315359 20802 raft_consensus.cc:686] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139 [term 1 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:54.315469 20802 consensus_queue.cc:237] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:54.315793 20800 leader_election.cc:288] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 02:00:54.315979 20800 ts_tablet_manager.cc:1398] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:54.316819 20728 catalog_manager.cc:5484] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193). New cstate: current_term: 1 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:56.339174 16703 external_mini_cluster.cc:1326] Running /tmp/dist-test-task3rm6An/build/debug/bin/kudu
/tmp/dist-test-task3rm6An/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.79.194:41805
--local_ip_for_outbound_sockets=127.16.79.194
--tserver_master_addrs=127.16.79.254:41035
--webserver_port=40525
--webserver_interface=127.16.79.194
--builtin_ntp_servers=127.16.79.212:36407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=20 with env {}
W20240502 02:00:56.436967 20890 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 02:00:56.437130 20890 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 02:00:56.437177 20890 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 02:00:56.440084 20890 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 02:00:56.440179 20890 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.79.194
I20240502 02:00:56.443576 20890 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.79.212:36407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.79.194:41805
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.79.194
--webserver_port=40525
--tserver_master_addrs=127.16.79.254:41035
--num_tablets_to_copy_simultaneously=20
--never_fsync=true
--heap_profile_path=/tmp/kudu.20890
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.79.194
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 02:00:56.444355 20890 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 02:00:56.445521 20890 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 02:00:56.452780 20895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:56.453286 20898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:56.453819 20896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 02:00:56.454239 20890 server_base.cc:1034] running on GCE node
I20240502 02:00:56.454545 20890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 02:00:56.454975 20890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 02:00:56.456120 20890 hybrid_clock.cc:648] HybridClock initialized: now 1714615256456111 us; error 23 us; skew 500 ppm
I20240502 02:00:56.457672 20890 webserver.cc:460] Webserver started at http://127.16.79.194:40525/ using document root <none> and password file <none>
I20240502 02:00:56.458140 20890 fs_manager.cc:359] Metadata directory not provided
I20240502 02:00:56.458209 20890 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 02:00:56.460948 20890 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:56.462503 20904 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:56.463320 20890 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 02:00:56.463425 20890 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-1/data,/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-1/wal
uuid: "3150ab3728ad4a57bb02f6673b3148d2"
format_stamp: "Formatted at 2024-05-02 02:00:53 on dist-test-slave-tj0m"
I20240502 02:00:56.463748 20890 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 02:00:56.474788 20890 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 02:00:56.475183 20890 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 02:00:56.475291 20890 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 02:00:56.475661 20890 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 02:00:56.476346 20890 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 02:00:56.476387 20890 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:56.476420 20890 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 02:00:56.476439 20890 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:56.483767 20890 rpc_server.cc:307] RPC server started. Bound to: 127.16.79.194:41805
I20240502 02:00:56.483966 21019 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.79.194:41805 every 8 connection(s)
I20240502 02:00:56.484658 20890 server_base.cc:1166] Dumped server information to /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-1/data/info.pb
I20240502 02:00:56.491909 21020 heartbeater.cc:347] Connected to a master server at 127.16.79.254:41035
I20240502 02:00:56.492079 21020 heartbeater.cc:464] Registering TS with master...
I20240502 02:00:56.492492 21020 heartbeater.cc:511] Master 127.16.79.254:41035 requested a full tablet report, sending...
I20240502 02:00:56.493395 20719 ts_manager.cc:194] Registered new tserver with Master: 3150ab3728ad4a57bb02f6673b3148d2 (127.16.79.194:41805)
I20240502 02:00:56.493918 16703 external_mini_cluster.cc:1388] Started /tmp/dist-test-task3rm6An/build/debug/bin/kudu as pid 20890
I20240502 02:00:56.494207 20719 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.79.194:37289
I20240502 02:00:56.494627 16703 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task3rm6An/build/debug/bin/kudu with pid 20429
I20240502 02:00:56.502382 16703 external_mini_cluster.cc:1326] Running /tmp/dist-test-task3rm6An/build/debug/bin/kudu
/tmp/dist-test-task3rm6An/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.79.193:44765
--local_ip_for_outbound_sockets=127.16.79.193
--tserver_master_addrs=127.16.79.254:41035
--webserver_port=45991
--webserver_interface=127.16.79.193
--builtin_ntp_servers=127.16.79.212:36407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=20
--rpc_service_queue_length=1
--rpc_num_service_threads=1 with env {}
W20240502 02:00:56.599431 21024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 02:00:56.599608 21024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 02:00:56.599673 21024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 02:00:56.602574 21024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 02:00:56.602691 21024 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.79.193
I20240502 02:00:56.606117 21024 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.79.212:36407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.79.193:44765
--rpc_num_service_threads=1
--rpc_server_allow_ephemeral_ports=true
--rpc_service_queue_length=1
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.79.193
--webserver_port=45991
--tserver_master_addrs=127.16.79.254:41035
--num_tablets_to_copy_simultaneously=20
--never_fsync=true
--heap_profile_path=/tmp/kudu.21024
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.79.193
--log_dir=/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 02:00:56.606822 21024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 02:00:56.607764 21024 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 02:00:56.615026 21031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:56.615547 21030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 02:00:56.615943 21033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 02:00:56.616357 21024 server_base.cc:1034] running on GCE node
I20240502 02:00:56.616678 21024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 02:00:56.617138 21024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 02:00:56.618288 21024 hybrid_clock.cc:648] HybridClock initialized: now 1714615256618274 us; error 24 us; skew 500 ppm
I20240502 02:00:56.619846 21024 webserver.cc:460] Webserver started at http://127.16.79.193:45991/ using document root <none> and password file <none>
I20240502 02:00:56.620323 21024 fs_manager.cc:359] Metadata directory not provided
I20240502 02:00:56.620397 21024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 02:00:56.623302 21024 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20240502 02:00:56.625972 21039 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 02:00:56.626852 21024 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240502 02:00:56.626953 21024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-0/data,/tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-0/wal
uuid: "ecdee71f76b04c42b4621aa6951fa139"
format_stamp: "Formatted at 2024-05-02 02:00:53 on dist-test-slave-tj0m"
I20240502 02:00:56.627285 21024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 02:00:56.643191 21024 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 02:00:56.643667 21024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 02:00:56.643788 21024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 02:00:56.644203 21024 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 02:00:56.645242 21046 ts_tablet_manager.cc:516] Loading tablet metadata (0/20 complete)
I20240502 02:00:56.658066 21024 ts_tablet_manager.cc:559] Loaded tablet metadata (20 total tablets, 20 live tablets)
I20240502 02:00:56.658114 21024 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.013s user 0.001s sys 0.000s
I20240502 02:00:56.658159 21024 ts_tablet_manager.cc:574] Registering tablets (0/20 complete)
I20240502 02:00:56.660010 21046 tablet_bootstrap.cc:492] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:56.666528 21024 ts_tablet_manager.cc:590] Registered 20 tablets
I20240502 02:00:56.666568 21024 ts_tablet_manager.cc:569] Time spent register tablets: real 0.008s user 0.008s sys 0.000s
I20240502 02:00:56.670255 21024 rpc_server.cc:307] RPC server started. Bound to: 127.16.79.193:44765
I20240502 02:00:56.670312 21058 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.79.193:44765 every 8 connection(s)
I20240502 02:00:56.671113 21024 server_base.cc:1166] Dumped server information to /tmp/dist-test-task3rm6An/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714615241968978-16703-0/minicluster-data/ts-0/data/info.pb
I20240502 02:00:56.676630 16703 external_mini_cluster.cc:1388] Started /tmp/dist-test-task3rm6An/build/debug/bin/kudu as pid 21024
I20240502 02:00:56.678460 21059 heartbeater.cc:347] Connected to a master server at 127.16.79.254:41035
I20240502 02:00:56.678645 21059 heartbeater.cc:464] Registering TS with master...
I20240502 02:00:56.679061 21059 heartbeater.cc:511] Master 127.16.79.254:41035 requested a full tablet report, sending...
I20240502 02:00:56.681054 20719 ts_manager.cc:194] Re-registered known tserver with Master: ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193:44765)
I20240502 02:00:56.684478 20719 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.79.193:35545
I20240502 02:00:56.684639 21046 log.cc:824] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139: Log is configured to *not* fsync() on all Append() calls
I20240502 02:00:56.786032 21046 tablet_bootstrap.cc:492] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap replayed 1/1 log segments. Stats: ops{read=195 overwritten=0 applied=195 ignored=0} inserts{seen=515 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 02:00:56.786340 21046 tablet_bootstrap.cc:492] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap complete.
I20240502 02:00:56.787179 21046 ts_tablet_manager.cc:1367] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.127s user 0.121s sys 0.004s
I20240502 02:00:56.788856 21046 raft_consensus.cc:348] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:56.789145 21046 raft_consensus.cc:729] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:56.789530 21046 consensus_queue.cc:260] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:56.789647 21046 raft_consensus.cc:388] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:56.789709 21046 raft_consensus.cc:482] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:56.789832 21046 raft_consensus.cc:3037] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Advancing to term 2
I20240502 02:00:56.791250 21046 raft_consensus.cc:504] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:56.791549 21046 leader_election.cc:302] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:56.791852 21046 leader_election.cc:288] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 02:00:56.791913 21064 raft_consensus.cc:2781] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 02:00:56.792097 21064 raft_consensus.cc:686] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139 [term 2 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:56.792414 21059 heartbeater.cc:503] Master 127.16.79.254:41035 was elected leader, sending a full tablet report...
I20240502 02:00:56.792389 21064 consensus_queue.cc:237] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 195, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:56.792606 21046 ts_tablet_manager.cc:1398] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20240502 02:00:56.792804 21046 tablet_bootstrap.cc:492] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:56.795344 20719 catalog_manager.cc:5484] T 7d1da903cf7749a5bb454cef5a01fd55 P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:56.909591 21046 tablet_bootstrap.cc:492] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap replayed 1/1 log segments. Stats: ops{read=203 overwritten=0 applied=203 ignored=0} inserts{seen=547 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 02:00:56.909862 21046 tablet_bootstrap.cc:492] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap complete.
I20240502 02:00:56.910584 21046 ts_tablet_manager.cc:1367] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.118s user 0.101s sys 0.016s
I20240502 02:00:56.910987 21046 raft_consensus.cc:348] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:56.911070 21046 raft_consensus.cc:729] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:56.911182 21046 consensus_queue.cc:260] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 203, Last appended: 1.203, Last appended by leader: 203, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:56.911247 21046 raft_consensus.cc:388] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:56.911278 21046 raft_consensus.cc:482] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:56.911320 21046 raft_consensus.cc:3037] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Advancing to term 2
I20240502 02:00:56.911926 21046 raft_consensus.cc:504] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:56.912035 21046 leader_election.cc:302] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:56.912123 21046 leader_election.cc:288] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 02:00:56.912199 21064 raft_consensus.cc:2781] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 02:00:56.912293 21064 raft_consensus.cc:686] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139 [term 2 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:56.912325 21046 ts_tablet_manager.cc:1398] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 02:00:56.912438 21046 tablet_bootstrap.cc:492] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:56.912398 21064 consensus_queue.cc:237] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 203, Committed index: 203, Last appended: 1.203, Last appended by leader: 203, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:56.913584 20719 catalog_manager.cc:5484] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:57.022186 21046 tablet_bootstrap.cc:492] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139: Bootstrap replayed 1/1 log segments. Stats: ops{read=193 overwritten=0 applied=193 ignored=0} inserts{seen=516 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 02:00:57.022471 21046 tablet_bootstrap.cc:492] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139: Bootstrap complete.
I20240502 02:00:57.023204 21046 ts_tablet_manager.cc:1367] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.111s user 0.105s sys 0.004s
I20240502 02:00:57.023597 21046 raft_consensus.cc:348] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.023687 21046 raft_consensus.cc:729] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:57.023814 21046 consensus_queue.cc:260] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 193, Last appended: 1.193, Last appended by leader: 193, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.023903 21046 raft_consensus.cc:388] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:57.023949 21046 raft_consensus.cc:482] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:57.023990 21046 raft_consensus.cc:3037] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Advancing to term 2
I20240502 02:00:57.024644 21046 raft_consensus.cc:504] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.024767 21046 leader_election.cc:302] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:57.024869 21046 leader_election.cc:288] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 02:00:57.024926 21064 raft_consensus.cc:2781] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 02:00:57.025019 21064 raft_consensus.cc:686] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139 [term 2 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:57.025079 21046 ts_tablet_manager.cc:1398] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 02:00:57.025125 21064 consensus_queue.cc:237] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 193, Committed index: 193, Last appended: 1.193, Last appended by leader: 193, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.025199 21046 tablet_bootstrap.cc:492] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:57.026381 20719 catalog_manager.cc:5484] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:57.134970 21046 tablet_bootstrap.cc:492] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap replayed 1/1 log segments. Stats: ops{read=189 overwritten=0 applied=189 ignored=0} inserts{seen=499 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 02:00:57.135237 21046 tablet_bootstrap.cc:492] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap complete.
I20240502 02:00:57.135962 21046 ts_tablet_manager.cc:1367] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.111s user 0.097s sys 0.012s
I20240502 02:00:57.136304 21046 raft_consensus.cc:348] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.136389 21046 raft_consensus.cc:729] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:57.136502 21046 consensus_queue.cc:260] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 189, Last appended: 1.189, Last appended by leader: 189, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.136581 21046 raft_consensus.cc:388] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:57.136624 21046 raft_consensus.cc:482] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:57.136669 21046 raft_consensus.cc:3037] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Advancing to term 2
I20240502 02:00:57.137300 21046 raft_consensus.cc:504] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.137411 21046 leader_election.cc:302] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:57.137497 21046 leader_election.cc:288] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 02:00:57.137566 21064 raft_consensus.cc:2781] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 02:00:57.137661 21064 raft_consensus.cc:686] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139 [term 2 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:57.137710 21046 ts_tablet_manager.cc:1398] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 02:00:57.137799 21064 consensus_queue.cc:237] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 189, Committed index: 189, Last appended: 1.189, Last appended by leader: 189, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.137846 21046 tablet_bootstrap.cc:492] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:57.138919 20719 catalog_manager.cc:5484] T caf7c697404b4b6b8f476dd27066c340 P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:57.249302 21046 tablet_bootstrap.cc:492] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139: Bootstrap replayed 1/1 log segments. Stats: ops{read=198 overwritten=0 applied=198 ignored=0} inserts{seen=516 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 02:00:57.249579 21046 tablet_bootstrap.cc:492] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139: Bootstrap complete.
I20240502 02:00:57.250344 21046 ts_tablet_manager.cc:1367] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.113s user 0.100s sys 0.012s
I20240502 02:00:57.250736 21046 raft_consensus.cc:348] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.250824 21046 raft_consensus.cc:729] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:57.250939 21046 consensus_queue.cc:260] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 198, Last appended: 1.198, Last appended by leader: 198, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.251003 21046 raft_consensus.cc:388] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:57.251025 21046 raft_consensus.cc:482] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:57.251067 21046 raft_consensus.cc:3037] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Advancing to term 2
I20240502 02:00:57.251713 21046 raft_consensus.cc:504] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.251827 21046 leader_election.cc:302] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:57.251914 21046 leader_election.cc:288] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 02:00:57.251951 21064 raft_consensus.cc:2781] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 02:00:57.252038 21064 raft_consensus.cc:686] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139 [term 2 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:57.252127 21046 ts_tablet_manager.cc:1398] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 02:00:57.252136 21064 consensus_queue.cc:237] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 198, Committed index: 198, Last appended: 1.198, Last appended by leader: 198, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.252264 21046 tablet_bootstrap.cc:492] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:57.253311 20719 catalog_manager.cc:5484] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:57.361193 21046 tablet_bootstrap.cc:492] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139: Bootstrap replayed 1/1 log segments. Stats: ops{read=197 overwritten=0 applied=197 ignored=0} inserts{seen=512 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 02:00:57.361439 21046 tablet_bootstrap.cc:492] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139: Bootstrap complete.
I20240502 02:00:57.362176 21046 ts_tablet_manager.cc:1367] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.110s user 0.102s sys 0.008s
I20240502 02:00:57.362545 21046 raft_consensus.cc:348] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.362636 21046 raft_consensus.cc:729] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:57.362733 21046 consensus_queue.cc:260] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 197, Last appended: 1.197, Last appended by leader: 197, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.362804 21046 raft_consensus.cc:388] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:57.362833 21046 raft_consensus.cc:482] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:57.362864 21046 raft_consensus.cc:3037] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Advancing to term 2
I20240502 02:00:57.363462 21046 raft_consensus.cc:504] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.363561 21046 leader_election.cc:302] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:57.363637 21046 leader_election.cc:288] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 02:00:57.363696 21064 raft_consensus.cc:2781] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 02:00:57.363781 21064 raft_consensus.cc:686] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139 [term 2 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:57.363842 21046 ts_tablet_manager.cc:1398] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 02:00:57.363885 21064 consensus_queue.cc:237] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 197, Committed index: 197, Last appended: 1.197, Last appended by leader: 197, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.363960 21046 tablet_bootstrap.cc:492] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:57.365048 20719 catalog_manager.cc:5484] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:57.473455 21046 tablet_bootstrap.cc:492] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139: Bootstrap replayed 1/1 log segments. Stats: ops{read=195 overwritten=0 applied=195 ignored=0} inserts{seen=509 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 02:00:57.473699 21046 tablet_bootstrap.cc:492] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139: Bootstrap complete.
I20240502 02:00:57.474406 21046 ts_tablet_manager.cc:1367] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.110s user 0.101s sys 0.008s
I20240502 02:00:57.474720 21046 raft_consensus.cc:348] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.474797 21046 raft_consensus.cc:729] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:57.474905 21046 consensus_queue.cc:260] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.474980 21046 raft_consensus.cc:388] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:57.475018 21046 raft_consensus.cc:482] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:57.475065 21046 raft_consensus.cc:3037] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Advancing to term 2
I20240502 02:00:57.475678 21046 raft_consensus.cc:504] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.475786 21046 leader_election.cc:302] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:57.475870 21046 leader_election.cc:288] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 02:00:57.475932 21065 raft_consensus.cc:2781] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 02:00:57.476030 21065 raft_consensus.cc:686] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139 [term 2 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:57.476083 21046 ts_tablet_manager.cc:1398] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 02:00:57.476190 21046 tablet_bootstrap.cc:492] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:57.476130 21065 consensus_queue.cc:237] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 195, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.477396 20719 catalog_manager.cc:5484] T f05c4ec5116541419948ae4af1bcb34a P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:57.498229 21020 heartbeater.cc:503] Master 127.16.79.254:41035 was elected leader, sending a full tablet report...
I20240502 02:00:57.586436 21046 tablet_bootstrap.cc:492] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap replayed 1/1 log segments. Stats: ops{read=194 overwritten=0 applied=194 ignored=0} inserts{seen=504 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 02:00:57.586694 21046 tablet_bootstrap.cc:492] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap complete.
I20240502 02:00:57.587383 21046 ts_tablet_manager.cc:1367] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.111s user 0.098s sys 0.012s
I20240502 02:00:57.587715 21046 raft_consensus.cc:348] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.587796 21046 raft_consensus.cc:729] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:57.587886 21046 consensus_queue.cc:260] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 194, Last appended: 1.194, Last appended by leader: 194, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.587940 21046 raft_consensus.cc:388] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:57.587960 21046 raft_consensus.cc:482] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:57.587991 21046 raft_consensus.cc:3037] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Advancing to term 2
I20240502 02:00:57.588608 21046 raft_consensus.cc:504] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.588716 21046 leader_election.cc:302] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:57.588790 21046 leader_election.cc:288] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 02:00:57.588853 21065 raft_consensus.cc:2781] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 02:00:57.588930 21065 raft_consensus.cc:686] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139 [term 2 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:57.589001 21046 ts_tablet_manager.cc:1398] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 02:00:57.589042 21065 consensus_queue.cc:237] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 194, Committed index: 194, Last appended: 1.194, Last appended by leader: 194, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.589154 21046 tablet_bootstrap.cc:492] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:57.590380 20719 catalog_manager.cc:5484] T d74fab82aa3a42fa897e7d649ac57815 P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:57.703624 21046 tablet_bootstrap.cc:492] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap replayed 1/1 log segments. Stats: ops{read=196 overwritten=0 applied=196 ignored=0} inserts{seen=545 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 02:00:57.703872 21046 tablet_bootstrap.cc:492] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap complete.
I20240502 02:00:57.704578 21046 ts_tablet_manager.cc:1367] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.115s user 0.097s sys 0.016s
I20240502 02:00:57.704895 21046 raft_consensus.cc:348] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.704977 21046 raft_consensus.cc:729] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:57.705081 21046 consensus_queue.cc:260] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 196, Last appended: 1.196, Last appended by leader: 196, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.705145 21046 raft_consensus.cc:388] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:57.705183 21046 raft_consensus.cc:482] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:57.705225 21046 raft_consensus.cc:3037] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Advancing to term 2
I20240502 02:00:57.705879 21046 raft_consensus.cc:504] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.705996 21046 leader_election.cc:302] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:57.706084 21046 leader_election.cc:288] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 02:00:57.706132 21066 raft_consensus.cc:2781] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 02:00:57.706286 21046 ts_tablet_manager.cc:1398] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.000s sys 0.004s
I20240502 02:00:57.706265 21066 raft_consensus.cc:686] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139 [term 2 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:57.706452 21046 tablet_bootstrap.cc:492] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:57.706424 21066 consensus_queue.cc:237] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 196, Committed index: 196, Last appended: 1.196, Last appended by leader: 196, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.707597 20719 catalog_manager.cc:5484] T 2d52144ee76b409dbef9df26ced28059 P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:57.820868 21046 tablet_bootstrap.cc:492] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139: Bootstrap replayed 1/1 log segments. Stats: ops{read=196 overwritten=0 applied=196 ignored=0} inserts{seen=533 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 02:00:57.821210 21046 tablet_bootstrap.cc:492] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139: Bootstrap complete.
I20240502 02:00:57.822046 21046 ts_tablet_manager.cc:1367] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.116s user 0.095s sys 0.020s
I20240502 02:00:57.822398 21046 raft_consensus.cc:348] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.822484 21046 raft_consensus.cc:729] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:57.822582 21046 consensus_queue.cc:260] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 196, Last appended: 1.196, Last appended by leader: 196, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.822640 21046 raft_consensus.cc:388] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:57.822666 21046 raft_consensus.cc:482] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:57.822697 21046 raft_consensus.cc:3037] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Advancing to term 2
I20240502 02:00:57.823319 21046 raft_consensus.cc:504] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.823429 21046 leader_election.cc:302] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:57.823498 21046 leader_election.cc:288] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 02:00:57.823557 21066 raft_consensus.cc:2781] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 02:00:57.823642 21066 raft_consensus.cc:686] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139 [term 2 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:57.823717 21046 ts_tablet_manager.cc:1398] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 02:00:57.823748 21066 consensus_queue.cc:237] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 196, Committed index: 196, Last appended: 1.196, Last appended by leader: 196, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.823840 21046 tablet_bootstrap.cc:492] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:57.825120 20719 catalog_manager.cc:5484] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:57.936636 21046 tablet_bootstrap.cc:492] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap replayed 1/1 log segments. Stats: ops{read=196 overwritten=0 applied=196 ignored=0} inserts{seen=541 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 02:00:57.936905 21046 tablet_bootstrap.cc:492] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap complete.
I20240502 02:00:57.937682 21046 ts_tablet_manager.cc:1367] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.114s user 0.102s sys 0.008s
I20240502 02:00:57.938083 21046 raft_consensus.cc:348] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.938175 21046 raft_consensus.cc:729] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:57.938297 21046 consensus_queue.cc:260] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 196, Last appended: 1.196, Last appended by leader: 196, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.938380 21046 raft_consensus.cc:388] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:57.938405 21046 raft_consensus.cc:482] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:57.938449 21046 raft_consensus.cc:3037] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Advancing to term 2
I20240502 02:00:57.939098 21046 raft_consensus.cc:504] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.939210 21046 leader_election.cc:302] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:57.939301 21046 leader_election.cc:288] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 02:00:57.939369 21066 raft_consensus.cc:2781] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 02:00:57.939464 21066 raft_consensus.cc:686] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139 [term 2 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:57.939517 21046 ts_tablet_manager.cc:1398] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 02:00:57.939564 21066 consensus_queue.cc:237] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 196, Committed index: 196, Last appended: 1.196, Last appended by leader: 196, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:57.939646 21046 tablet_bootstrap.cc:492] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:57.940951 20719 catalog_manager.cc:5484] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:58.050391 21046 tablet_bootstrap.cc:492] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap replayed 1/1 log segments. Stats: ops{read=199 overwritten=0 applied=199 ignored=0} inserts{seen=531 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 02:00:58.050669 21046 tablet_bootstrap.cc:492] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap complete.
I20240502 02:00:58.051379 21046 ts_tablet_manager.cc:1367] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.112s user 0.094s sys 0.016s
I20240502 02:00:58.051715 21046 raft_consensus.cc:348] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:58.051805 21046 raft_consensus.cc:729] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:58.051898 21046 consensus_queue.cc:260] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 199, Last appended: 1.199, Last appended by leader: 199, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:58.051944 21046 raft_consensus.cc:388] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:58.051963 21046 raft_consensus.cc:482] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:58.051988 21046 raft_consensus.cc:3037] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Advancing to term 2
I20240502 02:00:58.052623 21046 raft_consensus.cc:504] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:58.052731 21046 leader_election.cc:302] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:58.052801 21046 leader_election.cc:288] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 02:00:58.052867 21066 raft_consensus.cc:2781] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 02:00:58.052943 21066 raft_consensus.cc:686] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139 [term 2 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:58.053021 21046 ts_tablet_manager.cc:1398] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 02:00:58.053052 21066 consensus_queue.cc:237] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 199, Committed index: 199, Last appended: 1.199, Last appended by leader: 199, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:58.053184 21046 tablet_bootstrap.cc:492] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:58.054473 20719 catalog_manager.cc:5484] T f228a61b3ba8418792a60b33588208c2 P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:58.165135 21046 tablet_bootstrap.cc:492] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139: Bootstrap replayed 1/1 log segments. Stats: ops{read=201 overwritten=0 applied=201 ignored=0} inserts{seen=531 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 02:00:58.165386 21046 tablet_bootstrap.cc:492] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139: Bootstrap complete.
I20240502 02:00:58.166111 21046 ts_tablet_manager.cc:1367] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.113s user 0.097s sys 0.016s
I20240502 02:00:58.166448 21046 raft_consensus.cc:348] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:58.166549 21046 raft_consensus.cc:729] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:58.166652 21046 consensus_queue.cc:260] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 201, Last appended: 1.201, Last appended by leader: 201, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:58.166707 21046 raft_consensus.cc:388] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:58.166734 21046 raft_consensus.cc:482] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:58.166765 21046 raft_consensus.cc:3037] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Advancing to term 2
I20240502 02:00:58.167392 21046 raft_consensus.cc:504] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:58.167497 21046 leader_election.cc:302] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:58.167591 21046 leader_election.cc:288] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 02:00:58.167630 21066 raft_consensus.cc:2781] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 02:00:58.167704 21066 raft_consensus.cc:686] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139 [term 2 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:58.167824 21046 ts_tablet_manager.cc:1398] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 02:00:58.167812 21066 consensus_queue.cc:237] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 201, Committed index: 201, Last appended: 1.201, Last appended by leader: 201, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:58.167945 21046 tablet_bootstrap.cc:492] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:58.169081 20719 catalog_manager.cc:5484] T 16d1b68e36224267996e4beb5700027f P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:58.279153 21046 tablet_bootstrap.cc:492] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap replayed 1/1 log segments. Stats: ops{read=194 overwritten=0 applied=194 ignored=0} inserts{seen=556 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 02:00:58.279412 21046 tablet_bootstrap.cc:492] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap complete.
I20240502 02:00:58.280123 21046 ts_tablet_manager.cc:1367] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.112s user 0.098s sys 0.012s
I20240502 02:00:58.280455 21046 raft_consensus.cc:348] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:58.280541 21046 raft_consensus.cc:729] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:58.280655 21046 consensus_queue.cc:260] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 194, Last appended: 1.194, Last appended by leader: 194, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:58.280735 21046 raft_consensus.cc:388] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:58.280776 21046 raft_consensus.cc:482] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:58.280822 21046 raft_consensus.cc:3037] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Advancing to term 2
I20240502 02:00:58.281459 21046 raft_consensus.cc:504] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:58.281576 21046 leader_election.cc:302] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:58.281661 21046 leader_election.cc:288] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 02:00:58.281747 21066 raft_consensus.cc:2781] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 02:00:58.281845 21066 raft_consensus.cc:686] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139 [term 2 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:58.281881 21046 ts_tablet_manager.cc:1398] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
I20240502 02:00:58.281947 21066 consensus_queue.cc:237] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 194, Committed index: 194, Last appended: 1.194, Last appended by leader: 194, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:58.282003 21046 tablet_bootstrap.cc:492] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:58.283140 20719 catalog_manager.cc:5484] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:58.391081 21046 tablet_bootstrap.cc:492] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap replayed 1/1 log segments. Stats: ops{read=190 overwritten=0 applied=190 ignored=0} inserts{seen=496 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 02:00:58.391335 21046 tablet_bootstrap.cc:492] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap complete.
I20240502 02:00:58.392035 21046 ts_tablet_manager.cc:1367] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.110s user 0.092s sys 0.016s
I20240502 02:00:58.392360 21046 raft_consensus.cc:348] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:58.392439 21046 raft_consensus.cc:729] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:58.392551 21046 consensus_queue.cc:260] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 190, Last appended: 1.190, Last appended by leader: 190, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:58.392614 21046 raft_consensus.cc:388] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:58.392647 21046 raft_consensus.cc:482] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:58.392692 21046 raft_consensus.cc:3037] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Advancing to term 2
I20240502 02:00:58.393321 21046 raft_consensus.cc:504] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:58.393426 21046 leader_election.cc:302] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:58.393508 21046 leader_election.cc:288] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 02:00:58.393548 21066 raft_consensus.cc:2781] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 02:00:58.393649 21066 raft_consensus.cc:686] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139 [term 2 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:58.393713 21046 ts_tablet_manager.cc:1398] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 02:00:58.393781 21066 consensus_queue.cc:237] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 190, Committed index: 190, Last appended: 1.190, Last appended by leader: 190, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:58.393914 21046 tablet_bootstrap.cc:492] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:58.395023 20719 catalog_manager.cc:5484] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:58.529901 21046 tablet_bootstrap.cc:492] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap replayed 1/1 log segments. Stats: ops{read=190 overwritten=0 applied=190 ignored=0} inserts{seen=493 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 02:00:58.530170 21046 tablet_bootstrap.cc:492] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap complete.
I20240502 02:00:58.530937 21046 ts_tablet_manager.cc:1367] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.137s user 0.107s sys 0.004s
I20240502 02:00:58.531291 21046 raft_consensus.cc:348] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:58.531378 21046 raft_consensus.cc:729] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:58.531491 21046 consensus_queue.cc:260] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 190, Last appended: 1.190, Last appended by leader: 190, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:58.531571 21046 raft_consensus.cc:388] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:58.531607 21046 raft_consensus.cc:482] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:58.531656 21046 raft_consensus.cc:3037] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Advancing to term 2
I20240502 02:00:58.532305 21046 raft_consensus.cc:504] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:58.532420 21046 leader_election.cc:302] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:58.532509 21046 leader_election.cc:288] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 02:00:58.532574 21066 raft_consensus.cc:2781] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 02:00:58.532682 21066 raft_consensus.cc:686] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139 [term 2 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:58.532738 21046 ts_tablet_manager.cc:1398] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 02:00:58.532792 21066 consensus_queue.cc:237] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 190, Committed index: 190, Last appended: 1.190, Last appended by leader: 190, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:58.532888 21046 tablet_bootstrap.cc:492] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:58.534025 20719 catalog_manager.cc:5484] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:58.651171 21046 tablet_bootstrap.cc:492] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139: Bootstrap replayed 1/1 log segments. Stats: ops{read=198 overwritten=0 applied=198 ignored=0} inserts{seen=585 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 02:00:58.651448 21046 tablet_bootstrap.cc:492] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139: Bootstrap complete.
I20240502 02:00:58.652172 21046 ts_tablet_manager.cc:1367] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.119s user 0.109s sys 0.008s
I20240502 02:00:58.652532 21046 raft_consensus.cc:348] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:58.652626 21046 raft_consensus.cc:729] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:58.652743 21046 consensus_queue.cc:260] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 198, Last appended: 1.198, Last appended by leader: 198, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:58.652813 21046 raft_consensus.cc:388] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:58.652853 21046 raft_consensus.cc:482] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:58.652896 21046 raft_consensus.cc:3037] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Advancing to term 2
I20240502 02:00:58.653560 21046 raft_consensus.cc:504] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:58.653687 21046 leader_election.cc:302] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:58.653790 21046 leader_election.cc:288] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 02:00:58.653839 21066 raft_consensus.cc:2781] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 02:00:58.653939 21066 raft_consensus.cc:686] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139 [term 2 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:58.654003 21046 ts_tablet_manager.cc:1398] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
I20240502 02:00:58.654042 21066 consensus_queue.cc:237] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 198, Committed index: 198, Last appended: 1.198, Last appended by leader: 198, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:58.654120 21046 tablet_bootstrap.cc:492] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:58.655373 20719 catalog_manager.cc:5484] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:58.770512 21046 tablet_bootstrap.cc:492] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap replayed 1/1 log segments. Stats: ops{read=195 overwritten=0 applied=195 ignored=0} inserts{seen=506 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 02:00:58.770790 21046 tablet_bootstrap.cc:492] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap complete.
I20240502 02:00:58.771507 21046 ts_tablet_manager.cc:1367] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.117s user 0.104s sys 0.012s
I20240502 02:00:58.771848 21046 raft_consensus.cc:348] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:58.771934 21046 raft_consensus.cc:729] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:58.772048 21046 consensus_queue.cc:260] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:58.772118 21046 raft_consensus.cc:388] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:58.772151 21046 raft_consensus.cc:482] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:58.772193 21046 raft_consensus.cc:3037] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Advancing to term 2
I20240502 02:00:58.772814 21046 raft_consensus.cc:504] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:58.772922 21046 leader_election.cc:302] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:58.773012 21046 leader_election.cc:288] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 02:00:58.773077 21066 raft_consensus.cc:2781] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 02:00:58.773173 21066 raft_consensus.cc:686] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139 [term 2 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:58.773232 21046 ts_tablet_manager.cc:1398] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 02:00:58.773272 21066 consensus_queue.cc:237] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 195, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:58.773339 21046 tablet_bootstrap.cc:492] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:58.774531 20719 catalog_manager.cc:5484] T cfae387b6b6c4e5da9bc0c265dd9a701 P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:58.887750 21046 tablet_bootstrap.cc:492] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139: Bootstrap replayed 1/1 log segments. Stats: ops{read=195 overwritten=0 applied=195 ignored=0} inserts{seen=555 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 02:00:58.888089 21046 tablet_bootstrap.cc:492] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139: Bootstrap complete.
I20240502 02:00:58.889117 21046 ts_tablet_manager.cc:1367] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.116s user 0.093s sys 0.020s
I20240502 02:00:58.889492 21046 raft_consensus.cc:348] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:58.889581 21046 raft_consensus.cc:729] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:58.889672 21046 consensus_queue.cc:260] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:58.889726 21046 raft_consensus.cc:388] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:58.889768 21046 raft_consensus.cc:482] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:58.889807 21046 raft_consensus.cc:3037] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Advancing to term 2
I20240502 02:00:58.890440 21046 raft_consensus.cc:504] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:58.890563 21046 leader_election.cc:302] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:58.890635 21046 leader_election.cc:288] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 02:00:58.890699 21066 raft_consensus.cc:2781] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 02:00:58.890779 21066 raft_consensus.cc:686] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139 [term 2 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:58.890858 21046 ts_tablet_manager.cc:1398] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.000s sys 0.004s
I20240502 02:00:58.890888 21066 consensus_queue.cc:237] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 195, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:58.890998 21046 tablet_bootstrap.cc:492] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap starting.
I20240502 02:00:58.892247 20719 catalog_manager.cc:5484] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:59.003746 21046 tablet_bootstrap.cc:492] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap replayed 1/1 log segments. Stats: ops{read=192 overwritten=0 applied=192 ignored=0} inserts{seen=510 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 02:00:59.004016 21046 tablet_bootstrap.cc:492] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139: Bootstrap complete.
I20240502 02:00:59.004742 21046 ts_tablet_manager.cc:1367] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139: Time spent bootstrapping tablet: real 0.114s user 0.098s sys 0.012s
I20240502 02:00:59.005096 21046 raft_consensus.cc:348] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:59.005184 21046 raft_consensus.cc:729] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Initialized, Role: FOLLOWER
I20240502 02:00:59.005300 21046 consensus_queue.cc:260] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 192, Last appended: 1.192, Last appended by leader: 192, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:59.005369 21046 raft_consensus.cc:388] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 02:00:59.005403 21046 raft_consensus.cc:482] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 02:00:59.005446 21046 raft_consensus.cc:3037] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139 [term 1 FOLLOWER]: Advancing to term 2
I20240502 02:00:59.006141 21046 raft_consensus.cc:504] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:59.006260 21046 leader_election.cc:302] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdee71f76b04c42b4621aa6951fa139; no voters:
I20240502 02:00:59.006353 21046 leader_election.cc:288] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 02:00:59.006434 21064 raft_consensus.cc:2781] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 02:00:59.006536 21064 raft_consensus.cc:686] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139 [term 2 LEADER]: Becoming Leader. State: Replica: ecdee71f76b04c42b4621aa6951fa139, State: Running, Role: LEADER
I20240502 02:00:59.006573 21046 ts_tablet_manager.cc:1398] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
I20240502 02:00:59.006639 21064 consensus_queue.cc:237] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 192, Committed index: 192, Last appended: 1.192, Last appended by leader: 192, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } }
I20240502 02:00:59.007939 20719 catalog_manager.cc:5484] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ecdee71f76b04c42b4621aa6951fa139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdee71f76b04c42b4621aa6951fa139" member_type: VOTER last_known_addr { host: "127.16.79.193" port: 44765 } health_report { overall_health: HEALTHY } } }
I20240502 02:00:59.021692 21134 ts_tablet_manager.cc:902] T d474f34c74d0460799c6df42c2251d7d P 3150ab3728ad4a57bb02f6673b3148d2: Initiating tablet copy from peer ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193:44765)
I20240502 02:00:59.021783 21140 ts_tablet_manager.cc:902] T 574ae199657e4e49ae96fc7485847959 P 3150ab3728ad4a57bb02f6673b3148d2: Initiating tablet copy from peer ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193:44765)
I20240502 02:00:59.021992 21142 ts_tablet_manager.cc:902] T 57e25b6fdfdd4f669ab15be5a174417d P 3150ab3728ad4a57bb02f6673b3148d2: Initiating tablet copy from peer ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193:44765)
I20240502 02:00:59.022212 21144 ts_tablet_manager.cc:902] T 40d985f7eb9848798a35c154f6156cc1 P 3150ab3728ad4a57bb02f6673b3148d2: Initiating tablet copy from peer ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193:44765)
I20240502 02:00:59.022650 21143 ts_tablet_manager.cc:902] T 2d52144ee76b409dbef9df26ced28059 P 3150ab3728ad4a57bb02f6673b3148d2: Initiating tablet copy from peer ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193:44765)
I20240502 02:00:59.022861 21151 ts_tablet_manager.cc:902] T 9cb2471a4bbc492c85a197875f1ceade P 3150ab3728ad4a57bb02f6673b3148d2: Initiating tablet copy from peer ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193:44765)
I20240502 02:00:59.022987 21140 tablet_copy_client.cc:308] T 574ae199657e4e49ae96fc7485847959 P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:44765
I20240502 02:00:59.023075 21144 tablet_copy_client.cc:308] T 40d985f7eb9848798a35c154f6156cc1 P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:44765
I20240502 02:00:59.022400 21148 ts_tablet_manager.cc:902] T 2473abe9970e4ce2b0c25f406f949bef P 3150ab3728ad4a57bb02f6673b3148d2: Initiating tablet copy from peer ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193:44765)
I20240502 02:00:59.023407 21149 ts_tablet_manager.cc:902] T fa88cc2aa982450ba0092d6e0256e45e P 3150ab3728ad4a57bb02f6673b3148d2: Initiating tablet copy from peer ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193:44765)
I20240502 02:00:59.023507 21151 tablet_copy_client.cc:308] T 9cb2471a4bbc492c85a197875f1ceade P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:44765
I20240502 02:00:59.023737 21148 tablet_copy_client.cc:308] T 2473abe9970e4ce2b0c25f406f949bef P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:44765
I20240502 02:00:59.022497 21134 tablet_copy_client.cc:308] T d474f34c74d0460799c6df42c2251d7d P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:44765
I20240502 02:00:59.023914 21149 tablet_copy_client.cc:308] T fa88cc2aa982450ba0092d6e0256e45e P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:44765
I20240502 02:00:59.024097 21138 ts_tablet_manager.cc:902] T 0c5168136f4647ee8aecf4e409e803a5 P 3150ab3728ad4a57bb02f6673b3148d2: Initiating tablet copy from peer ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193:44765)
I20240502 02:00:59.022737 21159 ts_tablet_manager.cc:902] T 323350c532bc4d90b1b999f5f6584e10 P 3150ab3728ad4a57bb02f6673b3148d2: Initiating tablet copy from peer ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193:44765)
I20240502 02:00:59.024320 21143 tablet_copy_client.cc:308] T 2d52144ee76b409dbef9df26ced28059 P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:44765
I20240502 02:00:59.024523 21138 tablet_copy_client.cc:308] T 0c5168136f4647ee8aecf4e409e803a5 P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:44765
I20240502 02:00:59.022476 21142 tablet_copy_client.cc:308] T 57e25b6fdfdd4f669ab15be5a174417d P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:44765
I20240502 02:00:59.024746 21135 ts_tablet_manager.cc:902] T 1b8b1df2290d4731b5f467867d344475 P 3150ab3728ad4a57bb02f6673b3148d2: Initiating tablet copy from peer ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193:44765)
I20240502 02:00:59.022481 21147 ts_tablet_manager.cc:902] T ed1661390ffa447e89f9c24a048fc4ca P 3150ab3728ad4a57bb02f6673b3148d2: Initiating tablet copy from peer ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193:44765)
I20240502 02:00:59.023759 21146 ts_tablet_manager.cc:902] T 7d1da903cf7749a5bb454cef5a01fd55 P 3150ab3728ad4a57bb02f6673b3148d2: Initiating tablet copy from peer ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193:44765)
I20240502 02:00:59.024991 21137 ts_tablet_manager.cc:902] T f228a61b3ba8418792a60b33588208c2 P 3150ab3728ad4a57bb02f6673b3148d2: Initiating tablet copy from peer ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193:44765)
I20240502 02:00:59.022516 21150 ts_tablet_manager.cc:902] T cfae387b6b6c4e5da9bc0c265dd9a701 P 3150ab3728ad4a57bb02f6673b3148d2: Initiating tablet copy from peer ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193:44765)
I20240502 02:00:59.022627 21153 ts_tablet_manager.cc:902] T caf7c697404b4b6b8f476dd27066c340 P 3150ab3728ad4a57bb02f6673b3148d2: Initiating tablet copy from peer ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193:44765)
I20240502 02:00:59.025461 21146 tablet_copy_client.cc:308] T 7d1da903cf7749a5bb454cef5a01fd55 P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:44765
I20240502 02:00:59.024835 21159 tablet_copy_client.cc:308] T 323350c532bc4d90b1b999f5f6584e10 P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:44765
I20240502 02:00:59.025820 21153 tablet_copy_client.cc:308] T caf7c697404b4b6b8f476dd27066c340 P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:44765
I20240502 02:00:59.025233 21135 tablet_copy_client.cc:308] T 1b8b1df2290d4731b5f467867d344475 P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:44765
I20240502 02:00:59.025233 21147 tablet_copy_client.cc:308] T ed1661390ffa447e89f9c24a048fc4ca P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:44765
I20240502 02:00:59.025521 21137 tablet_copy_client.cc:308] T f228a61b3ba8418792a60b33588208c2 P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:44765
I20240502 02:00:59.022835 21145 ts_tablet_manager.cc:902] T b9a270c4a93d44b0af03702f01143375 P 3150ab3728ad4a57bb02f6673b3148d2: Initiating tablet copy from peer ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193:44765)
I20240502 02:00:59.022619 21141 ts_tablet_manager.cc:902] T d74fab82aa3a42fa897e7d649ac57815 P 3150ab3728ad4a57bb02f6673b3148d2: Initiating tablet copy from peer ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193:44765)
I20240502 02:00:59.026536 21145 tablet_copy_client.cc:308] T b9a270c4a93d44b0af03702f01143375 P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Beginning tablet copy session from remote peer at address 127.16.79.193:44765
F20240502 02:00:59.026479 21141 trace_metrics.cc:68] Check failed: g_intern_map->size() < 100 (100 vs. 100) Too many interned strings: (MaintenanceMgr.queue_time_us, MaintenanceMgr.queue_time_us) (MaintenanceMgr.run_cpu_time_us, MaintenanceMgr.run_cpu_time_us) (MaintenanceMgr.run_wall_time_us, MaintenanceMgr.run_wall_time_us) (apply.queue_time_us, apply.queue_time_us) (apply.run_cpu_time_us, apply.run_cpu_time_us) (apply.run_wall_time_us, apply.run_wall_time_us) (client-negotiator.queue_time_us, client-negotiator.queue_time_us) (client-negotiator.run_cpu_time_us, client-negotiator.run_cpu_time_us) (client-negotiator.run_wall_time_us, client-negotiator.run_wall_time_us) (compiler_manager_pool.queue_time_us, compiler_manager_pool.queue_time_us) (compiler_manager_pool.run_cpu_time_us, compiler_manager_pool.run_cpu_time_us) (compiler_manager_pool.run_wall_time_us, compiler_manager_pool.run_wall_time_us) (dirs.queue_time_us, dirs.queue_time_us) (dirs.run_cpu_time_us, dirs.run_cpu_time_us) (dirs.run_wall_time_us, dirs.run_wall_time_us) (dns-resolver.queue_time_us, dns-resolver.queue_time_us) (dns-resolver.run_cpu_time_us, dns-resolver.run_cpu_time_us) (dns-resolver.run_wall_time_us, dns-resolver.run_wall_time_us) (prepare.queue_time_us, prepare.queue_time_us) (prepare.run_cpu_time_us, prepare.run_cpu_time_us) (prepare.run_wall_time_us, prepare.run_wall_time_us) (raft.queue_time_us, raft.queue_time_us) (raft.run_cpu_time_us, raft.run_cpu_time_us) (raft.run_wall_time_us, raft.run_wall_time_us) (repair_pool.queue_time_us, repair_pool.queue_time_us) (repair_pool.run_cpu_time_us, repair_pool.run_cpu_time_us) (repair_pool.run_wall_time_us, repair_pool.run_wall_time_us) (server-negotiator.queue_time_us, server-negotiator.queue_time_us) (server-negotiator.run_cpu_time_us, server-negotiator.run_cpu_time_us) (server-negotiator.run_wall_time_us, server-negotiator.run_wall_time_us) (tablet-copy.queue_time_us, tablet-copy.queue_time_us) (tablet-copy.run_cpu_time_us, tablet-copy.run_cpu_time_us) (tablet-copy.run_wall_time_us, tablet-copy.run_wall_time_us) (tablet-delete.queue_time_us, tablet-delete.queue_time_us) (tablet-delete.run_cpu_time_us, tablet-delete.run_cpu_time_us) (tablet-delete.run_wall_time_us, tablet-delete.run_wall_time_us) (tablet-download-pool-0c5168136f4647ee8aecf4e409e803a5.queue_time_us, tablet-download-pool-0c5168136f4647ee8aecf4e409e803a5.queue_time_us) (tablet-download-pool-0c5168136f4647ee8aecf4e409e803a5.run_cpu_time_us, tablet-download-pool-0c5168136f4647ee8aecf4e409e803a5.run_cpu_time_us) (tablet-download-pool-0c5168136f4647ee8aecf4e409e803a5.run_wall_time_us, tablet-download-pool-0c5168136f4647ee8aecf4e409e803a5.run_wall_time_us) (tablet-download-pool-1b8b1df2290d4731b5f467867d344475.queue_time_us, tablet-download-pool-1b8b1df2290d4731b5f467867d344475.queue_time_us) (tablet-download-pool-1b8b1df2290d4731b5f467867d344475.run_cpu_time_us, tablet-download-pool-1b8b1df2290d4731b5f467867d344475.run_cpu_time_us) (tablet-download-pool-1b8b1df2290d4731b5f467867d344475.run_wall_time_us, tablet-download-pool-1b8b1df2290d4731b5f467867d344475.run_wall_time_us) (tablet-download-pool-2473abe9970e4ce2b0c25f406f949bef.queue_time_us, tablet-download-pool-2473abe9970e4ce2b0c25f406f949bef.queue_time_us) (tablet-download-pool-2473abe9970e4ce2b0c25f406f949bef.run_cpu_time_us, tablet-download-pool-2473abe9970e4ce2b0c25f406f949bef.run_cpu_time_us) (tablet-download-pool-2473abe9970e4ce2b0c25f406f949bef.run_wall_time_us, tablet-download-pool-2473abe9970e4ce2b0c25f406f949bef.run_wall_time_us) (tablet-download-pool-2d52144ee76b409dbef9df26ced28059.queue_time_us, tablet-download-pool-2d52144ee76b409dbef9df26ced28059.queue_time_us) (tablet-download-pool-2d52144ee76b409dbef9df26ced28059.run_cpu_time_us, tablet-download-pool-2d52144ee76b409dbef9df26ced28059.run_cpu_time_us) (tablet-download-pool-2d52144ee76b409dbef9df26ced28059.run_wall_time_us, tablet-download-pool-2d52144ee76b409dbef9df26ced28059.run_wall_time_us) (tablet-download-pool-323350c532bc4d90b1b999f5f6584e10.queue_time_us, tablet-download-pool-323350c532bc4d90b1b999f5f6584e10.queue_time_us) (tablet-download-pool-323350c532bc4d90b1b999f5f6584e10.run_cpu_time_us, tablet-download-pool-323350c532bc4d90b1b999f5f6584e10.run_cpu_time_us) (tablet-download-pool-323350c532bc4d90b1b999f5f6584e10.run_wall_time_us, tablet-download-pool-323350c532bc4d90b1b999f5f6584e10.run_wall_time_us) (tablet-download-pool-40d985f7eb9848798a35c154f6156cc1.queue_time_us, tablet-download-pool-40d985f7eb9848798a35c154f6156cc1.queue_time_us) (tablet-download-pool-40d985f7eb9848798a35c154f6156cc1.run_cpu_time_us, tablet-download-pool-40d985f7eb9848798a35c154f6156cc1.run_cpu_time_us) (tablet-download-pool-40d985f7eb9848798a35c154f6156cc1.run_wall_time_us, tablet-download-pool-40d985f7eb9848798a35c154f6156cc1.run_wall_time_us) (tablet-download-pool-574ae199657e4e49ae96fc7485847959.queue_time_us, tablet-download-pool-574ae199657e4e49ae96fc7485847959.queue_time_us) (tablet-download-pool-574ae199657e4e49ae96fc7485847959.run_cpu_time_us, tablet-download-pool-574ae199657e4e49ae96fc7485847959.run_cpu_time_us) (tablet-download-pool-574ae199657e4e49ae96fc7485847959.run_wall_time_us, tablet-download-pool-574ae199657e4e49ae96fc7485847959.run_wall_time_us) (tablet-download-pool-57e25b6fdfdd4f669ab15be5a174417d.queue_time_us, tablet-download-pool-57e25b6fdfdd4f669ab15be5a174417d.queue_time_us) (tablet-download-pool-57e25b6fdfdd4f669ab15be5a174417d.run_cpu_time_us, tablet-download-pool-57e25b6fdfdd4f669ab15be5a174417d.run_cpu_time_us) (tablet-download-pool-57e25b6fdfdd4f669ab15be5a174417d.run_wall_time_us, tablet-download-pool-57e25b6fdfdd4f669ab15be5a174417d.run_wall_time_us) (tablet-download-pool-7d1da903cf7749a5bb454cef5a01fd55.queue_time_us, tablet-download-pool-7d1da903cf7749a5bb454cef5a01fd55.queue_time_us) (tablet-download-pool-7d1da903cf7749a5bb454cef5a01fd55.run_cpu_time_us, tablet-download-pool-7d1da903cf7749a5bb454cef5a01fd55.run_cpu_time_us) (tablet-download-pool-7d1da903cf7749a5bb454cef5a01fd55.run_wall_time_us, tablet-download-pool-7d1da903cf7749a5bb454cef5a01fd55.run_wall_time_us) (tablet-download-pool-9cb2471a4bbc492c85a197875f1ceade.queue_time_us, tablet-download-pool-9cb2471a4bbc492c85a197875f1ceade.queue_time_us) (tablet-download-pool-9cb2471a4bbc492c85a197875f1ceade.run_cpu_time_us, tablet-download-pool-9cb2471a4bbc492c85a197875f1ceade.run_cpu_time_us) (tablet-download-pool-9cb2471a4bbc492c85a197875f1ceade.run_wall_time_us, tablet-download-pool-9cb2471a4bbc492c85a197875f1ceade.run_wall_time_us) (tablet-download-pool-b9a270c4a93d44b0af03702f01143375.queue_time_us, tablet-download-pool-b9a270c4a93d44b0af03702f01143375.queue_time_us) (tablet-download-pool-b9a270c4a93d44b0af03702f01143375.run_cpu_time_us, tablet-download-pool-b9a270c4a93d44b0af03702f01143375.run_cpu_time_us) (tablet-download-pool-b9a270c4a93d44b0af03702f01143375.run_wall_time_us, tablet-download-pool-b9a270c4a93d44b0af03702f01143375.run_wall_time_us) (tablet-download-pool-caf7c697404b4b6b8f476dd27066c340.queue_time_us, tablet-download-pool-caf7c697404b4b6b8f476dd27066c340.queue_time_us) (tablet-download-pool-caf7c697404b4b6b8f476dd27066c340.run_cpu_time_us, tablet-download-pool-caf7c697404b4b6b8f476dd27066c340.run_cpu_time_us) (tablet-download-pool-caf7c697404b4b6b8f476dd27066c340.run_wall_time_us, tablet-download-pool-caf7c697404b4b6b8f476dd27066c340.run_wall_time_us) (tablet-download-pool-d474f34c74d0460799c6df42c2251d7d.queue_time_us, tablet-download-pool-d474f34c74d0460799c6df42c2251d7d.queue_time_us) (tablet-download-pool-d474f34c74d0460799c6df42c2251d7d.run_cpu_time_us, tablet-download-pool-d474f34c74d0460799c6df42c2251d7d.run_cpu_time_us) (tablet-download-pool-d474f34c74d0460799c6df42c2251d7d.run_wall_time_us, tablet-download-pool-d474f34c74d0460799c6df42c2251d7d.run_wall_time_us) (tablet-download-pool-d74fab82aa3a42fa897e7d649ac57815.queue_time_us, tablet-download-pool-d74fab82aa3a42fa897e7d649ac57815.queue_time_us) (tablet-download-pool-ed1661390ffa447e89f9c24a048fc4ca.queue_time_us, tablet-download-pool-ed1661390ffa447e89f9c24a048fc4ca.queue_time_us) (tablet-download-pool-ed1661390ffa447e89f9c24a048fc4ca.run_cpu_time_us, tablet-download-pool-ed1661390ffa447e89f9c24a048fc4ca.run_cpu_time_us) (tablet-download-pool-ed1661390ffa447e89f9c24a048fc4ca.run_wall_time_us, tablet-download-pool-ed1661390ffa447e89f9c24a048fc4ca.run_wall_time_us) (tablet-download-pool-f228a61b3ba8418792a60b33588208c2.queue_time_us, tablet-download-pool-f228a61b3ba8418792a60b33588208c2.queue_time_us) (tablet-download-pool-f228a61b3ba8418792a60b33588208c2.run_cpu_time_us, tablet-download-pool-f228a61b3ba8418792a60b33588208c2.run_cpu_time_us) (tablet-download-pool-f228a61b3ba8418792a60b33588208c2.run_wall_time_us, tablet-download-pool-f228a61b3ba8418792a60b33588208c2.run_wall_time_us) (tablet-download-pool-fa88cc2aa982450ba0092d6e0256e45e.queue_time_us, tablet-download-pool-fa88cc2aa982450ba0092d6e0256e45e.queue_time_us) (tablet-download-pool-fa88cc2aa982450ba0092d6e0256e45e.run_cpu_time_us, tablet-download-pool-fa88cc2aa982450ba0092d6e0256e45e.run_cpu_time_us) (tablet-download-pool-fa88cc2aa982450ba0092d6e0256e45e.run_wall_time_us, tablet-download-pool-fa88cc2aa982450ba0092d6e0256e45e.run_wall_time_us) (tablet-open.queue_time_us, tablet-open.queue_time_us) (tablet-open.run_cpu_time_us, tablet-open.run_cpu_time_us) (tablet-open.run_wall_time_us, tablet-open.run_wall_time_us) (txn-commit.queue_time_us, txn-commit.queue_time_us) (txn-commit.run_cpu_time_us, txn-commit.run_cpu_time_us) (txn-commit.run_wall_time_us, txn-commit.run_wall_time_us) (txn-participant-registration.queue_time_us, txn-participant-registration.queue_time_us) (txn-participant-registration.run_cpu_time_us, txn-participant-registration.run_cpu_time_us) (txn-participant-registration.run_wall_time_us, txn-participant-registration.run_wall_time_us) (txn-status-manager.queue_time_us, txn-status-manager.queue_time_us) (txn-status-manager.run_cpu_time_us, txn-status-manager.run_cpu_time_us) (txn-status-manager.run_wall_time_us, txn-status-manager.run_wall_time_us) (txn-status-tablet-reload.queue_time_us, txn-status-tablet-reload.queue_time_us) (txn-status-tablet-reload.run_cpu_time_us, txn-status-tablet-reload.run_cpu_time_us) (txn-status-tablet-reload.run_wall_time_us, txn-status-tablet-reload.run_wall_time_us)
*** Check failure stack trace: ***
I20240502 02:00:59.025491 21139 ts_tablet_manager.cc:902] T f05c4ec5116541419948ae4af1bcb34a P 3150ab3728ad4a57bb02f6673b3148d2: Initiating tablet copy from peer ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193:44765)
I20240502 02:00:59.024798 21136 ts_tablet_manager.cc:902] T 16d1b68e36224267996e4beb5700027f P 3150ab3728ad4a57bb02f6673b3148d2: Initiating tablet copy from peer ecdee71f76b04c42b4621aa6951fa139 (127.16.79.193:44765)
W20240502 02:00:59.029531 21042 service_pool.cc:135] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items.
I20240502 02:00:59.029546 21052 tablet_copy_service.cc:140] P ecdee71f76b04c42b4621aa6951fa139: Received BeginTabletCopySession request for tablet 574ae199657e4e49ae96fc7485847959 from peer 3150ab3728ad4a57bb02f6673b3148d2 ({username='slave'} at 127.16.79.194:49045)
I20240502 02:00:59.029724 21052 tablet_copy_service.cc:161] P ecdee71f76b04c42b4621aa6951fa139: Beginning new tablet copy session on tablet 574ae199657e4e49ae96fc7485847959 from peer 3150ab3728ad4a57bb02f6673b3148d2 at {username='slave'} at 127.16.79.194:49045: session id = 3150ab3728ad4a57bb02f6673b3148d2-574ae199657e4e49ae96fc7485847959
I20240502 02:00:59.029788 21042 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 1)
I20240502 02:00:59.030079 21042 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 1)
I20240502 02:00:59.030229 21042 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 1)
I20240502 02:00:59.030350 21042 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 1)
I20240502 02:00:59.030495 21042 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 1)
@ 0x7f09d1599dcd google::LogMessage::Fail() at ??:0
I20240502 02:00:59.030673 21042 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 1)
I20240502 02:00:59.033071 21042 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 1)
I20240502 02:00:59.033226 21042 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 1)
@ 0x7f09d159db93 google::LogMessage::SendToLog() at ??:0
I20240502 02:00:59.033360 21042 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 1)
I20240502 02:00:59.033483 21042 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 1)
I20240502 02:00:59.033579 21042 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 1)
I20240502 02:00:59.033660 21042 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 1)
I20240502 02:00:59.033779 21042 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 1)
I20240502 02:00:59.033896 21042 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 1)
@ 0x7f09d15997cc google::LogMessage::Flush() at ??:0
I20240502 02:00:59.035621 21052 tablet_copy_source_session.cc:205] T 574ae199657e4e49ae96fc7485847959 P ecdee71f76b04c42b4621aa6951fa139: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 02:00:59.036343 21052 tablet_copy_service.cc:140] P ecdee71f76b04c42b4621aa6951fa139: Received BeginTabletCopySession request for tablet 40d985f7eb9848798a35c154f6156cc1 from peer 3150ab3728ad4a57bb02f6673b3148d2 ({username='slave'} at 127.16.79.194:49045)
I20240502 02:00:59.036423 21052 tablet_copy_service.cc:161] P ecdee71f76b04c42b4621aa6951fa139: Beginning new tablet copy session on tablet 40d985f7eb9848798a35c154f6156cc1 from peer 3150ab3728ad4a57bb02f6673b3148d2 at {username='slave'} at 127.16.79.194:49045: session id = 3150ab3728ad4a57bb02f6673b3148d2-40d985f7eb9848798a35c154f6156cc1
I20240502 02:00:59.037174 21052 tablet_copy_source_session.cc:205] T 40d985f7eb9848798a35c154f6156cc1 P ecdee71f76b04c42b4621aa6951fa139: Tablet Copy: opened 0 blocks and 1 log segments
@ 0x7f09d159af59 google::LogMessageFatal::~LogMessageFatal() at ??:0
I20240502 02:00:59.038602 21140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 574ae199657e4e49ae96fc7485847959. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f09d2a03044 kudu::TraceMetrics::InternName() at ??:0
I20240502 02:00:59.040490 21144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40d985f7eb9848798a35c154f6156cc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:59.040537 21042 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 17)
I20240502 02:00:59.040911 21052 tablet_copy_service.cc:140] P ecdee71f76b04c42b4621aa6951fa139: Received BeginTabletCopySession request for tablet 1b8b1df2290d4731b5f467867d344475 from peer 3150ab3728ad4a57bb02f6673b3148d2 ({username='slave'} at 127.16.79.194:49045)
I20240502 02:00:59.040987 21052 tablet_copy_service.cc:161] P ecdee71f76b04c42b4621aa6951fa139: Beginning new tablet copy session on tablet 1b8b1df2290d4731b5f467867d344475 from peer 3150ab3728ad4a57bb02f6673b3148d2 at {username='slave'} at 127.16.79.194:49045: session id = 3150ab3728ad4a57bb02f6673b3148d2-1b8b1df2290d4731b5f467867d344475
I20240502 02:00:59.041060 21042 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 17)
I20240502 02:00:59.041695 21052 tablet_copy_source_session.cc:205] T 1b8b1df2290d4731b5f467867d344475 P ecdee71f76b04c42b4621aa6951fa139: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 02:00:59.041909 21052 tablet_copy_service.cc:140] P ecdee71f76b04c42b4621aa6951fa139: Received BeginTabletCopySession request for tablet 2473abe9970e4ce2b0c25f406f949bef from peer 3150ab3728ad4a57bb02f6673b3148d2 ({username='slave'} at 127.16.79.194:49045)
I20240502 02:00:59.041985 21052 tablet_copy_service.cc:161] P ecdee71f76b04c42b4621aa6951fa139: Beginning new tablet copy session on tablet 2473abe9970e4ce2b0c25f406f949bef from peer 3150ab3728ad4a57bb02f6673b3148d2 at {username='slave'} at 127.16.79.194:49045: session id = 3150ab3728ad4a57bb02f6673b3148d2-2473abe9970e4ce2b0c25f406f949bef
I20240502 02:00:59.042021 21042 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 20)
I20240502 02:00:59.042197 21042 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 22)
I20240502 02:00:59.042373 21042 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 23)
I20240502 02:00:59.042663 21052 tablet_copy_source_session.cc:205] T 2473abe9970e4ce2b0c25f406f949bef P ecdee71f76b04c42b4621aa6951fa139: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 02:00:59.042881 21052 tablet_copy_service.cc:140] P ecdee71f76b04c42b4621aa6951fa139: Received BeginTabletCopySession request for tablet 9cb2471a4bbc492c85a197875f1ceade from peer 3150ab3728ad4a57bb02f6673b3148d2 ({username='slave'} at 127.16.79.194:49045)
I20240502 02:00:59.042951 21052 tablet_copy_service.cc:161] P ecdee71f76b04c42b4621aa6951fa139: Beginning new tablet copy session on tablet 9cb2471a4bbc492c85a197875f1ceade from peer 3150ab3728ad4a57bb02f6673b3148d2 at {username='slave'} at 127.16.79.194:49045: session id = 3150ab3728ad4a57bb02f6673b3148d2-9cb2471a4bbc492c85a197875f1ceade
I20240502 02:00:59.043022 21135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b8b1df2290d4731b5f467867d344475. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f09d29e7f98 kudu::ThreadPool::ThreadPool() at ??:0
I20240502 02:00:59.045171 21135 tablet_copy_client.cc:783] T 1b8b1df2290d4731b5f467867d344475 P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Starting download of 0 data blocks...
I20240502 02:00:59.045336 21135 tablet_copy_client.cc:647] T 1b8b1df2290d4731b5f467867d344475 P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Starting download of 1 WAL segments...
I20240502 02:00:59.046036 21042 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 24)
I20240502 02:00:59.046207 21042 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 24)
I20240502 02:00:59.046345 21042 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 24)
I20240502 02:00:59.046821 21148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2473abe9970e4ce2b0c25f406f949bef. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:59.048485 21052 tablet_copy_source_session.cc:205] T 9cb2471a4bbc492c85a197875f1ceade P ecdee71f76b04c42b4621aa6951fa139: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 02:00:59.048704 21052 tablet_copy_service.cc:140] P ecdee71f76b04c42b4621aa6951fa139: Received BeginTabletCopySession request for tablet d474f34c74d0460799c6df42c2251d7d from peer 3150ab3728ad4a57bb02f6673b3148d2 ({username='slave'} at 127.16.79.194:49045)
I20240502 02:00:59.048779 21052 tablet_copy_service.cc:161] P ecdee71f76b04c42b4621aa6951fa139: Beginning new tablet copy session on tablet d474f34c74d0460799c6df42c2251d7d from peer 3150ab3728ad4a57bb02f6673b3148d2 at {username='slave'} at 127.16.79.194:49045: session id = 3150ab3728ad4a57bb02f6673b3148d2-d474f34c74d0460799c6df42c2251d7d
I20240502 02:00:59.048799 21144 tablet_copy_client.cc:783] T 40d985f7eb9848798a35c154f6156cc1 P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Starting download of 0 data blocks...
I20240502 02:00:59.048924 21144 tablet_copy_client.cc:647] T 40d985f7eb9848798a35c154f6156cc1 P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Starting download of 1 WAL segments...
I20240502 02:00:59.049428 21052 tablet_copy_source_session.cc:205] T d474f34c74d0460799c6df42c2251d7d P ecdee71f76b04c42b4621aa6951fa139: Tablet Copy: opened 0 blocks and 1 log segments
@ 0x7f09d29e5efc kudu::ThreadPoolBuilder::Build() at ??:0
I20240502 02:00:59.050204 21148 tablet_copy_client.cc:783] T 2473abe9970e4ce2b0c25f406f949bef P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Starting download of 0 data blocks...
I20240502 02:00:59.050329 21148 tablet_copy_client.cc:647] T 2473abe9970e4ce2b0c25f406f949bef P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Starting download of 1 WAL segments...
I20240502 02:00:59.051323 21134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d474f34c74d0460799c6df42c2251d7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:59.051733 21151 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cb2471a4bbc492c85a197875f1ceade. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:59.051843 21144 tablet_copy_client.cc:523] T 40d985f7eb9848798a35c154f6156cc1 P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 02:00:59.053287 21140 tablet_copy_client.cc:783] T 574ae199657e4e49ae96fc7485847959 P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Starting download of 0 data blocks...
I20240502 02:00:59.053417 21140 tablet_copy_client.cc:647] T 574ae199657e4e49ae96fc7485847959 P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Starting download of 1 WAL segments...
@ 0x7f09d559877a kudu::tserver::TabletCopyClient::TabletCopyClient() at ??:0
I20240502 02:00:59.053300 21134 tablet_copy_client.cc:783] T d474f34c74d0460799c6df42c2251d7d P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Starting download of 0 data blocks...
I20240502 02:00:59.055027 21134 tablet_copy_client.cc:647] T d474f34c74d0460799c6df42c2251d7d P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Starting download of 1 WAL segments...
I20240502 02:00:59.053787 21151 tablet_copy_client.cc:783] T 9cb2471a4bbc492c85a197875f1ceade P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Starting download of 0 data blocks...
I20240502 02:00:59.055176 21151 tablet_copy_client.cc:647] T 9cb2471a4bbc492c85a197875f1ceade P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Starting download of 1 WAL segments...
I20240502 02:00:59.056023 21042 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.16.79.194:49045 (request call id 30)
I20240502 02:00:59.056631 21135 tablet_copy_client.cc:523] T 1b8b1df2290d4731b5f467867d344475 P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
@ 0x7f09d55a1a45 kudu::tserver::RemoteTabletCopyClient::RemoteTabletCopyClient() at ??:0
I20240502 02:00:59.056777 21144 tablet_bootstrap.cc:492] T 40d985f7eb9848798a35c154f6156cc1 P 3150ab3728ad4a57bb02f6673b3148d2: Bootstrap starting.
I20240502 02:00:59.057621 21135 tablet_bootstrap.cc:492] T 1b8b1df2290d4731b5f467867d344475 P 3150ab3728ad4a57bb02f6673b3148d2: Bootstrap starting.
I20240502 02:00:59.061169 21151 tablet_copy_client.cc:523] T 9cb2471a4bbc492c85a197875f1ceade P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 02:00:59.062171 21151 tablet_bootstrap.cc:492] T 9cb2471a4bbc492c85a197875f1ceade P 3150ab3728ad4a57bb02f6673b3148d2: Bootstrap starting.
@ 0x7f09d562276f kudu::tserver::TSTabletManager::RunTabletCopy() at ??:0
I20240502 02:00:59.065865 21042 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 33)
@ 0x7f09d56364f6 kudu::tserver::TabletCopyRunnable::Run() at ??:0
I20240502 02:00:59.067942 21042 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 35)
I20240502 02:00:59.068127 21042 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 35)
I20240502 02:00:59.068291 21042 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 37)
I20240502 02:00:59.068460 21042 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 37)
I20240502 02:00:59.068701 21052 tablet_copy_service.cc:140] P ecdee71f76b04c42b4621aa6951fa139: Received BeginTabletCopySession request for tablet ed1661390ffa447e89f9c24a048fc4ca from peer 3150ab3728ad4a57bb02f6673b3148d2 ({username='slave'} at 127.16.79.194:49045)
I20240502 02:00:59.068774 21052 tablet_copy_service.cc:161] P ecdee71f76b04c42b4621aa6951fa139: Beginning new tablet copy session on tablet ed1661390ffa447e89f9c24a048fc4ca from peer 3150ab3728ad4a57bb02f6673b3148d2 at {username='slave'} at 127.16.79.194:49045: session id = 3150ab3728ad4a57bb02f6673b3148d2-ed1661390ffa447e89f9c24a048fc4ca
I20240502 02:00:59.069767 21042 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 37)
I20240502 02:00:59.069844 21052 tablet_copy_source_session.cc:205] T ed1661390ffa447e89f9c24a048fc4ca P ecdee71f76b04c42b4621aa6951fa139: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 02:00:59.070048 21052 tablet_copy_service.cc:140] P ecdee71f76b04c42b4621aa6951fa139: Received BeginTabletCopySession request for tablet fa88cc2aa982450ba0092d6e0256e45e from peer 3150ab3728ad4a57bb02f6673b3148d2 ({username='slave'} at 127.16.79.194:49045)
I20240502 02:00:59.070693 21147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed1661390ffa447e89f9c24a048fc4ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:59.072681 21147 tablet_copy_client.cc:783] T ed1661390ffa447e89f9c24a048fc4ca P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Starting download of 0 data blocks...
I20240502 02:00:59.072808 21147 tablet_copy_client.cc:647] T ed1661390ffa447e89f9c24a048fc4ca P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Starting download of 1 WAL segments...
@ 0x7f09d5621226 _ZZN4kudu7tserver15TSTabletManager15StartTabletCopyEPKNS_9consensus24StartTabletCopyRequestPBESt8functionIFvRKNS_6StatusENS0_24TabletServerErrorPB_CodeEEEENKUlvE_clEv at ??:0
I20240502 02:00:59.075605 21042 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 40)
I20240502 02:00:59.075785 21042 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 40)
@ 0x7f09d5630c0a _ZNSt17_Function_handlerIFvvEZN4kudu7tserver15TSTabletManager15StartTabletCopyEPKNS1_9consensus24StartTabletCopyRequestPBESt8functionIFvRKNS1_6StatusENS2_24TabletServerErrorPB_CodeEEEEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
I20240502 02:00:59.079396 21042 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 43)
@ 0x56523ede175c std::function<>::operator()() at ??:0
I20240502 02:00:59.080333 21042 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 44)
I20240502 02:00:59.080509 21042 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 44)
I20240502 02:00:59.070129 21052 tablet_copy_service.cc:161] P ecdee71f76b04c42b4621aa6951fa139: Beginning new tablet copy session on tablet fa88cc2aa982450ba0092d6e0256e45e from peer 3150ab3728ad4a57bb02f6673b3148d2 at {username='slave'} at 127.16.79.194:49045: session id = 3150ab3728ad4a57bb02f6673b3148d2-fa88cc2aa982450ba0092d6e0256e45e
I20240502 02:00:59.082599 21052 tablet_copy_source_session.cc:205] T fa88cc2aa982450ba0092d6e0256e45e P ecdee71f76b04c42b4621aa6951fa139: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 02:00:59.084496 21042 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 44)
@ 0x7f09d29eae06 kudu::ThreadPool::DispatchThread() at ??:0
I20240502 02:00:59.084666 21042 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 44)
I20240502 02:00:59.085141 21052 tablet_copy_service.cc:140] P ecdee71f76b04c42b4621aa6951fa139: Received BeginTabletCopySession request for tablet 57e25b6fdfdd4f669ab15be5a174417d from peer 3150ab3728ad4a57bb02f6673b3148d2 ({username='slave'} at 127.16.79.194:49045)
I20240502 02:00:59.085212 21052 tablet_copy_service.cc:161] P ecdee71f76b04c42b4621aa6951fa139: Beginning new tablet copy session on tablet 57e25b6fdfdd4f669ab15be5a174417d from peer 3150ab3728ad4a57bb02f6673b3148d2 at {username='slave'} at 127.16.79.194:49045: session id = 3150ab3728ad4a57bb02f6673b3148d2-57e25b6fdfdd4f669ab15be5a174417d
I20240502 02:00:59.085192 21135 log.cc:824] T 1b8b1df2290d4731b5f467867d344475 P 3150ab3728ad4a57bb02f6673b3148d2: Log is configured to *not* fsync() on all Append() calls
I20240502 02:00:59.085865 21052 tablet_copy_source_session.cc:205] T 57e25b6fdfdd4f669ab15be5a174417d P ecdee71f76b04c42b4621aa6951fa139: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 02:00:59.086400 21149 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa88cc2aa982450ba0092d6e0256e45e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:59.088090 21149 tablet_copy_client.cc:783] T fa88cc2aa982450ba0092d6e0256e45e P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Starting download of 0 data blocks...
I20240502 02:00:59.088212 21149 tablet_copy_client.cc:647] T fa88cc2aa982450ba0092d6e0256e45e P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Starting download of 1 WAL segments...
@ 0x7f09d29eb6ef _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
I20240502 02:00:59.089144 21142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57e25b6fdfdd4f669ab15be5a174417d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:59.090893 21142 tablet_copy_client.cc:783] T 57e25b6fdfdd4f669ab15be5a174417d P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Starting download of 0 data blocks...
I20240502 02:00:59.091014 21142 tablet_copy_client.cc:647] T 57e25b6fdfdd4f669ab15be5a174417d P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Starting download of 1 WAL segments...
I20240502 02:00:59.091499 21042 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 49)
@ 0x7f09d29ed03b _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
I20240502 02:00:59.094326 21052 tablet_copy_service.cc:140] P ecdee71f76b04c42b4621aa6951fa139: Received BeginTabletCopySession request for tablet 323350c532bc4d90b1b999f5f6584e10 from peer 3150ab3728ad4a57bb02f6673b3148d2 ({username='slave'} at 127.16.79.194:49045)
I20240502 02:00:59.094400 21052 tablet_copy_service.cc:161] P ecdee71f76b04c42b4621aa6951fa139: Beginning new tablet copy session on tablet 323350c532bc4d90b1b999f5f6584e10 from peer 3150ab3728ad4a57bb02f6673b3148d2 at {username='slave'} at 127.16.79.194:49045: session id = 3150ab3728ad4a57bb02f6673b3148d2-323350c532bc4d90b1b999f5f6584e10
@ 0x56523ede175c std::function<>::operator()() at ??:0
I20240502 02:00:59.095352 21149 tablet_copy_client.cc:523] T fa88cc2aa982450ba0092d6e0256e45e P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 02:00:59.095733 21052 tablet_copy_source_session.cc:205] T 323350c532bc4d90b1b999f5f6584e10 P ecdee71f76b04c42b4621aa6951fa139: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 02:00:59.096304 21149 tablet_bootstrap.cc:492] T fa88cc2aa982450ba0092d6e0256e45e P 3150ab3728ad4a57bb02f6673b3148d2: Bootstrap starting.
I20240502 02:00:59.096338 21159 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 323350c532bc4d90b1b999f5f6584e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:59.098024 21159 tablet_copy_client.cc:783] T 323350c532bc4d90b1b999f5f6584e10 P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Starting download of 0 data blocks...
I20240502 02:00:59.098153 21159 tablet_copy_client.cc:647] T 323350c532bc4d90b1b999f5f6584e10 P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Starting download of 1 WAL segments...
I20240502 02:00:59.101166 21042 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 51)
I20240502 02:00:59.101488 21042 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 51)
@ 0x7f09d29da807 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f09d32186db start_thread at ??:0
I20240502 02:00:59.104630 21052 tablet_copy_service.cc:140] P ecdee71f76b04c42b4621aa6951fa139: Received BeginTabletCopySession request for tablet b9a270c4a93d44b0af03702f01143375 from peer 3150ab3728ad4a57bb02f6673b3148d2 ({username='slave'} at 127.16.79.194:49045)
I20240502 02:00:59.105662 21052 tablet_copy_service.cc:161] P ecdee71f76b04c42b4621aa6951fa139: Beginning new tablet copy session on tablet b9a270c4a93d44b0af03702f01143375 from peer 3150ab3728ad4a57bb02f6673b3148d2 at {username='slave'} at 127.16.79.194:49045: session id = 3150ab3728ad4a57bb02f6673b3148d2-b9a270c4a93d44b0af03702f01143375
I20240502 02:00:59.106150 21042 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.16.79.194:49045 (request call id 55)
I20240502 02:00:59.107084 21042 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.16.79.194:49045 (request call id 55)
I20240502 02:00:59.107254 21042 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.16.79.194:49045 (request call id 55)
I20240502 02:00:59.107088 21052 tablet_copy_source_session.cc:205] T b9a270c4a93d44b0af03702f01143375 P ecdee71f76b04c42b4621aa6951fa139: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 02:00:59.108134 21145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9a270c4a93d44b0af03702f01143375. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:59.110061 21145 tablet_copy_client.cc:783] T b9a270c4a93d44b0af03702f01143375 P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Starting download of 0 data blocks...
I20240502 02:00:59.110183 21145 tablet_copy_client.cc:647] T b9a270c4a93d44b0af03702f01143375 P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Starting download of 1 WAL segments...
I20240502 02:00:59.110728 21042 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.16.79.194:49045 (request call id 55)
I20240502 02:00:59.113201 21042 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.16.79.194:49045 (request call id 55)
I20240502 02:00:59.115083 21140 tablet_copy_client.cc:523] T 574ae199657e4e49ae96fc7485847959 P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 02:00:59.116133 21140 tablet_bootstrap.cc:492] T 574ae199657e4e49ae96fc7485847959 P 3150ab3728ad4a57bb02f6673b3148d2: Bootstrap starting.
I20240502 02:00:59.118172 21042 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 61)
I20240502 02:00:59.122407 21042 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 61)
I20240502 02:00:59.122840 21042 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.16.79.194:49045 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.16.79.194:49045 (request call id 61)
I20240502 02:00:59.126003 21052 tablet_copy_service.cc:140] P ecdee71f76b04c42b4621aa6951fa139: Received BeginTabletCopySession request for tablet 0c5168136f4647ee8aecf4e409e803a5 from peer 3150ab3728ad4a57bb02f6673b3148d2 ({username='slave'} at 127.16.79.194:49045)
I20240502 02:00:59.126091 21052 tablet_copy_service.cc:161] P ecdee71f76b04c42b4621aa6951fa139: Beginning new tablet copy session on tablet 0c5168136f4647ee8aecf4e409e803a5 from peer 3150ab3728ad4a57bb02f6673b3148d2 at {username='slave'} at 127.16.79.194:49045: session id = 3150ab3728ad4a57bb02f6673b3148d2-0c5168136f4647ee8aecf4e409e803a5
I20240502 02:00:59.126772 21052 tablet_copy_source_session.cc:205] T 0c5168136f4647ee8aecf4e409e803a5 P ecdee71f76b04c42b4621aa6951fa139: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 02:00:59.127368 21138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c5168136f4647ee8aecf4e409e803a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 02:00:59.129088 21138 tablet_copy_client.cc:783] T 0c5168136f4647ee8aecf4e409e803a5 P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Starting download of 0 data blocks...
I20240502 02:00:59.129213 21138 tablet_copy_client.cc:647] T 0c5168136f4647ee8aecf4e409e803a5 P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Starting download of 1 WAL segments...
I20240502 02:00:59.131099 21138 tablet_copy_client.cc:523] T 0c5168136f4647ee8aecf4e409e803a5 P 3150ab3728ad4a57bb02f6673b3148d2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 02:00:59.132078 21138 tablet_bootstrap.cc:492] T 0c5168136f4647ee8aecf4e409e803a5 P 3150ab3728ad4a57bb02f6673b3148d2: Bootstrap starting.
@ 0x7f09d075071f clone at ??:0
W20240502 02:00:59.286849 20333 connection.cc:535] client connection to 127.16.79.194:41805 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
F20240502 02:00:59.287199 21132 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
F20240502 02:00:59.287220 21113 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 02:00:59.287230 21124 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: F20240502 02:00:59.287241 21118 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 02:00:59.287329 21127 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 02:00:59.287299 21116 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 02:00:59.287256 21126 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 02:00:59.287200 21130 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
*** Aborted at 1714615259 (unix time) try "date -d @1714615259" if you are using GNU date ***
F20240502 02:00:59.287220 21113 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 02:00:59.287230 21124 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: F20240502 02:00:59.287241 21118 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 02:00:59.287329 21127 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 02:00:59.287299 21116 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 02:00:59.287256 21126 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 02:00:59.287200 21130 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
F20240502 02:00:59.287220 21113 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 02:00:59.287230 21124 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: F20240502 02:00:59.287241 21118 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 02:00:59.287329 21127 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 02:00:59.287299 21116 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 02:00:59.287256 21126 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 02:00:59.287200 21130 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
F20240502 02:00:59.287220 21113 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 02:00:59.287230 21124 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: F20240502 02:00:59.287241 21118 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 02:00:59.287329 21127 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 02:00:59.287299 21116 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 02:00:59.287256 21126 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 02:00:59.287200 21130 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
F20240502 02:00:59.287220 21113 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 02:00:59.287230 21124 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: F20240502 02:00:59.287241 21118 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 02:00:59.287329 21127 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 02:00:59.287299 21116 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 02:00:59.287256 21126 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 02:00:59.287200 21130 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
F20240502 02:00:59.287220 21113 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 02:00:59.287230 21124 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: F20240502 02:00:59.287241 21118 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 02:00:59.287329 21127 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 02:00:59.287299 21116 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 02:00:59.287256 21126 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 02:00:59.287200 21130 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
F20240502 02:00:59.287220 21113 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 02:00:59.287230 21124 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: F20240502 02:00:59.287241 21118 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 02:00:59.287329 21127 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 02:00:59.287299 21116 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 02:00:59.287256 21126 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 02:00:59.287200 21130 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e80000413f) received by PID 16703 (TID 0x7f8132b0b700) from PID 16703; stack trace: ***
@ 0x7f814fd31980 (unknown) at ??:0
@ 0x7f814dc1ffb7 gsignal at ??:0
@ 0x7f814dc21921 abort at ??:0
@ 0x7f814ea8adcd google::LogMessage::Fail() at ??:0
@ 0x7f814ea8eb93 google::LogMessage::SendToLog() at ??:0
@ 0x7f814ea8a7cc google::LogMessage::Flush() at ??:0
@ 0x7f814ea8bf59 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x562974b2b088 _ZZN4kudu62TabletCopyClientSessionITest_TestTabletCopyWithBusySource_Test8TestBodyEvENKUlvE_clEv at ??:0
@ 0x562974b2ea35 _ZSt13__invoke_implIvZN4kudu62TabletCopyClientSessionITest_TestTabletCopyWithBusySource_Test8TestBodyEvEUlvE_JEET_St14__invoke_otherOT0_DpOT1_ at ??:0
@ 0x562974b2e207 _ZSt8__invokeIZN4kudu62TabletCopyClientSessionITest_TestTabletCopyWithBusySource_Test8TestBodyEvEUlvE_JEENSt15__invoke_resultIT_JDpT0_EE4typeEOS4_DpOS5_ at ??:0
@ 0x562974b306e6 _ZNSt6thread8_InvokerISt5tupleIJZN4kudu62TabletCopyClientSessionITest_TestTabletCopyWithBusySource_Test8TestBodyEvEUlvE_EEE9_M_invokeIJLm0EEEEDTcl8__invokespcl10_S_declvalIXT_EEEEESt12_Index_tupleIJXspT_EEE at ??:0
@ 0x562974b3065f _ZNSt6thread8_InvokerISt5tupleIJZN4kudu62TabletCopyClientSessionITest_TestTabletCopyWithBusySource_Test8TestBodyEvEUlvE_EEEclEv at ??:0
@ 0x562974b305f6 _ZNSt6thread11_State_implINS_8_InvokerISt5tupleIJZN4kudu62TabletCopyClientSessionITest_TestTabletCopyWithBusySource_Test8TestBodyEvEUlvE_EEEEE6_M_runEv at ??:0
@ 0x7f814e2a76df (unknown) at ??:0
@ 0x7f814fd266db start_thread at ??:0
@ 0x7f814dd0271f clone at ??:0