[==========] Running 5 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 5 tests from TabletCopyClientSessionITest
[ RUN ] TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping
2024-05-03T08:02:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-03T08:02:00Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20240503 08:02:00.955319 14718 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9G1ywP/build/debug/bin/kudu
/tmp/dist-test-task9G1ywP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.95.190:40839
--webserver_interface=127.14.95.190
--webserver_port=0
--builtin_ntp_servers=127.14.95.148:35399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.95.190:40839
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240503 08:02:01.067597 14726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:02:01.067852 14726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:02:01.067893 14726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:02:01.071044 14726 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240503 08:02:01.071113 14726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:02:01.071139 14726 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240503 08:02:01.071157 14726 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240503 08:02:01.074992 14726 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.95.148:35399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.14.95.190:40839
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.95.190:40839
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.95.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.14726
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type DEBUG
built by None at 03 May 2024 07:43:15 UTC on 1a15035a6830
build id 101
I20240503 08:02:01.075956 14726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:02:01.077168 14726 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:02:01.085057 14734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:01.085758 14731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:01.086562 14732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:02:01.087332 14726 server_base.cc:1034] running on GCE node
I20240503 08:02:01.087895 14726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:02:01.088907 14726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:02:01.090090 14726 hybrid_clock.cc:648] HybridClock initialized: now 1714723321090062 us; error 71 us; skew 500 ppm
I20240503 08:02:01.092234 14726 webserver.cc:460] Webserver started at http://127.14.95.190:37953/ using document root <none> and password file <none>
I20240503 08:02:01.092818 14726 fs_manager.cc:359] Metadata directory not provided
I20240503 08:02:01.092880 14726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:02:01.093093 14726 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:02:01.094892 14726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/master-0/data/instance:
uuid: "4325972c2cc14fa68b337310e9f45a07"
format_stamp: "Formatted at 2024-05-03 08:02:01 on dist-test-slave-0z1c"
I20240503 08:02:01.095379 14726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/master-0/wal/instance:
uuid: "4325972c2cc14fa68b337310e9f45a07"
format_stamp: "Formatted at 2024-05-03 08:02:01 on dist-test-slave-0z1c"
I20240503 08:02:01.098927 14726 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20240503 08:02:01.101395 14740 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:01.102506 14726 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240503 08:02:01.102632 14726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/master-0/data,/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/master-0/wal
uuid: "4325972c2cc14fa68b337310e9f45a07"
format_stamp: "Formatted at 2024-05-03 08:02:01 on dist-test-slave-0z1c"
I20240503 08:02:01.102727 14726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:02:01.121256 14726 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:02:01.121956 14726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:02:01.122124 14726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:02:01.128705 14726 rpc_server.cc:307] RPC server started. Bound to: 127.14.95.190:40839
I20240503 08:02:01.128713 14792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.95.190:40839 every 8 connection(s)
I20240503 08:02:01.129851 14726 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/master-0/data/info.pb
I20240503 08:02:01.132160 14718 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9G1ywP/build/debug/bin/kudu as pid 14726
I20240503 08:02:01.132315 14718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/master-0/wal/instance
I20240503 08:02:01.132830 14793 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:01.139390 14793 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07: Bootstrap starting.
I20240503 08:02:01.141721 14793 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07: Neither blocks nor log segments found. Creating new log.
I20240503 08:02:01.142566 14793 log.cc:824] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07: Log is configured to *not* fsync() on all Append() calls
I20240503 08:02:01.144349 14793 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07: No bootstrap required, opened a new log
I20240503 08:02:01.147236 14793 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4325972c2cc14fa68b337310e9f45a07" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 40839 } }
I20240503 08:02:01.147457 14793 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:02:01.147528 14793 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4325972c2cc14fa68b337310e9f45a07, State: Initialized, Role: FOLLOWER
I20240503 08:02:01.148084 14793 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4325972c2cc14fa68b337310e9f45a07" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 40839 } }
I20240503 08:02:01.148267 14793 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:01.148332 14793 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:01.148440 14793 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:02:01.149296 14793 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4325972c2cc14fa68b337310e9f45a07" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 40839 } }
I20240503 08:02:01.149627 14793 leader_election.cc:302] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4325972c2cc14fa68b337310e9f45a07; no voters:
I20240503 08:02:01.149905 14793 leader_election.cc:288] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:02:01.150230 14798 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:02:01.150430 14798 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07 [term 1 LEADER]: Becoming Leader. State: Replica: 4325972c2cc14fa68b337310e9f45a07, State: Running, Role: LEADER
I20240503 08:02:01.150691 14798 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4325972c2cc14fa68b337310e9f45a07" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 40839 } }
I20240503 08:02:01.150985 14793 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07 [sys.catalog]: configured and running, proceeding with master startup.
I20240503 08:02:01.152140 14799 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4325972c2cc14fa68b337310e9f45a07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4325972c2cc14fa68b337310e9f45a07" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 40839 } } }
I20240503 08:02:01.152292 14799 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07 [sys.catalog]: This master's current role is: LEADER
I20240503 08:02:01.152140 14800 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4325972c2cc14fa68b337310e9f45a07. Latest consensus state: current_term: 1 leader_uuid: "4325972c2cc14fa68b337310e9f45a07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4325972c2cc14fa68b337310e9f45a07" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 40839 } } }
I20240503 08:02:01.152345 14800 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07 [sys.catalog]: This master's current role is: LEADER
I20240503 08:02:01.152631 14807 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240503 08:02:01.156178 14807 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240503 08:02:01.162073 14807 catalog_manager.cc:1347] Generated new cluster ID: 7b59171461d3429eb82fe279c8b8462c
I20240503 08:02:01.162168 14807 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240503 08:02:01.169901 14807 catalog_manager.cc:1370] Generated new certificate authority record
I20240503 08:02:01.171028 14807 catalog_manager.cc:1504] Loading token signing keys...
I20240503 08:02:01.182293 14807 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07: Generated new TSK 0
I20240503 08:02:01.183035 14807 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240503 08:02:01.190382 14718 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9G1ywP/build/debug/bin/kudu
/tmp/dist-test-task9G1ywP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.95.129:0
--local_ip_for_outbound_sockets=127.14.95.129
--webserver_interface=127.14.95.129
--webserver_port=0
--tserver_master_addrs=127.14.95.190:40839
--builtin_ntp_servers=127.14.95.148:35399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240503 08:02:01.303454 14817 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:02:01.303826 14817 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:02:01.303932 14817 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:02:01.307376 14817 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:02:01.307523 14817 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.95.129
I20240503 08:02:01.311699 14817 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.95.148:35399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.95.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.95.129
--webserver_port=0
--tserver_master_addrs=127.14.95.190:40839
--never_fsync=true
--heap_profile_path=/tmp/kudu.14817
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.95.129
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type DEBUG
built by None at 03 May 2024 07:43:15 UTC on 1a15035a6830
build id 101
I20240503 08:02:01.312724 14817 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:02:01.313972 14817 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:02:01.323285 14822 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:01.323796 14825 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:01.324525 14823 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:02:01.325421 14817 server_base.cc:1034] running on GCE node
I20240503 08:02:01.325891 14817 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:02:01.326570 14817 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:02:01.327764 14817 hybrid_clock.cc:648] HybridClock initialized: now 1714723321327750 us; error 29 us; skew 500 ppm
I20240503 08:02:01.329981 14817 webserver.cc:460] Webserver started at http://127.14.95.129:33667/ using document root <none> and password file <none>
I20240503 08:02:01.330637 14817 fs_manager.cc:359] Metadata directory not provided
I20240503 08:02:01.330705 14817 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:02:01.330893 14817 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:02:01.332664 14817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/data/instance:
uuid: "03f536fd5f2147749df1ac552c1b6540"
format_stamp: "Formatted at 2024-05-03 08:02:01 on dist-test-slave-0z1c"
I20240503 08:02:01.333215 14817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/wal/instance:
uuid: "03f536fd5f2147749df1ac552c1b6540"
format_stamp: "Formatted at 2024-05-03 08:02:01 on dist-test-slave-0z1c"
I20240503 08:02:01.336944 14817 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20240503 08:02:01.339380 14831 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:01.340540 14817 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20240503 08:02:01.340679 14817 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/data,/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/wal
uuid: "03f536fd5f2147749df1ac552c1b6540"
format_stamp: "Formatted at 2024-05-03 08:02:01 on dist-test-slave-0z1c"
I20240503 08:02:01.340798 14817 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:02:01.357188 14817 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:02:01.357864 14817 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:02:01.358029 14817 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:02:01.358577 14817 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:02:01.359512 14817 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:02:01.359561 14817 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:01.359614 14817 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:02:01.359642 14817 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:01.368129 14817 rpc_server.cc:307] RPC server started. Bound to: 127.14.95.129:33541
I20240503 08:02:01.368150 14944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.95.129:33541 every 8 connection(s)
I20240503 08:02:01.369163 14817 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/data/info.pb
I20240503 08:02:01.376372 14718 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9G1ywP/build/debug/bin/kudu as pid 14817
I20240503 08:02:01.376477 14718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/wal/instance
I20240503 08:02:01.378681 14945 heartbeater.cc:347] Connected to a master server at 127.14.95.190:40839
I20240503 08:02:01.378901 14718 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9G1ywP/build/debug/bin/kudu
/tmp/dist-test-task9G1ywP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.95.130:0
--local_ip_for_outbound_sockets=127.14.95.130
--webserver_interface=127.14.95.130
--webserver_port=0
--tserver_master_addrs=127.14.95.190:40839
--builtin_ntp_servers=127.14.95.148:35399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240503 08:02:01.378952 14945 heartbeater.cc:464] Registering TS with master...
I20240503 08:02:01.379524 14945 heartbeater.cc:511] Master 127.14.95.190:40839 requested a full tablet report, sending...
I20240503 08:02:01.381130 14756 ts_manager.cc:194] Registered new tserver with Master: 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:01.382814 14756 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.95.129:48295
W20240503 08:02:01.490733 14948 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:02:01.490996 14948 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:02:01.491041 14948 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:02:01.494257 14948 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:02:01.494381 14948 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.95.130
I20240503 08:02:01.498212 14948 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.95.148:35399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.95.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.95.130
--webserver_port=0
--tserver_master_addrs=127.14.95.190:40839
--never_fsync=true
--heap_profile_path=/tmp/kudu.14948
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.95.130
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type DEBUG
built by None at 03 May 2024 07:43:15 UTC on 1a15035a6830
build id 101
I20240503 08:02:01.499176 14948 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:02:01.500346 14948 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:02:01.509595 14956 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:01.510295 14953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:01.510917 14954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:02:01.511632 14948 server_base.cc:1034] running on GCE node
I20240503 08:02:01.512099 14948 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:02:01.512724 14948 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:02:01.513911 14948 hybrid_clock.cc:648] HybridClock initialized: now 1714723321513881 us; error 47 us; skew 500 ppm
I20240503 08:02:01.516072 14948 webserver.cc:460] Webserver started at http://127.14.95.130:34073/ using document root <none> and password file <none>
I20240503 08:02:01.516685 14948 fs_manager.cc:359] Metadata directory not provided
I20240503 08:02:01.516749 14948 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:02:01.516943 14948 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:02:01.518780 14948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data/instance:
uuid: "697b9bd2e5354e849f4672797bda960d"
format_stamp: "Formatted at 2024-05-03 08:02:01 on dist-test-slave-0z1c"
I20240503 08:02:01.519292 14948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/wal/instance:
uuid: "697b9bd2e5354e849f4672797bda960d"
format_stamp: "Formatted at 2024-05-03 08:02:01 on dist-test-slave-0z1c"
I20240503 08:02:01.523036 14948 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20240503 08:02:01.525655 14962 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:01.526857 14948 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240503 08:02:01.526981 14948 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data,/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/wal
uuid: "697b9bd2e5354e849f4672797bda960d"
format_stamp: "Formatted at 2024-05-03 08:02:01 on dist-test-slave-0z1c"
I20240503 08:02:01.527093 14948 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:02:01.538369 14948 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:02:01.539033 14948 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:02:01.539197 14948 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:02:01.539789 14948 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:02:01.540745 14948 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:02:01.540793 14948 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:01.540834 14948 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:02:01.540848 14948 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:01.549682 14948 rpc_server.cc:307] RPC server started. Bound to: 127.14.95.130:34223
I20240503 08:02:01.549695 15075 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.95.130:34223 every 8 connection(s)
I20240503 08:02:01.550829 14948 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data/info.pb
I20240503 08:02:01.555066 14718 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9G1ywP/build/debug/bin/kudu as pid 14948
I20240503 08:02:01.555239 14718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/wal/instance
I20240503 08:02:01.560689 15076 heartbeater.cc:347] Connected to a master server at 127.14.95.190:40839
I20240503 08:02:01.560951 15076 heartbeater.cc:464] Registering TS with master...
I20240503 08:02:01.561553 15076 heartbeater.cc:511] Master 127.14.95.190:40839 requested a full tablet report, sending...
I20240503 08:02:01.562585 14756 ts_manager.cc:194] Registered new tserver with Master: 697b9bd2e5354e849f4672797bda960d (127.14.95.130:34223)
I20240503 08:02:01.563159 14756 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.95.130:59275
I20240503 08:02:01.570446 14718 external_mini_cluster.cc:930] 2 TS(s) registered with all masters
I20240503 08:02:01.580806 14718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9G1ywP/build/debug/bin/kudu with pid 14948
I20240503 08:02:01.587929 14718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9G1ywP/build/debug/bin/kudu with pid 14726
I20240503 08:02:01.594730 14718 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9G1ywP/build/debug/bin/kudu
/tmp/dist-test-task9G1ywP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.95.190:40839
--webserver_interface=127.14.95.190
--webserver_port=37953
--builtin_ntp_servers=127.14.95.148:35399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.95.190:40839
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240503 08:02:01.708144 15084 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:02:01.708418 15084 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:02:01.708460 15084 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:02:01.711685 15084 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240503 08:02:01.711764 15084 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:02:01.711784 15084 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240503 08:02:01.711802 15084 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240503 08:02:01.715713 15084 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.95.148:35399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.14.95.190:40839
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.95.190:40839
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.95.190
--webserver_port=37953
--never_fsync=true
--heap_profile_path=/tmp/kudu.15084
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type DEBUG
built by None at 03 May 2024 07:43:15 UTC on 1a15035a6830
build id 101
I20240503 08:02:01.716739 15084 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:02:01.717972 15084 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:02:01.725870 15092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:01.726356 15090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:01.727270 15089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:02:01.728029 15084 server_base.cc:1034] running on GCE node
I20240503 08:02:01.728595 15084 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:02:01.729661 15084 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:02:01.730829 15084 hybrid_clock.cc:648] HybridClock initialized: now 1714723321730797 us; error 51 us; skew 500 ppm
I20240503 08:02:01.732929 15084 webserver.cc:460] Webserver started at http://127.14.95.190:37953/ using document root <none> and password file <none>
I20240503 08:02:01.733528 15084 fs_manager.cc:359] Metadata directory not provided
I20240503 08:02:01.733604 15084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:02:01.737349 15084 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20240503 08:02:01.739477 15098 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:01.740600 15084 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240503 08:02:01.740726 15084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/master-0/data,/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/master-0/wal
uuid: "4325972c2cc14fa68b337310e9f45a07"
format_stamp: "Formatted at 2024-05-03 08:02:01 on dist-test-slave-0z1c"
I20240503 08:02:01.741212 15084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:02:01.753331 15084 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:02:01.754017 15084 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:02:01.754179 15084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:02:01.760680 15084 rpc_server.cc:307] RPC server started. Bound to: 127.14.95.190:40839
I20240503 08:02:01.760676 15150 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.95.190:40839 every 8 connection(s)
I20240503 08:02:01.761830 15084 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/master-0/data/info.pb
I20240503 08:02:01.766088 15151 sys_catalog.cc:263] Verifying existing consensus state
I20240503 08:02:01.767724 15151 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07: Bootstrap starting.
I20240503 08:02:01.770661 14718 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9G1ywP/build/debug/bin/kudu as pid 15084
I20240503 08:02:01.781941 15151 log.cc:824] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07: Log is configured to *not* fsync() on all Append() calls
I20240503 08:02:01.788302 15151 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:02:01.788704 15151 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07: Bootstrap complete.
I20240503 08:02:01.792208 15151 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4325972c2cc14fa68b337310e9f45a07" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 40839 } }
I20240503 08:02:01.792690 15151 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4325972c2cc14fa68b337310e9f45a07, State: Initialized, Role: FOLLOWER
I20240503 08:02:01.793165 15151 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4325972c2cc14fa68b337310e9f45a07" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 40839 } }
I20240503 08:02:01.793308 15151 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:01.793371 15151 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:01.793484 15151 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:02:01.795162 15151 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4325972c2cc14fa68b337310e9f45a07" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 40839 } }
I20240503 08:02:01.795509 15151 leader_election.cc:302] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4325972c2cc14fa68b337310e9f45a07; no voters:
I20240503 08:02:01.795797 15151 leader_election.cc:288] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:02:01.795938 15156 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:02:01.796139 15156 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07 [term 2 LEADER]: Becoming Leader. State: Replica: 4325972c2cc14fa68b337310e9f45a07, State: Running, Role: LEADER
I20240503 08:02:01.796447 15156 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4325972c2cc14fa68b337310e9f45a07" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 40839 } }
I20240503 08:02:01.796896 15151 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07 [sys.catalog]: configured and running, proceeding with master startup.
I20240503 08:02:01.797869 15157 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "4325972c2cc14fa68b337310e9f45a07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4325972c2cc14fa68b337310e9f45a07" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 40839 } } }
I20240503 08:02:01.797986 15157 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07 [sys.catalog]: This master's current role is: LEADER
I20240503 08:02:01.798235 15158 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4325972c2cc14fa68b337310e9f45a07. Latest consensus state: current_term: 2 leader_uuid: "4325972c2cc14fa68b337310e9f45a07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4325972c2cc14fa68b337310e9f45a07" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 40839 } } }
I20240503 08:02:01.798311 15158 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07 [sys.catalog]: This master's current role is: LEADER
I20240503 08:02:01.798556 15165 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240503 08:02:01.801237 15165 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240503 08:02:01.801941 15165 catalog_manager.cc:1259] Loaded cluster ID: 7b59171461d3429eb82fe279c8b8462c
I20240503 08:02:01.801993 15165 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240503 08:02:01.803753 15165 catalog_manager.cc:1504] Loading token signing keys...
I20240503 08:02:01.804394 15165 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4325972c2cc14fa68b337310e9f45a07: Loaded TSK: 0
I20240503 08:02:01.805624 15165 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240503 08:02:02.385529 14945 heartbeater.cc:503] Master 127.14.95.190:40839 was elected leader, sending a full tablet report...
I20240503 08:02:02.390444 15115 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "03f536fd5f2147749df1ac552c1b6540" instance_seqno: 1714723321365691) as {username='slave'} at 127.14.95.129:47997; Asking this server to re-register.
I20240503 08:02:02.391076 14945 heartbeater.cc:464] Registering TS with master...
I20240503 08:02:02.391259 14945 heartbeater.cc:511] Master 127.14.95.190:40839 requested a full tablet report, sending...
I20240503 08:02:02.392227 15115 ts_manager.cc:194] Registered new tserver with Master: 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:02.402459 14718 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20240503 08:02:02.402606 14718 test_util.cc:268] Using random seed: 579147562
I20240503 08:02:02.415926 15115 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42246:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20240503 08:02:02.432899 14879 tablet_service.cc:1467] Processing CreateTablet for tablet e89b17bb69564679a7cf9f2fcbec5bd8 (DEFAULT_TABLE table=test-workload [id=4dc7b76d74474aab9ca25c22e8f2d146]), partition=RANGE (key) PARTITION UNBOUNDED
I20240503 08:02:02.433847 14879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e89b17bb69564679a7cf9f2fcbec5bd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:02.439150 15186 tablet_bootstrap.cc:492] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540: Bootstrap starting.
I20240503 08:02:02.441138 15186 tablet_bootstrap.cc:654] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540: Neither blocks nor log segments found. Creating new log.
I20240503 08:02:02.441846 15186 log.cc:824] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540: Log is configured to *not* fsync() on all Append() calls
I20240503 08:02:02.443475 15186 tablet_bootstrap.cc:492] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540: No bootstrap required, opened a new log
I20240503 08:02:02.443650 15186 ts_tablet_manager.cc:1367] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20240503 08:02:02.446799 15186 raft_consensus.cc:348] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f536fd5f2147749df1ac552c1b6540" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33541 } }
I20240503 08:02:02.447019 15186 raft_consensus.cc:374] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:02:02.447068 15186 raft_consensus.cc:729] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03f536fd5f2147749df1ac552c1b6540, State: Initialized, Role: FOLLOWER
I20240503 08:02:02.447500 15186 consensus_queue.cc:260] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f536fd5f2147749df1ac552c1b6540" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33541 } }
I20240503 08:02:02.447643 15186 raft_consensus.cc:388] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:02.447706 15186 raft_consensus.cc:482] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:02.447810 15186 raft_consensus.cc:3037] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:02:02.448632 15186 raft_consensus.cc:504] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f536fd5f2147749df1ac552c1b6540" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33541 } }
I20240503 08:02:02.448971 15186 leader_election.cc:302] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 03f536fd5f2147749df1ac552c1b6540; no voters:
I20240503 08:02:02.449330 15186 leader_election.cc:288] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:02:02.449437 15188 raft_consensus.cc:2781] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:02:02.449609 15188 raft_consensus.cc:686] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [term 1 LEADER]: Becoming Leader. State: Replica: 03f536fd5f2147749df1ac552c1b6540, State: Running, Role: LEADER
I20240503 08:02:02.449906 15188 consensus_queue.cc:237] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f536fd5f2147749df1ac552c1b6540" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33541 } }
I20240503 08:02:02.450237 15186 ts_tablet_manager.cc:1398] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20240503 08:02:02.453338 15115 catalog_manager.cc:5484] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 reported cstate change: term changed from 0 to 1, leader changed from <none> to 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129). New cstate: current_term: 1 leader_uuid: "03f536fd5f2147749df1ac552c1b6540" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f536fd5f2147749df1ac552c1b6540" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33541 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:02.855110 14718 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9G1ywP/build/debug/bin/kudu
/tmp/dist-test-task9G1ywP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.95.130:34223
--local_ip_for_outbound_sockets=127.14.95.130
--tserver_master_addrs=127.14.95.190:40839
--webserver_port=34073
--webserver_interface=127.14.95.130
--builtin_ntp_servers=127.14.95.148:35399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240503 08:02:02.963109 15203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:02:02.963361 15203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:02:02.963404 15203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:02:02.966569 15203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:02:02.966694 15203 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.95.130
I20240503 08:02:02.970525 15203 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.95.148:35399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.95.130:34223
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.95.130
--webserver_port=34073
--tserver_master_addrs=127.14.95.190:40839
--never_fsync=true
--heap_profile_path=/tmp/kudu.15203
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.95.130
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type DEBUG
built by None at 03 May 2024 07:43:15 UTC on 1a15035a6830
build id 101
I20240503 08:02:02.971463 15203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:02:02.972620 15203 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:02:02.981521 15209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:02.982038 15211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:02.983170 15208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:02:02.984031 15203 server_base.cc:1034] running on GCE node
I20240503 08:02:02.984511 15203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:02:02.985280 15203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:02:02.986466 15203 hybrid_clock.cc:648] HybridClock initialized: now 1714723322986444 us; error 45 us; skew 500 ppm
I20240503 08:02:02.988492 15203 webserver.cc:460] Webserver started at http://127.14.95.130:34073/ using document root <none> and password file <none>
I20240503 08:02:02.989123 15203 fs_manager.cc:359] Metadata directory not provided
I20240503 08:02:02.989212 15203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:02:02.992789 15203 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20240503 08:02:02.995076 15217 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:02.996270 15203 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240503 08:02:02.996398 15203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data,/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/wal
uuid: "697b9bd2e5354e849f4672797bda960d"
format_stamp: "Formatted at 2024-05-03 08:02:01 on dist-test-slave-0z1c"
I20240503 08:02:02.996925 15203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:02:03.030436 15203 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:02:03.031054 15203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:02:03.031216 15203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:02:03.031761 15203 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:02:03.032656 15203 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:02:03.032703 15203 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:03.032742 15203 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:02:03.032757 15203 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:03.041157 15203 rpc_server.cc:307] RPC server started. Bound to: 127.14.95.130:34223
I20240503 08:02:03.041193 15330 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.95.130:34223 every 8 connection(s)
I20240503 08:02:03.042256 15203 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data/info.pb
I20240503 08:02:03.051251 14718 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9G1ywP/build/debug/bin/kudu as pid 15203
I20240503 08:02:03.051862 15331 heartbeater.cc:347] Connected to a master server at 127.14.95.190:40839
I20240503 08:02:03.052106 15331 heartbeater.cc:464] Registering TS with master...
I20240503 08:02:03.052830 15331 heartbeater.cc:511] Master 127.14.95.190:40839 requested a full tablet report, sending...
I20240503 08:02:03.053638 14718 tablet_copy_client_session-itest.cc:139] Starting loop 0
I20240503 08:02:03.053705 14718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9G1ywP/build/debug/bin/kudu with pid 14817
I20240503 08:02:03.053934 15115 ts_manager.cc:194] Registered new tserver with Master: 697b9bd2e5354e849f4672797bda960d (127.14.95.130:34223)
I20240503 08:02:03.054970 15115 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.95.130:55349
I20240503 08:02:03.060289 14718 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9G1ywP/build/debug/bin/kudu
/tmp/dist-test-task9G1ywP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.95.129:33541
--local_ip_for_outbound_sockets=127.14.95.129
--tserver_master_addrs=127.14.95.190:40839
--webserver_port=33667
--webserver_interface=127.14.95.129
--builtin_ntp_servers=127.14.95.148:35399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240503 08:02:03.068665 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.069505 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.100344 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.100878 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.104025 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.104486 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.119841 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.120319 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.132092 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.132603 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.133812 15342 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.134271 15342 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.139516 15342 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.139947 15342 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.148068 15342 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.148620 15342 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.154500 15342 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.154960 15342 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.160712 15342 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.161202 15342 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.172574 15342 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.173162 15342 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.177692 15342 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.178154 15342 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
W20240503 08:02:03.178270 15340 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:02:03.178539 15340 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:02:03.178617 15340 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20240503 08:02:03.181368 15342 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.181793 15342 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
W20240503 08:02:03.182456 15340 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:02:03.182592 15340 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.95.129
I20240503 08:02:03.186740 15340 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.95.148:35399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.95.129:33541
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.95.129
--webserver_port=33667
--tserver_master_addrs=127.14.95.190:40839
--never_fsync=true
--heap_profile_path=/tmp/kudu.15340
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.95.129
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type DEBUG
built by None at 03 May 2024 07:43:15 UTC on 1a15035a6830
build id 101
I20240503 08:02:03.187680 15340 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:02:03.188807 15340 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20240503 08:02:03.191615 15342 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.192072 15342 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
W20240503 08:02:03.198526 15406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:03.199314 15405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:03.199940 15408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:02:03.200934 15340 server_base.cc:1034] running on GCE node
I20240503 08:02:03.201488 15340 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:02:03.201731 15342 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.202190 15342 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.202345 15340 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:02:03.203523 15340 hybrid_clock.cc:648] HybridClock initialized: now 1714723323203505 us; error 30 us; skew 500 ppm
I20240503 08:02:03.205547 15340 webserver.cc:460] Webserver started at http://127.14.95.129:33667/ using document root <none> and password file <none>
I20240503 08:02:03.206123 15340 fs_manager.cc:359] Metadata directory not provided
I20240503 08:02:03.206197 15340 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:02:03.209838 15340 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20240503 08:02:03.211937 15418 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:03.213109 15340 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240503 08:02:03.213346 15342 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.213234 15340 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/data,/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/wal
uuid: "03f536fd5f2147749df1ac552c1b6540"
format_stamp: "Formatted at 2024-05-03 08:02:01 on dist-test-slave-0z1c"
I20240503 08:02:03.213761 15342 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.213716 15340 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:02:03.215480 15342 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.215898 15342 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.219643 15342 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.220052 15342 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.222501 15342 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.222893 15342 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.232136 15340 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:02:03.232762 15340 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:02:03.232918 15340 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:02:03.233515 15340 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:02:03.234735 15441 ts_tablet_manager.cc:516] Loading tablet metadata (0/1 complete)
I20240503 08:02:03.237525 15342 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.237947 15342 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.238261 15340 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240503 08:02:03.238318 15340 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20240503 08:02:03.238379 15340 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240503 08:02:03.239974 15340 ts_tablet_manager.cc:590] Registered 1 tablets
I20240503 08:02:03.240023 15340 ts_tablet_manager.cc:569] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20240503 08:02:03.240264 15441 tablet_bootstrap.cc:492] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540: Bootstrap starting.
I20240503 08:02:03.240918 15342 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.241343 15342 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.243479 15342 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.243829 15342 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.249130 15342 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.249586 15342 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.250726 15340 rpc_server.cc:307] RPC server started. Bound to: 127.14.95.129:33541
I20240503 08:02:03.252007 15340 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/data/info.pb
I20240503 08:02:03.253266 15564 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.95.129:33541 every 8 connection(s)
I20240503 08:02:03.256665 14718 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9G1ywP/build/debug/bin/kudu as pid 15340
I20240503 08:02:03.259137 15342 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.259631 15342 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.261047 15565 heartbeater.cc:347] Connected to a master server at 127.14.95.190:40839
I20240503 08:02:03.261317 15565 heartbeater.cc:464] Registering TS with master...
I20240503 08:02:03.261997 15565 heartbeater.cc:511] Master 127.14.95.190:40839 requested a full tablet report, sending...
I20240503 08:02:03.264216 15115 ts_manager.cc:194] Re-registered known tserver with Master: 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.265105 15115 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.95.129:35883
I20240503 08:02:03.270887 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.271041 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.271632 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.274346 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.274812 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.275314 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.275406 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.275501 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.277635 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.277873 15441 log.cc:824] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540: Log is configured to *not* fsync() on all Append() calls
I20240503 08:02:03.278069 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.278499 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.278597 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.278692 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.305457 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.305943 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.306581 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.306708 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.306807 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.316998 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.317512 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.318181 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.318315 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.318467 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.324561 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.325352 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.325924 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.326035 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.326126 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.334283 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.334764 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.335266 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.335364 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.335438 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.340301 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.340814 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.341399 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.341519 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.341614 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.347805 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.348345 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.348860 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.348978 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.349129 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.360000 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.360467 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.361043 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.361162 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.361264 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.366309 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.366917 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.367385 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.367501 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.367599 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.389672 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.390168 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.390681 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.390801 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.390899 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.397426 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.397935 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.398512 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.398622 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.398712 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.407967 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.408463 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.409129 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.409237 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.409333 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.416301 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.416779 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.417307 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.417435 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.417538 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.422400 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.422878 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.423408 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.423509 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.423604 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.432574 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.433064 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.433552 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.433650 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.433737 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.443316 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.443816 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.444326 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.444427 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.444520 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.446329 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.446771 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.447221 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.447319 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.447407 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.455085 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.455585 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.456118 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.456220 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.456310 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.461568 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.462067 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.462579 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.462684 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.462772 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.476296 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.476758 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.477308 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.477406 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.477495 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.480762 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.481273 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.481765 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.481868 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.481957 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.484774 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.485266 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.485834 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.485940 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.486042 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.506436 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.506904 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.507464 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.507570 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.507655 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.513792 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.514256 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.514778 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.514902 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.514991 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.516615 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.517057 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.517525 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.517630 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.517719 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.526516 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.527029 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.527593 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.527710 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.527802 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.535130 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.535620 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.536177 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.536294 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.536391 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.540096 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.540553 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.541065 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.541175 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.541266 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.549857 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.550379 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.550944 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.551081 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.551182 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.552160 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.552575 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.553097 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.553206 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.553295 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.562556 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.563067 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.563597 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.563711 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.563803 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.577651 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.578164 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.578752 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.578872 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.578961 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.586694 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.587208 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.587718 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.587829 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.587919 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.593348 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.593837 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.594372 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.594499 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.594591 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.600490 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.600971 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.601516 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.601619 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:03.601706 15535 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48903: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:03.603958 15441 tablet_bootstrap.cc:492] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540: Bootstrap replayed 1/1 log segments. Stats: ops{read=209 overwritten=0 applied=209 ignored=0} inserts{seen=10400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:02:03.604331 15441 tablet_bootstrap.cc:492] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540: Bootstrap complete.
I20240503 08:02:03.605260 15441 ts_tablet_manager.cc:1367] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540: Time spent bootstrapping tablet: real 0.365s user 0.356s sys 0.008s
I20240503 08:02:03.607545 15441 raft_consensus.cc:348] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f536fd5f2147749df1ac552c1b6540" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33541 } }
I20240503 08:02:03.607898 15441 raft_consensus.cc:729] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03f536fd5f2147749df1ac552c1b6540, State: Initialized, Role: FOLLOWER
I20240503 08:02:03.608381 15441 consensus_queue.cc:260] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 209, Last appended: 1.209, Last appended by leader: 209, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f536fd5f2147749df1ac552c1b6540" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33541 } }
I20240503 08:02:03.608502 15441 raft_consensus.cc:388] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:03.608551 15441 raft_consensus.cc:482] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:03.608654 15441 raft_consensus.cc:3037] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:02:03.610378 15441 raft_consensus.cc:504] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f536fd5f2147749df1ac552c1b6540" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33541 } }
I20240503 08:02:03.610751 15441 leader_election.cc:302] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 03f536fd5f2147749df1ac552c1b6540; no voters:
I20240503 08:02:03.611054 15441 leader_election.cc:288] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:02:03.611275 15718 raft_consensus.cc:2781] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:02:03.611611 15718 raft_consensus.cc:686] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [term 2 LEADER]: Becoming Leader. State: Replica: 03f536fd5f2147749df1ac552c1b6540, State: Running, Role: LEADER
I20240503 08:02:03.611964 15441 ts_tablet_manager.cc:1398] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20240503 08:02:03.612036 15341 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:03.612056 15565 heartbeater.cc:503] Master 127.14.95.190:40839 was elected leader, sending a full tablet report...
I20240503 08:02:03.612474 15341 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:03.612689 15718 consensus_queue.cc:237] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 209, Committed index: 209, Last appended: 1.209, Last appended by leader: 209, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f536fd5f2147749df1ac552c1b6540" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33541 } }
I20240503 08:02:03.613019 15535 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48903)
I20240503 08:02:03.613137 15535 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48903: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
I20240503 08:02:03.614207 15535 tablet_copy_source_session.cc:205] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:02:03.615247 15115 catalog_manager.cc:5484] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "03f536fd5f2147749df1ac552c1b6540" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f536fd5f2147749df1ac552c1b6540" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33541 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:03.617899 15341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e89b17bb69564679a7cf9f2fcbec5bd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:03.624884 15341 tablet_copy_client.cc:783] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Starting download of 0 data blocks...
I20240503 08:02:03.625155 15341 tablet_copy_client.cc:647] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Starting download of 1 WAL segments...
I20240503 08:02:03.629582 15341 tablet_copy_client.cc:523] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:02:03.631327 15341 tablet_bootstrap.cc:492] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Bootstrap starting.
I20240503 08:02:03.653178 15341 log.cc:824] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Log is configured to *not* fsync() on all Append() calls
I20240503 08:02:03.991784 15341 tablet_bootstrap.cc:492] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Bootstrap replayed 1/1 log segments. Stats: ops{read=210 overwritten=0 applied=209 ignored=0} inserts{seen=10400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20240503 08:02:03.992201 15341 tablet_bootstrap.cc:492] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Bootstrap complete.
I20240503 08:02:03.992583 15341 ts_tablet_manager.cc:1367] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Time spent bootstrapping tablet: real 0.361s user 0.359s sys 0.000s
I20240503 08:02:03.995565 15341 raft_consensus.cc:348] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d [term 2 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f536fd5f2147749df1ac552c1b6540" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33541 } }
I20240503 08:02:03.995961 15341 raft_consensus.cc:729] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 697b9bd2e5354e849f4672797bda960d, State: Initialized, Role: NON_PARTICIPANT
I20240503 08:02:03.996320 15341 consensus_queue.cc:260] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 209, Last appended: 2.210, Last appended by leader: 210, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f536fd5f2147749df1ac552c1b6540" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33541 } }
I20240503 08:02:03.996986 15331 heartbeater.cc:503] Master 127.14.95.190:40839 was elected leader, sending a full tablet report...
I20240503 08:02:03.997296 15341 ts_tablet_manager.cc:1398] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Time spent starting tablet: real 0.005s user 0.008s sys 0.000s
I20240503 08:02:03.998148 15535 tablet_copy_service.cc:342] P 03f536fd5f2147749df1ac552c1b6540: Request end of tablet copy session 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8 received from {username='slave'} at 127.14.95.130:48903
I20240503 08:02:03.998275 15535 tablet_copy_service.cc:433] P 03f536fd5f2147749df1ac552c1b6540: ending tablet copy session 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8 on tablet e89b17bb69564679a7cf9f2fcbec5bd8 with peer 697b9bd2e5354e849f4672797bda960d
W20240503 08:02:04.012044 15341 ts_tablet_manager.cc:701] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Tablet Copy: Invalid argument: Leader has replica of tablet e89b17bb69564679a7cf9f2fcbec5bd8 with term 0, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20240503 08:02:04.027019 15341 ts_tablet_manager.cc:701] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Tablet Copy: Invalid argument: Leader has replica of tablet e89b17bb69564679a7cf9f2fcbec5bd8 with term 0, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
I20240503 08:02:04.029418 15265 tablet_service.cc:1514] Processing DeleteTablet for tablet e89b17bb69564679a7cf9f2fcbec5bd8 with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:40894
I20240503 08:02:04.029904 15734 tablet_replica.cc:330] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: stopping tablet replica
I20240503 08:02:04.030218 15734 raft_consensus.cc:2229] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d [term 2 NON_PARTICIPANT]: Raft consensus shutting down.
I20240503 08:02:04.030443 15734 pending_rounds.cc:62] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Trying to abort 1 pending ops.
I20240503 08:02:04.030512 15734 pending_rounds.cc:68] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Aborting op as it isn't in flight: id { term: 2 index: 210 } timestamp: 7023506733518286848 op_type: NO_OP noop_request { }
I20240503 08:02:04.030660 15734 raft_consensus.cc:2866] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d [term 2 NON_PARTICIPANT]: NO_OP replication failed: Aborted: Op aborted
I20240503 08:02:04.030740 15734 raft_consensus.cc:2258] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d [term 2 NON_PARTICIPANT]: Raft consensus is shut down!
I20240503 08:02:04.032032 15734 ts_tablet_manager.cc:1875] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20240503 08:02:04.033959 15734 ts_tablet_manager.cc:1888] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.210
I20240503 08:02:04.034040 15734 log.cc:1196] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Deleting WAL directory at /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/wal/wals/e89b17bb69564679a7cf9f2fcbec5bd8
I20240503 08:02:04.034323 15734 ts_tablet_manager.cc:1909] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Deleting consensus metadata
I20240503 08:02:04.035686 14718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9G1ywP/build/debug/bin/kudu with pid 15203
I20240503 08:02:04.041329 14718 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9G1ywP/build/debug/bin/kudu
/tmp/dist-test-task9G1ywP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.95.130:34223
--local_ip_for_outbound_sockets=127.14.95.130
--tserver_master_addrs=127.14.95.190:40839
--webserver_port=34073
--webserver_interface=127.14.95.130
--builtin_ntp_servers=127.14.95.148:35399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240503 08:02:04.152508 15735 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:02:04.152765 15735 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:02:04.152810 15735 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:02:04.156065 15735 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:02:04.156184 15735 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.95.130
I20240503 08:02:04.160081 15735 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.95.148:35399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.95.130:34223
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.95.130
--webserver_port=34073
--tserver_master_addrs=127.14.95.190:40839
--never_fsync=true
--heap_profile_path=/tmp/kudu.15735
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.95.130
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type DEBUG
built by None at 03 May 2024 07:43:15 UTC on 1a15035a6830
build id 101
I20240503 08:02:04.161151 15735 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:02:04.162402 15735 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:02:04.171984 15741 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:04.172729 15743 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:04.173192 15740 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:02:04.173928 15735 server_base.cc:1034] running on GCE node
I20240503 08:02:04.174424 15735 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:02:04.175145 15735 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:02:04.176321 15735 hybrid_clock.cc:648] HybridClock initialized: now 1714723324176300 us; error 39 us; skew 500 ppm
I20240503 08:02:04.178414 15735 webserver.cc:460] Webserver started at http://127.14.95.130:34073/ using document root <none> and password file <none>
I20240503 08:02:04.179001 15735 fs_manager.cc:359] Metadata directory not provided
I20240503 08:02:04.179062 15735 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:02:04.182611 15735 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20240503 08:02:04.184722 15749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:04.185868 15735 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240503 08:02:04.186004 15735 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data,/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/wal
uuid: "697b9bd2e5354e849f4672797bda960d"
format_stamp: "Formatted at 2024-05-03 08:02:01 on dist-test-slave-0z1c"
I20240503 08:02:04.186524 15735 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:02:04.207727 15735 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:02:04.208400 15735 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:02:04.208580 15735 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:02:04.209167 15735 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:02:04.210120 15735 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:02:04.210171 15735 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:04.210227 15735 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:02:04.210253 15735 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:04.219478 15735 rpc_server.cc:307] RPC server started. Bound to: 127.14.95.130:34223
I20240503 08:02:04.219504 15862 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.95.130:34223 every 8 connection(s)
I20240503 08:02:04.220628 15735 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data/info.pb
I20240503 08:02:04.227102 14718 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9G1ywP/build/debug/bin/kudu as pid 15735
I20240503 08:02:04.227242 14718 tablet_copy_client_session-itest.cc:139] Starting loop 1
I20240503 08:02:04.227293 14718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9G1ywP/build/debug/bin/kudu with pid 15340
I20240503 08:02:04.232162 15863 heartbeater.cc:347] Connected to a master server at 127.14.95.190:40839
I20240503 08:02:04.232487 15863 heartbeater.cc:464] Registering TS with master...
I20240503 08:02:04.233276 15863 heartbeater.cc:511] Master 127.14.95.190:40839 requested a full tablet report, sending...
I20240503 08:02:04.234249 14718 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9G1ywP/build/debug/bin/kudu
/tmp/dist-test-task9G1ywP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.95.129:33541
--local_ip_for_outbound_sockets=127.14.95.129
--tserver_master_addrs=127.14.95.190:40839
--webserver_port=33667
--webserver_interface=127.14.95.129
--builtin_ntp_servers=127.14.95.148:35399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240503 08:02:04.234583 15115 ts_manager.cc:194] Re-registered known tserver with Master: 697b9bd2e5354e849f4672797bda960d (127.14.95.130:34223)
I20240503 08:02:04.235229 15115 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.95.130:36385
I20240503 08:02:04.241945 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.242872 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.252470 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.252960 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.258138 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.258610 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.261593 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.262007 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.280303 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.280784 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.289685 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.290175 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.296375 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.296837 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.303550 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.304028 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.310781 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.311280 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.312741 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.313187 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.323509 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.324059 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.326915 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.327373 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.342877 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.343348 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.346451 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.346910 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.349795 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.350209 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
W20240503 08:02:04.356263 15873 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:02:04.356520 15873 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:02:04.356566 15873 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20240503 08:02:04.357513 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.358007 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
W20240503 08:02:04.360491 15873 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:02:04.360610 15873 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.95.129
I20240503 08:02:04.361965 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.362443 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.365289 15873 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.95.148:35399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.95.129:33541
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.95.129
--webserver_port=33667
--tserver_master_addrs=127.14.95.190:40839
--never_fsync=true
--heap_profile_path=/tmp/kudu.15873
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.95.129
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type DEBUG
built by None at 03 May 2024 07:43:15 UTC on 1a15035a6830
build id 101
I20240503 08:02:04.365547 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.366024 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.366542 15873 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:02:04.368032 15873 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20240503 08:02:04.368399 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.368789 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
W20240503 08:02:04.377343 15961 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:04.378240 15958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:02:04.378693 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
W20240503 08:02:04.378957 15959 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:02:04.379132 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.379648 15873 server_base.cc:1034] running on GCE node
I20240503 08:02:04.380205 15873 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:02:04.381036 15873 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:02:04.381165 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.381505 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.382228 15873 hybrid_clock.cc:648] HybridClock initialized: now 1714723324382199 us; error 38 us; skew 500 ppm
I20240503 08:02:04.384413 15873 webserver.cc:460] Webserver started at http://127.14.95.129:33667/ using document root <none> and password file <none>
I20240503 08:02:04.385040 15873 fs_manager.cc:359] Metadata directory not provided
I20240503 08:02:04.385116 15873 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:02:04.388720 15873 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20240503 08:02:04.391057 15975 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:04.392408 15873 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20240503 08:02:04.392567 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.392587 15873 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/data,/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/wal
uuid: "03f536fd5f2147749df1ac552c1b6540"
format_stamp: "Formatted at 2024-05-03 08:02:01 on dist-test-slave-0z1c"
I20240503 08:02:04.393049 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.393110 15873 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:02:04.415120 15873 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:02:04.415784 15873 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:02:04.415931 15873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:02:04.416447 15873 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:02:04.417694 15986 ts_tablet_manager.cc:516] Loading tablet metadata (0/1 complete)
I20240503 08:02:04.420090 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.420557 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.421337 15873 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240503 08:02:04.421408 15873 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20240503 08:02:04.421478 15873 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240503 08:02:04.423223 15873 ts_tablet_manager.cc:590] Registered 1 tablets
I20240503 08:02:04.423280 15873 ts_tablet_manager.cc:569] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20240503 08:02:04.423626 15986 tablet_bootstrap.cc:492] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540: Bootstrap starting.
I20240503 08:02:04.428885 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.429340 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.432749 15873 rpc_server.cc:307] RPC server started. Bound to: 127.14.95.129:33541
I20240503 08:02:04.432780 16101 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.95.129:33541 every 8 connection(s)
I20240503 08:02:04.433986 15873 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/data/info.pb
I20240503 08:02:04.434928 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.435370 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.441327 14718 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9G1ywP/build/debug/bin/kudu as pid 15873
I20240503 08:02:04.444221 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.444463 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
I20240503 08:02:04.444748 16102 heartbeater.cc:347] Connected to a master server at 127.14.95.190:40839
I20240503 08:02:04.444995 16102 heartbeater.cc:464] Registering TS with master...
W20240503 08:02:04.445139 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.445727 16102 heartbeater.cc:511] Master 127.14.95.190:40839 requested a full tablet report, sending...
I20240503 08:02:04.447678 15115 ts_manager.cc:194] Re-registered known tserver with Master: 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.448607 15115 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.95.129:33929
I20240503 08:02:04.452606 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.453181 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.453650 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.453752 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.453842 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.463043 15986 log.cc:824] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540: Log is configured to *not* fsync() on all Append() calls
I20240503 08:02:04.464051 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.464529 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.465142 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.465265 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.465370 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.468040 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.468493 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.468945 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.469072 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.469188 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.478937 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.479403 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.479899 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.480000 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.480075 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.502578 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.503070 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.503659 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.503769 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.503865 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.506400 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.506919 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.507391 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.507504 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.507606 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.509042 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.509465 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.509891 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.509996 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.510088 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.518479 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.519038 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.519565 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.519685 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.519778 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.541954 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.542472 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.542966 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.543077 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.543174 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.544654 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.545083 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.545567 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.545671 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.545765 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.549758 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.550218 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.550719 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.550835 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.550931 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.556038 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.556480 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.556979 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.557122 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.557222 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.566509 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.567068 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.567765 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.567886 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.567987 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.570079 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.570531 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.571000 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.571098 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.571187 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.580881 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.581462 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.582095 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.582198 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.582288 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.596117 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.596618 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.597232 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.597365 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.597466 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.601821 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.602290 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.602842 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.602972 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.603061 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.622443 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.622947 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.623487 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.623608 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.623703 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.625216 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.625641 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.626102 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.626204 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.626296 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.630939 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.631398 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.631894 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.631996 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.632086 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.646317 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.646854 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.647495 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.647601 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.647696 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.655110 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.655597 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.656080 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.656193 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.656318 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.659294 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.659754 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.660238 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.660342 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.660434 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.662369 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.662817 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.663269 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.663379 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.663471 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.671429 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.671947 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.672521 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.672631 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.672776 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.675093 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.675503 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.675904 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.675988 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.676070 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.678540 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.678927 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.679344 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.679430 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.679513 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.699793 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.700326 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.700896 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.701036 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.701131 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.707784 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.708281 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.708782 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.708886 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.708978 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.723155 15875 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.723611 15875 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.724119 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.724216 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.724290 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.725299 15874 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.725750 15874 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.726172 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.726279 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.726363 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.730353 15874 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.730841 15874 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.731287 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.731384 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.731473 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.733335 15874 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.733762 15874 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.734223 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.734337 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.734429 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.741483 15874 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.741955 15874 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.742489 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.742760 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.742880 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.756770 15874 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.757335 15874 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.757930 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.758061 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.758155 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.760462 15874 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.765429 15874 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.766075 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.766196 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.766290 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.772054 15874 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.772533 15874 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.773138 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.773252 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.773353 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.779338 15874 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.779877 15874 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.780455 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.780570 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.780660 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.783895 15874 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.784368 15874 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.784886 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.784994 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.785138 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.789433 15874 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.789980 15874 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.790514 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.790637 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.790732 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.796015 15986 tablet_bootstrap.cc:492] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540: Bootstrap replayed 1/1 log segments. Stats: ops{read=210 overwritten=0 applied=210 ignored=0} inserts{seen=10400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:02:04.796466 15986 tablet_bootstrap.cc:492] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540: Bootstrap complete.
I20240503 08:02:04.797492 15986 ts_tablet_manager.cc:1367] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540: Time spent bootstrapping tablet: real 0.374s user 0.343s sys 0.028s
I20240503 08:02:04.799824 15986 raft_consensus.cc:348] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f536fd5f2147749df1ac552c1b6540" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33541 } }
I20240503 08:02:04.800221 15986 raft_consensus.cc:729] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03f536fd5f2147749df1ac552c1b6540, State: Initialized, Role: FOLLOWER
I20240503 08:02:04.800714 15986 consensus_queue.cc:260] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 210, Last appended: 2.210, Last appended by leader: 210, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f536fd5f2147749df1ac552c1b6540" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33541 } }
I20240503 08:02:04.800844 15986 raft_consensus.cc:388] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:04.800911 15986 raft_consensus.cc:482] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:04.801051 15986 raft_consensus.cc:3037] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:02:04.802307 15874 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.802774 15874 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.803165 15986 raft_consensus.cc:504] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f536fd5f2147749df1ac552c1b6540" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33541 } }
I20240503 08:02:04.803308 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.803400 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:04.803486 16056 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:43467: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:04.803553 15986 leader_election.cc:302] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 03f536fd5f2147749df1ac552c1b6540; no voters:
I20240503 08:02:04.803881 15986 leader_election.cc:288] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [CANDIDATE]: Term 3 election: Requested vote from peers
I20240503 08:02:04.803974 16275 raft_consensus.cc:2781] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [term 3 FOLLOWER]: Leader election won for term 3
I20240503 08:02:04.804333 16275 raft_consensus.cc:686] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [term 3 LEADER]: Becoming Leader. State: Replica: 03f536fd5f2147749df1ac552c1b6540, State: Running, Role: LEADER
I20240503 08:02:04.804701 16275 consensus_queue.cc:237] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 210, Committed index: 210, Last appended: 2.210, Last appended by leader: 210, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f536fd5f2147749df1ac552c1b6540" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33541 } }
I20240503 08:02:04.804797 15986 ts_tablet_manager.cc:1398] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540: Time spent starting tablet: real 0.007s user 0.003s sys 0.004s
I20240503 08:02:04.805160 16102 heartbeater.cc:503] Master 127.14.95.190:40839 was elected leader, sending a full tablet report...
I20240503 08:02:04.807112 15115 catalog_manager.cc:5484] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 reported cstate change: term changed from 2 to 3. New cstate: current_term: 3 leader_uuid: "03f536fd5f2147749df1ac552c1b6540" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f536fd5f2147749df1ac552c1b6540" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33541 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:04.811697 15874 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:04.812132 15874 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:04.812719 16056 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:43467)
I20240503 08:02:04.812821 16056 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:43467: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
I20240503 08:02:04.814043 16056 tablet_copy_source_session.cc:205] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:02:04.817680 15874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e89b17bb69564679a7cf9f2fcbec5bd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:04.823562 15874 tablet_copy_client.cc:783] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Starting download of 0 data blocks...
I20240503 08:02:04.823817 15874 tablet_copy_client.cc:647] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Starting download of 1 WAL segments...
I20240503 08:02:04.828131 15874 tablet_copy_client.cc:523] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:02:04.830075 15874 tablet_bootstrap.cc:492] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Bootstrap starting.
I20240503 08:02:04.853310 15874 log.cc:824] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Log is configured to *not* fsync() on all Append() calls
I20240503 08:02:05.166313 15874 tablet_bootstrap.cc:492] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Bootstrap replayed 1/1 log segments. Stats: ops{read=211 overwritten=0 applied=211 ignored=0} inserts{seen=10400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:02:05.166713 15874 tablet_bootstrap.cc:492] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Bootstrap complete.
I20240503 08:02:05.167093 15874 ts_tablet_manager.cc:1367] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Time spent bootstrapping tablet: real 0.337s user 0.329s sys 0.007s
I20240503 08:02:05.169687 15874 raft_consensus.cc:348] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d [term 3 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f536fd5f2147749df1ac552c1b6540" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33541 } }
I20240503 08:02:05.169914 15874 raft_consensus.cc:729] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d [term 3 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 697b9bd2e5354e849f4672797bda960d, State: Initialized, Role: NON_PARTICIPANT
I20240503 08:02:05.170236 15874 consensus_queue.cc:260] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 211, Last appended: 3.211, Last appended by leader: 211, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f536fd5f2147749df1ac552c1b6540" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33541 } }
I20240503 08:02:05.170951 15863 heartbeater.cc:503] Master 127.14.95.190:40839 was elected leader, sending a full tablet report...
I20240503 08:02:05.171038 15874 ts_tablet_manager.cc:1398] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20240503 08:02:05.171823 16056 tablet_copy_service.cc:342] P 03f536fd5f2147749df1ac552c1b6540: Request end of tablet copy session 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8 received from {username='slave'} at 127.14.95.130:43467
I20240503 08:02:05.171939 16056 tablet_copy_service.cc:433] P 03f536fd5f2147749df1ac552c1b6540: ending tablet copy session 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8 on tablet e89b17bb69564679a7cf9f2fcbec5bd8 with peer 697b9bd2e5354e849f4672797bda960d
W20240503 08:02:05.181789 15874 ts_tablet_manager.cc:701] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Tablet Copy: Invalid argument: Leader has replica of tablet e89b17bb69564679a7cf9f2fcbec5bd8 with term 0, which is lower than last-logged term 3 on local replica. Rejecting tablet copy request
W20240503 08:02:05.188797 15874 ts_tablet_manager.cc:701] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Tablet Copy: Invalid argument: Leader has replica of tablet e89b17bb69564679a7cf9f2fcbec5bd8 with term 0, which is lower than last-logged term 3 on local replica. Rejecting tablet copy request
W20240503 08:02:05.203684 15874 ts_tablet_manager.cc:701] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Tablet Copy: Invalid argument: Leader has replica of tablet e89b17bb69564679a7cf9f2fcbec5bd8 with term 0, which is lower than last-logged term 3 on local replica. Rejecting tablet copy request
I20240503 08:02:05.205942 15796 tablet_service.cc:1514] Processing DeleteTablet for tablet e89b17bb69564679a7cf9f2fcbec5bd8 with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:40906
I20240503 08:02:05.206418 16291 tablet_replica.cc:330] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: stopping tablet replica
I20240503 08:02:05.206769 16291 raft_consensus.cc:2229] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d [term 3 NON_PARTICIPANT]: Raft consensus shutting down.
I20240503 08:02:05.207031 16291 raft_consensus.cc:2258] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d [term 3 NON_PARTICIPANT]: Raft consensus is shut down!
I20240503 08:02:05.208388 16291 ts_tablet_manager.cc:1875] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20240503 08:02:05.210196 16291 ts_tablet_manager.cc:1888] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 3.211
I20240503 08:02:05.210281 16291 log.cc:1196] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Deleting WAL directory at /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/wal/wals/e89b17bb69564679a7cf9f2fcbec5bd8
I20240503 08:02:05.210565 16291 ts_tablet_manager.cc:1909] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Deleting consensus metadata
I20240503 08:02:05.211942 14718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9G1ywP/build/debug/bin/kudu with pid 15735
I20240503 08:02:05.217572 14718 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9G1ywP/build/debug/bin/kudu
/tmp/dist-test-task9G1ywP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.95.130:34223
--local_ip_for_outbound_sockets=127.14.95.130
--tserver_master_addrs=127.14.95.190:40839
--webserver_port=34073
--webserver_interface=127.14.95.130
--builtin_ntp_servers=127.14.95.148:35399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240503 08:02:05.334700 16292 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:02:05.334977 16292 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:02:05.335040 16292 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:02:05.338410 16292 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:02:05.338553 16292 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.95.130
I20240503 08:02:05.342442 16292 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.95.148:35399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.95.130:34223
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.95.130
--webserver_port=34073
--tserver_master_addrs=127.14.95.190:40839
--never_fsync=true
--heap_profile_path=/tmp/kudu.16292
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.95.130
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type DEBUG
built by None at 03 May 2024 07:43:15 UTC on 1a15035a6830
build id 101
I20240503 08:02:05.343436 16292 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:02:05.344695 16292 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:02:05.354216 16297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:05.354502 16298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:05.355127 16300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:02:05.356141 16292 server_base.cc:1034] running on GCE node
I20240503 08:02:05.356618 16292 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:02:05.357383 16292 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:02:05.358542 16292 hybrid_clock.cc:648] HybridClock initialized: now 1714723325358512 us; error 45 us; skew 500 ppm
I20240503 08:02:05.360560 16292 webserver.cc:460] Webserver started at http://127.14.95.130:34073/ using document root <none> and password file <none>
I20240503 08:02:05.361184 16292 fs_manager.cc:359] Metadata directory not provided
I20240503 08:02:05.361249 16292 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:02:05.364727 16292 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20240503 08:02:05.366822 16306 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:05.367944 16292 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20240503 08:02:05.368058 16292 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data,/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/wal
uuid: "697b9bd2e5354e849f4672797bda960d"
format_stamp: "Formatted at 2024-05-03 08:02:01 on dist-test-slave-0z1c"
I20240503 08:02:05.368528 16292 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:02:05.396354 16292 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:02:05.397058 16292 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:02:05.397228 16292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:02:05.397905 16292 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:02:05.398913 16292 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:02:05.398964 16292 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:05.399020 16292 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:02:05.399048 16292 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:05.407289 16292 rpc_server.cc:307] RPC server started. Bound to: 127.14.95.130:34223
I20240503 08:02:05.407312 16419 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.95.130:34223 every 8 connection(s)
I20240503 08:02:05.408381 16292 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data/info.pb
I20240503 08:02:05.414005 14718 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9G1ywP/build/debug/bin/kudu as pid 16292
I20240503 08:02:05.414165 14718 tablet_copy_client_session-itest.cc:139] Starting loop 2
I20240503 08:02:05.414213 14718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9G1ywP/build/debug/bin/kudu with pid 15873
I20240503 08:02:05.420959 14718 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9G1ywP/build/debug/bin/kudu
/tmp/dist-test-task9G1ywP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.95.129:33541
--local_ip_for_outbound_sockets=127.14.95.129
--tserver_master_addrs=127.14.95.190:40839
--webserver_port=33667
--webserver_interface=127.14.95.129
--builtin_ntp_servers=127.14.95.148:35399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240503 08:02:05.421633 16420 heartbeater.cc:347] Connected to a master server at 127.14.95.190:40839
I20240503 08:02:05.421862 16420 heartbeater.cc:464] Registering TS with master...
I20240503 08:02:05.422528 16420 heartbeater.cc:511] Master 127.14.95.190:40839 requested a full tablet report, sending...
I20240503 08:02:05.423738 15115 ts_manager.cc:194] Re-registered known tserver with Master: 697b9bd2e5354e849f4672797bda960d (127.14.95.130:34223)
I20240503 08:02:05.424389 15115 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.95.130:45771
I20240503 08:02:05.428840 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.429728 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.450148 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.450700 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.453946 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.454418 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.457613 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.458079 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.463449 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.463954 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.475528 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.476035 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.493698 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.494211 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.505080 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.505580 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.512918 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.513432 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.516291 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.516750 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.520331 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.520748 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.539256 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.539777 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.543778 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.544211 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
W20240503 08:02:05.545567 16429 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:02:05.545866 16429 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:02:05.545943 16429 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:02:05.549278 16429 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:02:05.549413 16429 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.95.129
I20240503 08:02:05.553460 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.553532 16429 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.95.148:35399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.95.129:33541
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.95.129
--webserver_port=33667
--tserver_master_addrs=127.14.95.190:40839
--never_fsync=true
--heap_profile_path=/tmp/kudu.16429
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.95.129
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type DEBUG
built by None at 03 May 2024 07:43:15 UTC on 1a15035a6830
build id 101
I20240503 08:02:05.553926 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.554733 16429 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:02:05.556116 16429 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20240503 08:02:05.562188 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.562646 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.564491 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.564882 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
W20240503 08:02:05.565460 16496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:05.566001 16495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:05.566906 16498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:02:05.567829 16429 server_base.cc:1034] running on GCE node
I20240503 08:02:05.568333 16429 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:02:05.569294 16429 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:02:05.570503 16429 hybrid_clock.cc:648] HybridClock initialized: now 1714723325570475 us; error 37 us; skew 500 ppm
I20240503 08:02:05.574370 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.574891 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.577633 16429 webserver.cc:460] Webserver started at http://127.14.95.129:33667/ using document root <none> and password file <none>
I20240503 08:02:05.578271 16429 fs_manager.cc:359] Metadata directory not provided
I20240503 08:02:05.578343 16429 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:02:05.580201 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.580694 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.582468 16429 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20240503 08:02:05.582688 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.583081 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.585080 16524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:05.586198 16429 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240503 08:02:05.586328 16429 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/data,/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/wal
uuid: "03f536fd5f2147749df1ac552c1b6540"
format_stamp: "Formatted at 2024-05-03 08:02:01 on dist-test-slave-0z1c"
I20240503 08:02:05.586781 16429 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:02:05.593782 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.594275 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.610639 16429 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:02:05.611326 16429 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:02:05.611501 16429 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:02:05.612061 16429 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:02:05.613251 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.613327 16535 ts_tablet_manager.cc:516] Loading tablet metadata (0/1 complete)
I20240503 08:02:05.613663 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.616765 16429 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240503 08:02:05.616847 16429 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20240503 08:02:05.616900 16429 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240503 08:02:05.618474 16429 ts_tablet_manager.cc:590] Registered 1 tablets
I20240503 08:02:05.618541 16429 ts_tablet_manager.cc:569] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20240503 08:02:05.618819 16535 tablet_bootstrap.cc:492] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540: Bootstrap starting.
I20240503 08:02:05.624023 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.624500 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.629757 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.630215 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.631384 16429 rpc_server.cc:307] RPC server started. Bound to: 127.14.95.129:33541
I20240503 08:02:05.631918 16654 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.95.129:33541 every 8 connection(s)
I20240503 08:02:05.632728 16429 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-0/data/info.pb
I20240503 08:02:05.637262 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.637708 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.639269 14718 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9G1ywP/build/debug/bin/kudu as pid 16429
I20240503 08:02:05.642890 16655 heartbeater.cc:347] Connected to a master server at 127.14.95.190:40839
I20240503 08:02:05.643142 16655 heartbeater.cc:464] Registering TS with master...
I20240503 08:02:05.643781 16655 heartbeater.cc:511] Master 127.14.95.190:40839 requested a full tablet report, sending...
I20240503 08:02:05.645860 15115 ts_manager.cc:194] Re-registered known tserver with Master: 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.646739 15115 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.95.129:41525
I20240503 08:02:05.647359 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.647504 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.648065 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.653640 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.654132 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.654670 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.654786 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.654884 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.658740 16535 log.cc:824] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540: Log is configured to *not* fsync() on all Append() calls
I20240503 08:02:05.669083 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.669709 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.670292 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.670397 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.670485 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.676375 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.676901 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.677471 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.677577 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.677707 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.679349 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.679777 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.680212 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.680308 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.680395 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.699105 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.699594 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.700210 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.700338 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.700438 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.711028 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.711529 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.712061 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.712167 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.712261 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.713718 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.714181 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.714632 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.714726 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.714859 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.723693 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.724206 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.724761 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.724867 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.724958 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.730528 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.730984 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.731496 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.731600 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.731706 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.745797 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.746284 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.746884 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.747014 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.747112 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.751013 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.751497 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.752032 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.752146 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.752242 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.753671 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.754105 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.754556 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.754660 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.754753 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.763562 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.764041 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.764576 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.764706 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.764801 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.769897 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.770342 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.770913 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.771011 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.771083 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.776243 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.776696 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.777194 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.777295 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.777383 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.783306 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.783778 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.784286 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.784390 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.784466 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.799885 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.800376 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.800930 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.801065 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.801162 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.807086 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.807577 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.808162 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.808270 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.808362 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.811528 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.812044 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.812532 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.812682 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.812784 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.817660 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.818166 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.818862 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.818984 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.819077 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.829704 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.830170 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.830704 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.830807 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.830902 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.837638 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.838130 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.838624 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.838744 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.838837 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.853400 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.853874 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.854431 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.854547 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.854640 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.856606 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.857062 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.857496 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.857596 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.857685 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.879524 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.880137 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.880659 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.880781 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.880872 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.882493 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.882918 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.883371 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.883468 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.883577 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.897130 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.897637 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.898177 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.898288 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.898383 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.902446 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.902899 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.903415 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.903519 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.903610 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.916167 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.916644 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.917284 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.917423 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.917521 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.921622 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.922142 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.922699 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.922813 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.922888 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.929231 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.929680 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.930315 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.930421 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.930518 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.934612 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.935117 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.935657 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.935763 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.935859 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.936908 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.937387 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.938087 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.938211 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.938304 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.943403 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.943890 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.944406 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.944512 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.944608 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.948659 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.949141 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.949707 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.949820 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.949903 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.956336 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.956874 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.957439 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.957547 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.957640 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.965291 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.965829 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.966465 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.966598 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.966717 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.980898 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.981420 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.982054 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.982198 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.982295 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.990315 16535 tablet_bootstrap.cc:492] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540: Bootstrap replayed 1/1 log segments. Stats: ops{read=211 overwritten=0 applied=211 ignored=0} inserts{seen=10400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:02:05.990790 16535 tablet_bootstrap.cc:492] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540: Bootstrap complete.
I20240503 08:02:05.990924 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.991453 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.991837 16535 ts_tablet_manager.cc:1367] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540: Time spent bootstrapping tablet: real 0.373s user 0.357s sys 0.012s
I20240503 08:02:05.992113 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.992216 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.992429 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.994539 16535 raft_consensus.cc:348] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f536fd5f2147749df1ac552c1b6540" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33541 } }
I20240503 08:02:05.994897 16535 raft_consensus.cc:729] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03f536fd5f2147749df1ac552c1b6540, State: Initialized, Role: FOLLOWER
I20240503 08:02:05.995397 16535 consensus_queue.cc:260] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 211, Last appended: 3.211, Last appended by leader: 211, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f536fd5f2147749df1ac552c1b6540" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33541 } }
I20240503 08:02:05.995510 16432 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:05.995523 16535 raft_consensus.cc:388] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [term 3 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:05.995590 16535 raft_consensus.cc:482] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [term 3 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:05.995699 16535 raft_consensus.cc:3037] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:02:05.996022 16432 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:05.996529 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:05.996639 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
W20240503 08:02:05.996755 16616 tablet_copy_service.cc:478] P 03f536fd5f2147749df1ac552c1b6540: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.95.130:48459: Error beginning tablet copy session for tablet e89b17bb69564679a7cf9f2fcbec5bd8: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:02:05.997946 16535 raft_consensus.cc:504] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f536fd5f2147749df1ac552c1b6540" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33541 } }
I20240503 08:02:05.998339 16535 leader_election.cc:302] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 03f536fd5f2147749df1ac552c1b6540; no voters:
I20240503 08:02:05.998647 16535 leader_election.cc:288] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [CANDIDATE]: Term 4 election: Requested vote from peers
I20240503 08:02:05.998736 16825 raft_consensus.cc:2781] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [term 4 FOLLOWER]: Leader election won for term 4
I20240503 08:02:05.999020 16825 raft_consensus.cc:686] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [term 4 LEADER]: Becoming Leader. State: Replica: 03f536fd5f2147749df1ac552c1b6540, State: Running, Role: LEADER
I20240503 08:02:05.999329 16655 heartbeater.cc:503] Master 127.14.95.190:40839 was elected leader, sending a full tablet report...
I20240503 08:02:05.999572 16535 ts_tablet_manager.cc:1398] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540: Time spent starting tablet: real 0.008s user 0.010s sys 0.000s
I20240503 08:02:05.999647 16825 consensus_queue.cc:237] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 211, Committed index: 211, Last appended: 3.211, Last appended by leader: 211, Current term: 4, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f536fd5f2147749df1ac552c1b6540" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33541 } }
I20240503 08:02:06.001837 15115 catalog_manager.cc:5484] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540 reported cstate change: term changed from 3 to 4. New cstate: current_term: 4 leader_uuid: "03f536fd5f2147749df1ac552c1b6540" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f536fd5f2147749df1ac552c1b6540" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33541 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:06.014616 16824 ts_tablet_manager.cc:902] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Initiating tablet copy from peer 03f536fd5f2147749df1ac552c1b6540 (127.14.95.129:33541)
I20240503 08:02:06.015189 16824 tablet_copy_client.cc:308] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33541
I20240503 08:02:06.015786 16616 tablet_copy_service.cc:140] P 03f536fd5f2147749df1ac552c1b6540: Received BeginTabletCopySession request for tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d ({username='slave'} at 127.14.95.130:48459)
I20240503 08:02:06.015908 16616 tablet_copy_service.cc:161] P 03f536fd5f2147749df1ac552c1b6540: Beginning new tablet copy session on tablet e89b17bb69564679a7cf9f2fcbec5bd8 from peer 697b9bd2e5354e849f4672797bda960d at {username='slave'} at 127.14.95.130:48459: session id = 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8
I20240503 08:02:06.016916 16616 tablet_copy_source_session.cc:205] T e89b17bb69564679a7cf9f2fcbec5bd8 P 03f536fd5f2147749df1ac552c1b6540: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:02:06.020361 16824 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e89b17bb69564679a7cf9f2fcbec5bd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:06.026185 16824 tablet_copy_client.cc:783] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Starting download of 0 data blocks...
I20240503 08:02:06.026437 16824 tablet_copy_client.cc:647] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Starting download of 1 WAL segments...
I20240503 08:02:06.030771 16824 tablet_copy_client.cc:523] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:02:06.032522 16824 tablet_bootstrap.cc:492] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Bootstrap starting.
I20240503 08:02:06.055963 16824 log.cc:824] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Log is configured to *not* fsync() on all Append() calls
I20240503 08:02:06.373522 16824 tablet_bootstrap.cc:492] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Bootstrap replayed 1/1 log segments. Stats: ops{read=212 overwritten=0 applied=212 ignored=0} inserts{seen=10400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:02:06.373888 16824 tablet_bootstrap.cc:492] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Bootstrap complete.
I20240503 08:02:06.374274 16824 ts_tablet_manager.cc:1367] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Time spent bootstrapping tablet: real 0.342s user 0.330s sys 0.012s
I20240503 08:02:06.376871 16824 raft_consensus.cc:348] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d [term 4 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f536fd5f2147749df1ac552c1b6540" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33541 } }
I20240503 08:02:06.377158 16824 raft_consensus.cc:729] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d [term 4 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 697b9bd2e5354e849f4672797bda960d, State: Initialized, Role: NON_PARTICIPANT
I20240503 08:02:06.377537 16824 consensus_queue.cc:260] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 212, Last appended: 4.212, Last appended by leader: 212, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f536fd5f2147749df1ac552c1b6540" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33541 } }
I20240503 08:02:06.378321 16420 heartbeater.cc:503] Master 127.14.95.190:40839 was elected leader, sending a full tablet report...
I20240503 08:02:06.378501 16824 ts_tablet_manager.cc:1398] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
W20240503 08:02:06.379065 16432 ts_tablet_manager.cc:701] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Tablet Copy: Invalid argument: Leader has replica of tablet e89b17bb69564679a7cf9f2fcbec5bd8 with term 0, which is lower than last-logged term 4 on local replica. Rejecting tablet copy request
I20240503 08:02:06.379338 16616 tablet_copy_service.cc:342] P 03f536fd5f2147749df1ac552c1b6540: Request end of tablet copy session 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8 received from {username='slave'} at 127.14.95.130:48459
I20240503 08:02:06.379451 16616 tablet_copy_service.cc:433] P 03f536fd5f2147749df1ac552c1b6540: ending tablet copy session 697b9bd2e5354e849f4672797bda960d-e89b17bb69564679a7cf9f2fcbec5bd8 on tablet e89b17bb69564679a7cf9f2fcbec5bd8 with peer 697b9bd2e5354e849f4672797bda960d
W20240503 08:02:06.413211 16824 ts_tablet_manager.cc:701] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Tablet Copy: Invalid argument: Leader has replica of tablet e89b17bb69564679a7cf9f2fcbec5bd8 with term 0, which is lower than last-logged term 4 on local replica. Rejecting tablet copy request
I20240503 08:02:06.415477 16354 tablet_service.cc:1514] Processing DeleteTablet for tablet e89b17bb69564679a7cf9f2fcbec5bd8 with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:40910
I20240503 08:02:06.415984 16840 tablet_replica.cc:330] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: stopping tablet replica
I20240503 08:02:06.416293 16840 raft_consensus.cc:2229] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d [term 4 NON_PARTICIPANT]: Raft consensus shutting down.
I20240503 08:02:06.416579 16840 raft_consensus.cc:2258] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d [term 4 NON_PARTICIPANT]: Raft consensus is shut down!
I20240503 08:02:06.417834 16840 ts_tablet_manager.cc:1875] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20240503 08:02:06.419637 16840 ts_tablet_manager.cc:1888] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 4.212
I20240503 08:02:06.419719 16840 log.cc:1196] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Deleting WAL directory at /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/wal/wals/e89b17bb69564679a7cf9f2fcbec5bd8
I20240503 08:02:06.420009 16840 ts_tablet_manager.cc:1909] T e89b17bb69564679a7cf9f2fcbec5bd8 P 697b9bd2e5354e849f4672797bda960d: Deleting consensus metadata
I20240503 08:02:06.421372 14718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9G1ywP/build/debug/bin/kudu with pid 16292
I20240503 08:02:06.426820 14718 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9G1ywP/build/debug/bin/kudu
/tmp/dist-test-task9G1ywP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.95.130:34223
--local_ip_for_outbound_sockets=127.14.95.130
--tserver_master_addrs=127.14.95.190:40839
--webserver_port=34073
--webserver_interface=127.14.95.130
--builtin_ntp_servers=127.14.95.148:35399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240503 08:02:06.537360 16841 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:02:06.537621 16841 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:02:06.537684 16841 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:02:06.540962 16841 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:02:06.541141 16841 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.95.130
I20240503 08:02:06.544981 16841 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.95.148:35399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.95.130:34223
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.95.130
--webserver_port=34073
--tserver_master_addrs=127.14.95.190:40839
--never_fsync=true
--heap_profile_path=/tmp/kudu.16841
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.95.130
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type DEBUG
built by None at 03 May 2024 07:43:15 UTC on 1a15035a6830
build id 101
I20240503 08:02:06.546036 16841 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:02:06.547261 16841 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:02:06.555840 16846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:06.556334 16849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:06.556950 16847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:02:06.557853 16841 server_base.cc:1034] running on GCE node
I20240503 08:02:06.558301 16841 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:02:06.559006 16841 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:02:06.560184 16841 hybrid_clock.cc:648] HybridClock initialized: now 1714723326560166 us; error 32 us; skew 500 ppm
I20240503 08:02:06.562162 16841 webserver.cc:460] Webserver started at http://127.14.95.130:34073/ using document root <none> and password file <none>
I20240503 08:02:06.562754 16841 fs_manager.cc:359] Metadata directory not provided
I20240503 08:02:06.562816 16841 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:02:06.566666 16841 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20240503 08:02:06.568761 16855 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:06.570096 16841 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240503 08:02:06.570237 16841 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data,/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/wal
uuid: "697b9bd2e5354e849f4672797bda960d"
format_stamp: "Formatted at 2024-05-03 08:02:01 on dist-test-slave-0z1c"
I20240503 08:02:06.570720 16841 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:02:06.580655 16841 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:02:06.581408 16841 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:02:06.581586 16841 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:02:06.582206 16841 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:02:06.583170 16841 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:02:06.583220 16841 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:06.583276 16841 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:02:06.583302 16841 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:06.592161 16841 rpc_server.cc:307] RPC server started. Bound to: 127.14.95.130:34223
I20240503 08:02:06.592181 16968 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.95.130:34223 every 8 connection(s)
I20240503 08:02:06.593422 16841 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714723320929540-14718-0/minicluster-data/ts-1/data/info.pb
I20240503 08:02:06.602650 14718 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9G1ywP/build/debug/bin/kudu as pid 16841
I20240503 08:02:06.602960 14718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9G1ywP/build/debug/bin/kudu with pid 16429
I20240503 08:02:06.603513 16969 heartbeater.cc:347] Connected to a master server at 127.14.95.190:40839
I20240503 08:02:06.603796 16969 heartbeater.cc:464] Registering TS with master...
I20240503 08:02:06.604588 16969 heartbeater.cc:511] Master 127.14.95.190:40839 requested a full tablet report, sending...
I20240503 08:02:06.606074 15115 ts_manager.cc:194] Re-registered known tserver with Master: 697b9bd2e5354e849f4672797bda960d (127.14.95.130:34223)
I20240503 08:02:06.606712 15115 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.95.130:47593
I20240503 08:02:06.608695 14718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9G1ywP/build/debug/bin/kudu with pid 16841
I20240503 08:02:06.614328 14718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9G1ywP/build/debug/bin/kudu with pid 15084
2024-05-03T08:02:06Z chronyd exiting
[ OK ] TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping (5695 ms)
[ RUN ] TabletCopyClientSessionITest.TestStartTabletCopy
2024-05-03T08:02:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-03T08:02:06Z Disabled control of system clock
I20240503 08:02:06.641856 14718 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9G1ywP/build/debug/bin/kudu
/tmp/dist-test-task9G1ywP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.95.190:44453
--webserver_interface=127.14.95.190
--webserver_port=0
--builtin_ntp_servers=127.14.95.148:38765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.95.190:44453
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240503 08:02:06.751470 16976 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:02:06.751739 16976 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:02:06.751791 16976 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:02:06.755057 16976 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240503 08:02:06.755133 16976 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:02:06.755153 16976 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240503 08:02:06.755170 16976 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240503 08:02:06.759128 16976 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.95.148:38765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.14.95.190:44453
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.95.190:44453
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.95.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.16976
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type DEBUG
built by None at 03 May 2024 07:43:15 UTC on 1a15035a6830
build id 101
I20240503 08:02:06.760147 16976 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:02:06.761368 16976 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:02:06.769721 16982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:06.770511 16984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:06.771049 16981 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:02:06.771735 16976 server_base.cc:1034] running on GCE node
I20240503 08:02:06.772336 16976 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:02:06.773463 16976 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:02:06.774631 16976 hybrid_clock.cc:648] HybridClock initialized: now 1714723326774610 us; error 36 us; skew 500 ppm
I20240503 08:02:06.776791 16976 webserver.cc:460] Webserver started at http://127.14.95.190:39927/ using document root <none> and password file <none>
I20240503 08:02:06.777418 16976 fs_manager.cc:359] Metadata directory not provided
I20240503 08:02:06.777482 16976 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:02:06.777664 16976 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:02:06.779389 16976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/master-0/data/instance:
uuid: "4ae0c16fd153406382c424b1631d237f"
format_stamp: "Formatted at 2024-05-03 08:02:06 on dist-test-slave-0z1c"
I20240503 08:02:06.779886 16976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/master-0/wal/instance:
uuid: "4ae0c16fd153406382c424b1631d237f"
format_stamp: "Formatted at 2024-05-03 08:02:06 on dist-test-slave-0z1c"
I20240503 08:02:06.783572 16976 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20240503 08:02:06.786151 16990 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:06.787431 16976 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240503 08:02:06.787586 16976 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/master-0/data,/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/master-0/wal
uuid: "4ae0c16fd153406382c424b1631d237f"
format_stamp: "Formatted at 2024-05-03 08:02:06 on dist-test-slave-0z1c"
I20240503 08:02:06.787707 16976 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:02:06.801512 16976 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:02:06.802214 16976 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:02:06.802389 16976 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:02:06.809230 16976 rpc_server.cc:307] RPC server started. Bound to: 127.14.95.190:44453
I20240503 08:02:06.809237 17042 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.95.190:44453 every 8 connection(s)
I20240503 08:02:06.810258 16976 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/master-0/data/info.pb
I20240503 08:02:06.812841 17043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:06.817265 14718 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9G1ywP/build/debug/bin/kudu as pid 16976
I20240503 08:02:06.817376 14718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/master-0/wal/instance
I20240503 08:02:06.817951 17043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f: Bootstrap starting.
I20240503 08:02:06.820263 17043 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f: Neither blocks nor log segments found. Creating new log.
I20240503 08:02:06.820945 17043 log.cc:824] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f: Log is configured to *not* fsync() on all Append() calls
I20240503 08:02:06.822576 17043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f: No bootstrap required, opened a new log
I20240503 08:02:06.825879 17043 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ae0c16fd153406382c424b1631d237f" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 44453 } }
I20240503 08:02:06.826128 17043 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:02:06.826186 17043 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ae0c16fd153406382c424b1631d237f, State: Initialized, Role: FOLLOWER
I20240503 08:02:06.826632 17043 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ae0c16fd153406382c424b1631d237f" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 44453 } }
I20240503 08:02:06.826786 17043 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:06.826880 17043 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:06.826967 17043 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:02:06.827714 17043 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ae0c16fd153406382c424b1631d237f" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 44453 } }
I20240503 08:02:06.828032 17043 leader_election.cc:302] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4ae0c16fd153406382c424b1631d237f; no voters:
I20240503 08:02:06.828292 17043 leader_election.cc:288] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:02:06.828410 17048 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:02:06.828626 17048 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f [term 1 LEADER]: Becoming Leader. State: Replica: 4ae0c16fd153406382c424b1631d237f, State: Running, Role: LEADER
I20240503 08:02:06.828958 17048 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ae0c16fd153406382c424b1631d237f" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 44453 } }
I20240503 08:02:06.829386 17043 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f [sys.catalog]: configured and running, proceeding with master startup.
I20240503 08:02:06.830564 17049 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4ae0c16fd153406382c424b1631d237f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ae0c16fd153406382c424b1631d237f" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 44453 } } }
I20240503 08:02:06.830576 17050 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ae0c16fd153406382c424b1631d237f. Latest consensus state: current_term: 1 leader_uuid: "4ae0c16fd153406382c424b1631d237f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ae0c16fd153406382c424b1631d237f" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 44453 } } }
I20240503 08:02:06.830801 17049 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f [sys.catalog]: This master's current role is: LEADER
I20240503 08:02:06.830821 17050 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f [sys.catalog]: This master's current role is: LEADER
I20240503 08:02:06.831869 17057 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240503 08:02:06.834534 17057 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240503 08:02:06.840008 17057 catalog_manager.cc:1347] Generated new cluster ID: 014d2de39d024f22b3419a14196ae146
I20240503 08:02:06.840092 17057 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240503 08:02:06.852501 17057 catalog_manager.cc:1370] Generated new certificate authority record
I20240503 08:02:06.853785 17057 catalog_manager.cc:1504] Loading token signing keys...
I20240503 08:02:06.864259 17057 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f: Generated new TSK 0
I20240503 08:02:06.865090 17057 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240503 08:02:06.876010 14718 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9G1ywP/build/debug/bin/kudu
/tmp/dist-test-task9G1ywP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.95.129:0
--local_ip_for_outbound_sockets=127.14.95.129
--webserver_interface=127.14.95.129
--webserver_port=0
--tserver_master_addrs=127.14.95.190:44453
--builtin_ntp_servers=127.14.95.148:38765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240503 08:02:06.985606 17067 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:02:06.985869 17067 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:02:06.985937 17067 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:02:06.989202 17067 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:02:06.989349 17067 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.95.129
I20240503 08:02:06.993273 17067 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.95.148:38765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.95.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.95.129
--webserver_port=0
--tserver_master_addrs=127.14.95.190:44453
--never_fsync=true
--heap_profile_path=/tmp/kudu.17067
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.95.129
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type DEBUG
built by None at 03 May 2024 07:43:15 UTC on 1a15035a6830
build id 101
I20240503 08:02:06.994218 17067 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:02:06.995368 17067 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:02:07.004132 17075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:07.004479 17073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:07.005347 17072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:02:07.006440 17067 server_base.cc:1034] running on GCE node
I20240503 08:02:07.006948 17067 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:02:07.007598 17067 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:02:07.008770 17067 hybrid_clock.cc:648] HybridClock initialized: now 1714723327008741 us; error 44 us; skew 500 ppm
I20240503 08:02:07.010911 17067 webserver.cc:460] Webserver started at http://127.14.95.129:35821/ using document root <none> and password file <none>
I20240503 08:02:07.011512 17067 fs_manager.cc:359] Metadata directory not provided
I20240503 08:02:07.011572 17067 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:02:07.011754 17067 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:02:07.013541 17067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-0/data/instance:
uuid: "cff2fd6b605043d88e76f9df514325cd"
format_stamp: "Formatted at 2024-05-03 08:02:07 on dist-test-slave-0z1c"
I20240503 08:02:07.014024 17067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-0/wal/instance:
uuid: "cff2fd6b605043d88e76f9df514325cd"
format_stamp: "Formatted at 2024-05-03 08:02:07 on dist-test-slave-0z1c"
I20240503 08:02:07.017629 17067 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20240503 08:02:07.019953 17081 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:07.021121 17067 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240503 08:02:07.021237 17067 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-0/data,/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-0/wal
uuid: "cff2fd6b605043d88e76f9df514325cd"
format_stamp: "Formatted at 2024-05-03 08:02:07 on dist-test-slave-0z1c"
I20240503 08:02:07.021332 17067 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:02:07.038188 17067 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:02:07.038954 17067 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:02:07.039124 17067 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:02:07.039830 17067 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:02:07.041030 17067 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:02:07.041093 17067 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:07.041157 17067 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:02:07.041188 17067 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:07.049309 17067 rpc_server.cc:307] RPC server started. Bound to: 127.14.95.129:35273
I20240503 08:02:07.049333 17194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.95.129:35273 every 8 connection(s)
I20240503 08:02:07.050267 17067 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-0/data/info.pb
I20240503 08:02:07.051718 14718 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9G1ywP/build/debug/bin/kudu as pid 17067
I20240503 08:02:07.051843 14718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-0/wal/instance
I20240503 08:02:07.054385 14718 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9G1ywP/build/debug/bin/kudu
/tmp/dist-test-task9G1ywP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.95.130:0
--local_ip_for_outbound_sockets=127.14.95.130
--webserver_interface=127.14.95.130
--webserver_port=0
--tserver_master_addrs=127.14.95.190:44453
--builtin_ntp_servers=127.14.95.148:38765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240503 08:02:07.060444 17195 heartbeater.cc:347] Connected to a master server at 127.14.95.190:44453
I20240503 08:02:07.060698 17195 heartbeater.cc:464] Registering TS with master...
I20240503 08:02:07.061300 17195 heartbeater.cc:511] Master 127.14.95.190:44453 requested a full tablet report, sending...
I20240503 08:02:07.063006 17007 ts_manager.cc:194] Registered new tserver with Master: cff2fd6b605043d88e76f9df514325cd (127.14.95.129:35273)
I20240503 08:02:07.064632 17007 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.95.129:33323
W20240503 08:02:07.164598 17198 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:02:07.164880 17198 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:02:07.164933 17198 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:02:07.168252 17198 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:02:07.168381 17198 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.95.130
I20240503 08:02:07.172199 17198 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.95.148:38765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.95.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.95.130
--webserver_port=0
--tserver_master_addrs=127.14.95.190:44453
--never_fsync=true
--heap_profile_path=/tmp/kudu.17198
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.95.130
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type DEBUG
built by None at 03 May 2024 07:43:15 UTC on 1a15035a6830
build id 101
I20240503 08:02:07.173260 17198 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:02:07.174484 17198 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:02:07.183678 17206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:07.184491 17204 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:07.185103 17203 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:02:07.185708 17198 server_base.cc:1034] running on GCE node
I20240503 08:02:07.186185 17198 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:02:07.186825 17198 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:02:07.187996 17198 hybrid_clock.cc:648] HybridClock initialized: now 1714723327187977 us; error 38 us; skew 500 ppm
I20240503 08:02:07.190204 17198 webserver.cc:460] Webserver started at http://127.14.95.130:36435/ using document root <none> and password file <none>
I20240503 08:02:07.190783 17198 fs_manager.cc:359] Metadata directory not provided
I20240503 08:02:07.190845 17198 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:02:07.191042 17198 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:02:07.193078 17198 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-1/data/instance:
uuid: "2b157540cd384816ad17ba31fa6160cc"
format_stamp: "Formatted at 2024-05-03 08:02:07 on dist-test-slave-0z1c"
I20240503 08:02:07.193696 17198 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-1/wal/instance:
uuid: "2b157540cd384816ad17ba31fa6160cc"
format_stamp: "Formatted at 2024-05-03 08:02:07 on dist-test-slave-0z1c"
I20240503 08:02:07.197388 17198 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20240503 08:02:07.199874 17212 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:07.201122 17198 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240503 08:02:07.201243 17198 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-1/data,/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-1/wal
uuid: "2b157540cd384816ad17ba31fa6160cc"
format_stamp: "Formatted at 2024-05-03 08:02:07 on dist-test-slave-0z1c"
I20240503 08:02:07.201339 17198 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:02:07.229238 17198 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:02:07.229979 17198 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:02:07.230176 17198 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:02:07.230847 17198 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:02:07.231874 17198 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:02:07.231935 17198 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:07.231990 17198 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:02:07.232015 17198 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:07.240252 17198 rpc_server.cc:307] RPC server started. Bound to: 127.14.95.130:45097
I20240503 08:02:07.240300 17325 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.95.130:45097 every 8 connection(s)
I20240503 08:02:07.241305 17198 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-1/data/info.pb
I20240503 08:02:07.250069 17326 heartbeater.cc:347] Connected to a master server at 127.14.95.190:44453
I20240503 08:02:07.250314 17326 heartbeater.cc:464] Registering TS with master...
I20240503 08:02:07.250687 14718 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9G1ywP/build/debug/bin/kudu as pid 17198
I20240503 08:02:07.250794 14718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-1/wal/instance
I20240503 08:02:07.250926 17326 heartbeater.cc:511] Master 127.14.95.190:44453 requested a full tablet report, sending...
I20240503 08:02:07.251896 17006 ts_manager.cc:194] Registered new tserver with Master: 2b157540cd384816ad17ba31fa6160cc (127.14.95.130:45097)
I20240503 08:02:07.252570 17006 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.95.130:60959
I20240503 08:02:07.253075 14718 external_mini_cluster.cc:930] 2 TS(s) registered with all masters
I20240503 08:02:07.261308 14718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9G1ywP/build/debug/bin/kudu with pid 17198
I20240503 08:02:07.266484 14718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9G1ywP/build/debug/bin/kudu with pid 16976
I20240503 08:02:07.272347 14718 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9G1ywP/build/debug/bin/kudu
/tmp/dist-test-task9G1ywP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.95.190:44453
--webserver_interface=127.14.95.190
--webserver_port=39927
--builtin_ntp_servers=127.14.95.148:38765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.95.190:44453
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240503 08:02:07.380683 17334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:02:07.380939 17334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:02:07.380980 17334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:02:07.384127 17334 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240503 08:02:07.384207 17334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:02:07.384227 17334 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240503 08:02:07.384243 17334 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240503 08:02:07.388063 17334 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.95.148:38765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.14.95.190:44453
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.95.190:44453
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.95.190
--webserver_port=39927
--never_fsync=true
--heap_profile_path=/tmp/kudu.17334
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type DEBUG
built by None at 03 May 2024 07:43:15 UTC on 1a15035a6830
build id 101
I20240503 08:02:07.389043 17334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:02:07.390193 17334 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:02:07.398373 17340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:07.398908 17339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:07.399655 17342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:02:07.400296 17334 server_base.cc:1034] running on GCE node
I20240503 08:02:07.400862 17334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:02:07.401878 17334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:02:07.403038 17334 hybrid_clock.cc:648] HybridClock initialized: now 1714723327403024 us; error 32 us; skew 500 ppm
I20240503 08:02:07.405201 17334 webserver.cc:460] Webserver started at http://127.14.95.190:39927/ using document root <none> and password file <none>
I20240503 08:02:07.405787 17334 fs_manager.cc:359] Metadata directory not provided
I20240503 08:02:07.405859 17334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:02:07.409400 17334 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20240503 08:02:07.411410 17348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:07.412488 17334 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240503 08:02:07.412616 17334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/master-0/data,/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/master-0/wal
uuid: "4ae0c16fd153406382c424b1631d237f"
format_stamp: "Formatted at 2024-05-03 08:02:06 on dist-test-slave-0z1c"
I20240503 08:02:07.413092 17334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:02:07.429140 17334 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:02:07.429801 17334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:02:07.429967 17334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:02:07.436547 17334 rpc_server.cc:307] RPC server started. Bound to: 127.14.95.190:44453
I20240503 08:02:07.436551 17400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.95.190:44453 every 8 connection(s)
I20240503 08:02:07.437922 17334 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/master-0/data/info.pb
I20240503 08:02:07.442158 17401 sys_catalog.cc:263] Verifying existing consensus state
I20240503 08:02:07.443773 17401 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f: Bootstrap starting.
I20240503 08:02:07.447857 14718 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9G1ywP/build/debug/bin/kudu as pid 17334
I20240503 08:02:07.458636 17401 log.cc:824] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f: Log is configured to *not* fsync() on all Append() calls
I20240503 08:02:07.464363 17401 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:02:07.464717 17401 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f: Bootstrap complete.
I20240503 08:02:07.468020 17401 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ae0c16fd153406382c424b1631d237f" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 44453 } }
I20240503 08:02:07.468385 17401 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ae0c16fd153406382c424b1631d237f, State: Initialized, Role: FOLLOWER
I20240503 08:02:07.468806 17401 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ae0c16fd153406382c424b1631d237f" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 44453 } }
I20240503 08:02:07.468909 17401 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:07.468955 17401 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:07.469075 17401 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:02:07.471086 17401 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ae0c16fd153406382c424b1631d237f" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 44453 } }
I20240503 08:02:07.471494 17401 leader_election.cc:302] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4ae0c16fd153406382c424b1631d237f; no voters:
I20240503 08:02:07.471807 17401 leader_election.cc:288] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:02:07.471936 17406 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:02:07.472148 17406 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f [term 2 LEADER]: Becoming Leader. State: Replica: 4ae0c16fd153406382c424b1631d237f, State: Running, Role: LEADER
I20240503 08:02:07.472450 17406 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ae0c16fd153406382c424b1631d237f" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 44453 } }
I20240503 08:02:07.472893 17401 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f [sys.catalog]: configured and running, proceeding with master startup.
I20240503 08:02:07.473815 17407 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "4ae0c16fd153406382c424b1631d237f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ae0c16fd153406382c424b1631d237f" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 44453 } } }
I20240503 08:02:07.473950 17407 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f [sys.catalog]: This master's current role is: LEADER
I20240503 08:02:07.474311 17408 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ae0c16fd153406382c424b1631d237f. Latest consensus state: current_term: 2 leader_uuid: "4ae0c16fd153406382c424b1631d237f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ae0c16fd153406382c424b1631d237f" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 44453 } } }
I20240503 08:02:07.474514 17415 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240503 08:02:07.474529 17408 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f [sys.catalog]: This master's current role is: LEADER
I20240503 08:02:07.477635 17415 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240503 08:02:07.478340 17415 catalog_manager.cc:1259] Loaded cluster ID: 014d2de39d024f22b3419a14196ae146
I20240503 08:02:07.478406 17415 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240503 08:02:07.480733 17415 catalog_manager.cc:1504] Loading token signing keys...
I20240503 08:02:07.481485 17415 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4ae0c16fd153406382c424b1631d237f: Loaded TSK: 0
I20240503 08:02:07.482796 17415 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240503 08:02:08.067139 17195 heartbeater.cc:503] Master 127.14.95.190:44453 was elected leader, sending a full tablet report...
I20240503 08:02:08.072005 17365 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "cff2fd6b605043d88e76f9df514325cd" instance_seqno: 1714723327046969) as {username='slave'} at 127.14.95.129:35065; Asking this server to re-register.
I20240503 08:02:08.072671 17195 heartbeater.cc:464] Registering TS with master...
I20240503 08:02:08.072877 17195 heartbeater.cc:511] Master 127.14.95.190:44453 requested a full tablet report, sending...
I20240503 08:02:08.073978 17365 ts_manager.cc:194] Registered new tserver with Master: cff2fd6b605043d88e76f9df514325cd (127.14.95.129:35273)
I20240503 08:02:08.079022 14718 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20240503 08:02:08.079108 14718 test_util.cc:268] Using random seed: 584824068
I20240503 08:02:08.089716 17365 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36890:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20240503 08:02:08.105448 17129 tablet_service.cc:1467] Processing CreateTablet for tablet 88b989efef9b4a18bb5086c6e382a74f (DEFAULT_TABLE table=test-workload [id=ac76df07d38040498d167bddfbd5409f]), partition=RANGE (key) PARTITION UNBOUNDED
I20240503 08:02:08.106350 17129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88b989efef9b4a18bb5086c6e382a74f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:08.111438 17436 tablet_bootstrap.cc:492] T 88b989efef9b4a18bb5086c6e382a74f P cff2fd6b605043d88e76f9df514325cd: Bootstrap starting.
I20240503 08:02:08.113327 17436 tablet_bootstrap.cc:654] T 88b989efef9b4a18bb5086c6e382a74f P cff2fd6b605043d88e76f9df514325cd: Neither blocks nor log segments found. Creating new log.
I20240503 08:02:08.113996 17436 log.cc:824] T 88b989efef9b4a18bb5086c6e382a74f P cff2fd6b605043d88e76f9df514325cd: Log is configured to *not* fsync() on all Append() calls
I20240503 08:02:08.115567 17436 tablet_bootstrap.cc:492] T 88b989efef9b4a18bb5086c6e382a74f P cff2fd6b605043d88e76f9df514325cd: No bootstrap required, opened a new log
I20240503 08:02:08.115762 17436 ts_tablet_manager.cc:1367] T 88b989efef9b4a18bb5086c6e382a74f P cff2fd6b605043d88e76f9df514325cd: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240503 08:02:08.118892 17436 raft_consensus.cc:348] T 88b989efef9b4a18bb5086c6e382a74f P cff2fd6b605043d88e76f9df514325cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cff2fd6b605043d88e76f9df514325cd" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 35273 } }
I20240503 08:02:08.119076 17436 raft_consensus.cc:374] T 88b989efef9b4a18bb5086c6e382a74f P cff2fd6b605043d88e76f9df514325cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:02:08.119131 17436 raft_consensus.cc:729] T 88b989efef9b4a18bb5086c6e382a74f P cff2fd6b605043d88e76f9df514325cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cff2fd6b605043d88e76f9df514325cd, State: Initialized, Role: FOLLOWER
I20240503 08:02:08.119534 17436 consensus_queue.cc:260] T 88b989efef9b4a18bb5086c6e382a74f P cff2fd6b605043d88e76f9df514325cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cff2fd6b605043d88e76f9df514325cd" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 35273 } }
I20240503 08:02:08.119659 17436 raft_consensus.cc:388] T 88b989efef9b4a18bb5086c6e382a74f P cff2fd6b605043d88e76f9df514325cd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:08.119717 17436 raft_consensus.cc:482] T 88b989efef9b4a18bb5086c6e382a74f P cff2fd6b605043d88e76f9df514325cd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:08.119817 17436 raft_consensus.cc:3037] T 88b989efef9b4a18bb5086c6e382a74f P cff2fd6b605043d88e76f9df514325cd [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:02:08.120589 17436 raft_consensus.cc:504] T 88b989efef9b4a18bb5086c6e382a74f P cff2fd6b605043d88e76f9df514325cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cff2fd6b605043d88e76f9df514325cd" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 35273 } }
I20240503 08:02:08.120899 17436 leader_election.cc:302] T 88b989efef9b4a18bb5086c6e382a74f P cff2fd6b605043d88e76f9df514325cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cff2fd6b605043d88e76f9df514325cd; no voters:
I20240503 08:02:08.121196 17436 leader_election.cc:288] T 88b989efef9b4a18bb5086c6e382a74f P cff2fd6b605043d88e76f9df514325cd [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:02:08.121308 17438 raft_consensus.cc:2781] T 88b989efef9b4a18bb5086c6e382a74f P cff2fd6b605043d88e76f9df514325cd [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:02:08.121524 17438 raft_consensus.cc:686] T 88b989efef9b4a18bb5086c6e382a74f P cff2fd6b605043d88e76f9df514325cd [term 1 LEADER]: Becoming Leader. State: Replica: cff2fd6b605043d88e76f9df514325cd, State: Running, Role: LEADER
I20240503 08:02:08.121822 17438 consensus_queue.cc:237] T 88b989efef9b4a18bb5086c6e382a74f P cff2fd6b605043d88e76f9df514325cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cff2fd6b605043d88e76f9df514325cd" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 35273 } }
I20240503 08:02:08.122053 17436 ts_tablet_manager.cc:1398] T 88b989efef9b4a18bb5086c6e382a74f P cff2fd6b605043d88e76f9df514325cd: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20240503 08:02:08.125389 17365 catalog_manager.cc:5484] T 88b989efef9b4a18bb5086c6e382a74f P cff2fd6b605043d88e76f9df514325cd reported cstate change: term changed from 0 to 1, leader changed from <none> to cff2fd6b605043d88e76f9df514325cd (127.14.95.129). New cstate: current_term: 1 leader_uuid: "cff2fd6b605043d88e76f9df514325cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cff2fd6b605043d88e76f9df514325cd" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 35273 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:08.520021 14718 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9G1ywP/build/debug/bin/kudu
/tmp/dist-test-task9G1ywP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.95.130:45097
--local_ip_for_outbound_sockets=127.14.95.130
--tserver_master_addrs=127.14.95.190:44453
--webserver_port=36435
--webserver_interface=127.14.95.130
--builtin_ntp_servers=127.14.95.148:38765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240503 08:02:08.628513 17453 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:02:08.628760 17453 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:02:08.628808 17453 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:02:08.632073 17453 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:02:08.632215 17453 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.95.130
I20240503 08:02:08.636078 17453 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.95.148:38765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.95.130:45097
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.95.130
--webserver_port=36435
--tserver_master_addrs=127.14.95.190:44453
--never_fsync=true
--heap_profile_path=/tmp/kudu.17453
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.95.130
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type DEBUG
built by None at 03 May 2024 07:43:15 UTC on 1a15035a6830
build id 101
I20240503 08:02:08.637090 17453 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:02:08.638247 17453 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:02:08.646906 17459 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:08.647444 17458 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:08.648017 17461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:02:08.648957 17453 server_base.cc:1034] running on GCE node
I20240503 08:02:08.649417 17453 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:02:08.650039 17453 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:02:08.651207 17453 hybrid_clock.cc:648] HybridClock initialized: now 1714723328651182 us; error 38 us; skew 500 ppm
I20240503 08:02:08.653261 17453 webserver.cc:460] Webserver started at http://127.14.95.130:36435/ using document root <none> and password file <none>
I20240503 08:02:08.653833 17453 fs_manager.cc:359] Metadata directory not provided
I20240503 08:02:08.653905 17453 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:02:08.657608 17453 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20240503 08:02:08.659571 17467 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:08.660691 17453 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240503 08:02:08.660800 17453 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-1/data,/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-1/wal
uuid: "2b157540cd384816ad17ba31fa6160cc"
format_stamp: "Formatted at 2024-05-03 08:02:07 on dist-test-slave-0z1c"
I20240503 08:02:08.661280 17453 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:02:08.683434 17453 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:02:08.684115 17453 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:02:08.684279 17453 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:02:08.684855 17453 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:02:08.685861 17453 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:02:08.685911 17453 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:08.685951 17453 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:02:08.685966 17453 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:08.693997 17453 rpc_server.cc:307] RPC server started. Bound to: 127.14.95.130:45097
I20240503 08:02:08.694029 17580 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.95.130:45097 every 8 connection(s)
I20240503 08:02:08.695150 17453 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-1/data/info.pb
I20240503 08:02:08.695699 14718 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9G1ywP/build/debug/bin/kudu as pid 17453
I20240503 08:02:08.704182 17581 heartbeater.cc:347] Connected to a master server at 127.14.95.190:44453
I20240503 08:02:08.704396 17581 heartbeater.cc:464] Registering TS with master...
I20240503 08:02:08.704723 17586 ts_tablet_manager.cc:902] T 88b989efef9b4a18bb5086c6e382a74f P 2b157540cd384816ad17ba31fa6160cc: Initiating tablet copy from peer cff2fd6b605043d88e76f9df514325cd (127.14.95.129:35273)
I20240503 08:02:08.705046 17581 heartbeater.cc:511] Master 127.14.95.190:44453 requested a full tablet report, sending...
I20240503 08:02:08.705531 17586 tablet_copy_client.cc:308] T 88b989efef9b4a18bb5086c6e382a74f P 2b157540cd384816ad17ba31fa6160cc: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:35273
I20240503 08:02:08.706128 17358 ts_manager.cc:194] Registered new tserver with Master: 2b157540cd384816ad17ba31fa6160cc (127.14.95.130:45097)
I20240503 08:02:08.707108 17358 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.95.130:54077
I20240503 08:02:08.709321 17169 tablet_copy_service.cc:140] P cff2fd6b605043d88e76f9df514325cd: Received BeginTabletCopySession request for tablet 88b989efef9b4a18bb5086c6e382a74f from peer 2b157540cd384816ad17ba31fa6160cc ({username='slave'} at 127.14.95.130:53135)
I20240503 08:02:08.709461 17169 tablet_copy_service.cc:161] P cff2fd6b605043d88e76f9df514325cd: Beginning new tablet copy session on tablet 88b989efef9b4a18bb5086c6e382a74f from peer 2b157540cd384816ad17ba31fa6160cc at {username='slave'} at 127.14.95.130:53135: session id = 2b157540cd384816ad17ba31fa6160cc-88b989efef9b4a18bb5086c6e382a74f
I20240503 08:02:08.710568 17169 tablet_copy_source_session.cc:205] T 88b989efef9b4a18bb5086c6e382a74f P cff2fd6b605043d88e76f9df514325cd: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:02:08.713603 17586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88b989efef9b4a18bb5086c6e382a74f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:08.719328 17586 tablet_copy_client.cc:783] T 88b989efef9b4a18bb5086c6e382a74f P 2b157540cd384816ad17ba31fa6160cc: tablet copy: Starting download of 0 data blocks...
I20240503 08:02:08.719514 17586 tablet_copy_client.cc:647] T 88b989efef9b4a18bb5086c6e382a74f P 2b157540cd384816ad17ba31fa6160cc: tablet copy: Starting download of 1 WAL segments...
I20240503 08:02:08.723371 17586 tablet_copy_client.cc:523] T 88b989efef9b4a18bb5086c6e382a74f P 2b157540cd384816ad17ba31fa6160cc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:02:08.724989 17586 tablet_bootstrap.cc:492] T 88b989efef9b4a18bb5086c6e382a74f P 2b157540cd384816ad17ba31fa6160cc: Bootstrap starting.
I20240503 08:02:08.746263 17586 log.cc:824] T 88b989efef9b4a18bb5086c6e382a74f P 2b157540cd384816ad17ba31fa6160cc: Log is configured to *not* fsync() on all Append() calls
I20240503 08:02:09.043090 17586 tablet_bootstrap.cc:492] T 88b989efef9b4a18bb5086c6e382a74f P 2b157540cd384816ad17ba31fa6160cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=211 overwritten=0 applied=211 ignored=0} inserts{seen=10500 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:02:09.043498 17586 tablet_bootstrap.cc:492] T 88b989efef9b4a18bb5086c6e382a74f P 2b157540cd384816ad17ba31fa6160cc: Bootstrap complete.
I20240503 08:02:09.043913 17586 ts_tablet_manager.cc:1367] T 88b989efef9b4a18bb5086c6e382a74f P 2b157540cd384816ad17ba31fa6160cc: Time spent bootstrapping tablet: real 0.319s user 0.313s sys 0.004s
I20240503 08:02:09.046653 17586 raft_consensus.cc:348] T 88b989efef9b4a18bb5086c6e382a74f P 2b157540cd384816ad17ba31fa6160cc [term 1 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cff2fd6b605043d88e76f9df514325cd" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 35273 } }
I20240503 08:02:09.046936 17586 raft_consensus.cc:729] T 88b989efef9b4a18bb5086c6e382a74f P 2b157540cd384816ad17ba31fa6160cc [term 1 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 2b157540cd384816ad17ba31fa6160cc, State: Initialized, Role: NON_PARTICIPANT
I20240503 08:02:09.047415 17586 consensus_queue.cc:260] T 88b989efef9b4a18bb5086c6e382a74f P 2b157540cd384816ad17ba31fa6160cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 211, Last appended: 1.211, Last appended by leader: 211, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cff2fd6b605043d88e76f9df514325cd" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 35273 } }
I20240503 08:02:09.048215 17581 heartbeater.cc:503] Master 127.14.95.190:44453 was elected leader, sending a full tablet report...
I20240503 08:02:09.048357 17586 ts_tablet_manager.cc:1398] T 88b989efef9b4a18bb5086c6e382a74f P 2b157540cd384816ad17ba31fa6160cc: Time spent starting tablet: real 0.004s user 0.007s sys 0.000s
I20240503 08:02:09.049265 17169 tablet_copy_service.cc:342] P cff2fd6b605043d88e76f9df514325cd: Request end of tablet copy session 2b157540cd384816ad17ba31fa6160cc-88b989efef9b4a18bb5086c6e382a74f received from {username='slave'} at 127.14.95.130:53135
I20240503 08:02:09.049399 17169 tablet_copy_service.cc:433] P cff2fd6b605043d88e76f9df514325cd: ending tablet copy session 2b157540cd384816ad17ba31fa6160cc-88b989efef9b4a18bb5086c6e382a74f on tablet 88b989efef9b4a18bb5086c6e382a74f with peer 2b157540cd384816ad17ba31fa6160cc
I20240503 08:02:09.050647 17515 tablet_service.cc:1514] Processing DeleteTablet for tablet 88b989efef9b4a18bb5086c6e382a74f with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:39188
I20240503 08:02:09.051057 17593 tablet_replica.cc:330] T 88b989efef9b4a18bb5086c6e382a74f P 2b157540cd384816ad17ba31fa6160cc: stopping tablet replica
I20240503 08:02:09.051329 17593 raft_consensus.cc:2229] T 88b989efef9b4a18bb5086c6e382a74f P 2b157540cd384816ad17ba31fa6160cc [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20240503 08:02:09.051573 17593 raft_consensus.cc:2258] T 88b989efef9b4a18bb5086c6e382a74f P 2b157540cd384816ad17ba31fa6160cc [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20240503 08:02:09.052953 17593 ts_tablet_manager.cc:1875] T 88b989efef9b4a18bb5086c6e382a74f P 2b157540cd384816ad17ba31fa6160cc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 08:02:09.054665 17593 ts_tablet_manager.cc:1888] T 88b989efef9b4a18bb5086c6e382a74f P 2b157540cd384816ad17ba31fa6160cc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.211
I20240503 08:02:09.054803 17593 log.cc:1196] T 88b989efef9b4a18bb5086c6e382a74f P 2b157540cd384816ad17ba31fa6160cc: Deleting WAL directory at /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714723320929540-14718-0/minicluster-data/ts-1/wal/wals/88b989efef9b4a18bb5086c6e382a74f
I20240503 08:02:09.056051 17586 ts_tablet_manager.cc:902] T 88b989efef9b4a18bb5086c6e382a74f P 2b157540cd384816ad17ba31fa6160cc: Initiating tablet copy from peer cff2fd6b605043d88e76f9df514325cd (127.14.95.129:35273)
I20240503 08:02:09.056444 17586 tablet_copy_client.cc:308] T 88b989efef9b4a18bb5086c6e382a74f P 2b157540cd384816ad17ba31fa6160cc: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:35273
I20240503 08:02:09.056901 17169 tablet_copy_service.cc:140] P cff2fd6b605043d88e76f9df514325cd: Received BeginTabletCopySession request for tablet 88b989efef9b4a18bb5086c6e382a74f from peer 2b157540cd384816ad17ba31fa6160cc ({username='slave'} at 127.14.95.130:53135)
I20240503 08:02:09.057039 17169 tablet_copy_service.cc:161] P cff2fd6b605043d88e76f9df514325cd: Beginning new tablet copy session on tablet 88b989efef9b4a18bb5086c6e382a74f from peer 2b157540cd384816ad17ba31fa6160cc at {username='slave'} at 127.14.95.130:53135: session id = 2b157540cd384816ad17ba31fa6160cc-88b989efef9b4a18bb5086c6e382a74f
I20240503 08:02:09.057915 17169 tablet_copy_source_session.cc:205] T 88b989efef9b4a18bb5086c6e382a74f P cff2fd6b605043d88e76f9df514325cd: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:02:09.058532 17586 ts_tablet_manager.cc:1875] T 88b989efef9b4a18bb5086c6e382a74f P 2b157540cd384816ad17ba31fa6160cc: Deleting tablet data with delete state TABLET_DATA_COPYING
I20240503 08:02:09.060016 17586 ts_tablet_manager.cc:1888] T 88b989efef9b4a18bb5086c6e382a74f P 2b157540cd384816ad17ba31fa6160cc: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.211
I20240503 08:02:09.060179 17586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88b989efef9b4a18bb5086c6e382a74f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:09.061074 17586 tablet_copy_client.cc:783] T 88b989efef9b4a18bb5086c6e382a74f P 2b157540cd384816ad17ba31fa6160cc: tablet copy: Starting download of 0 data blocks...
I20240503 08:02:09.061197 17586 tablet_copy_client.cc:647] T 88b989efef9b4a18bb5086c6e382a74f P 2b157540cd384816ad17ba31fa6160cc: tablet copy: Starting download of 1 WAL segments...
I20240503 08:02:09.063426 17586 tablet_copy_client.cc:523] T 88b989efef9b4a18bb5086c6e382a74f P 2b157540cd384816ad17ba31fa6160cc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:02:09.064430 17586 tablet_bootstrap.cc:492] T 88b989efef9b4a18bb5086c6e382a74f P 2b157540cd384816ad17ba31fa6160cc: Bootstrap starting.
I20240503 08:02:09.371460 17586 tablet_bootstrap.cc:492] T 88b989efef9b4a18bb5086c6e382a74f P 2b157540cd384816ad17ba31fa6160cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=211 overwritten=0 applied=211 ignored=0} inserts{seen=10500 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:02:09.371742 17586 tablet_bootstrap.cc:492] T 88b989efef9b4a18bb5086c6e382a74f P 2b157540cd384816ad17ba31fa6160cc: Bootstrap complete.
I20240503 08:02:09.371966 17586 ts_tablet_manager.cc:1367] T 88b989efef9b4a18bb5086c6e382a74f P 2b157540cd384816ad17ba31fa6160cc: Time spent bootstrapping tablet: real 0.308s user 0.293s sys 0.012s
I20240503 08:02:09.372510 17586 raft_consensus.cc:348] T 88b989efef9b4a18bb5086c6e382a74f P 2b157540cd384816ad17ba31fa6160cc [term 1 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cff2fd6b605043d88e76f9df514325cd" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 35273 } }
I20240503 08:02:09.372614 17586 raft_consensus.cc:729] T 88b989efef9b4a18bb5086c6e382a74f P 2b157540cd384816ad17ba31fa6160cc [term 1 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 2b157540cd384816ad17ba31fa6160cc, State: Initialized, Role: NON_PARTICIPANT
I20240503 08:02:09.372713 17586 consensus_queue.cc:260] T 88b989efef9b4a18bb5086c6e382a74f P 2b157540cd384816ad17ba31fa6160cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 211, Last appended: 1.211, Last appended by leader: 211, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cff2fd6b605043d88e76f9df514325cd" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 35273 } }
I20240503 08:02:09.372943 17586 ts_tablet_manager.cc:1398] T 88b989efef9b4a18bb5086c6e382a74f P 2b157540cd384816ad17ba31fa6160cc: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:02:09.373562 17169 tablet_copy_service.cc:342] P cff2fd6b605043d88e76f9df514325cd: Request end of tablet copy session 2b157540cd384816ad17ba31fa6160cc-88b989efef9b4a18bb5086c6e382a74f received from {username='slave'} at 127.14.95.130:53135
I20240503 08:02:09.373643 17169 tablet_copy_service.cc:433] P cff2fd6b605043d88e76f9df514325cd: ending tablet copy session 2b157540cd384816ad17ba31fa6160cc-88b989efef9b4a18bb5086c6e382a74f on tablet 88b989efef9b4a18bb5086c6e382a74f with peer 2b157540cd384816ad17ba31fa6160cc
I20240503 08:02:09.380270 14718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9G1ywP/build/debug/bin/kudu with pid 17067
I20240503 08:02:09.385793 14718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9G1ywP/build/debug/bin/kudu with pid 17453
I20240503 08:02:09.391088 14718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9G1ywP/build/debug/bin/kudu with pid 17334
2024-05-03T08:02:09Z chronyd exiting
[ OK ] TabletCopyClientSessionITest.TestStartTabletCopy (2765 ms)
[ RUN ] TabletCopyClientSessionITest.TestCopyFromCrashedSource
2024-05-03T08:02:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-03T08:02:09Z Disabled control of system clock
I20240503 08:02:09.407799 14718 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9G1ywP/build/debug/bin/kudu
/tmp/dist-test-task9G1ywP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.95.190:38815
--webserver_interface=127.14.95.190
--webserver_port=0
--builtin_ntp_servers=127.14.95.148:45719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.95.190:38815
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240503 08:02:09.514750 17602 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:02:09.514997 17602 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:02:09.515035 17602 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:02:09.518152 17602 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240503 08:02:09.518220 17602 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:02:09.518239 17602 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240503 08:02:09.518256 17602 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240503 08:02:09.522049 17602 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.95.148:45719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.14.95.190:38815
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.95.190:38815
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.95.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.17602
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type DEBUG
built by None at 03 May 2024 07:43:15 UTC on 1a15035a6830
build id 101
I20240503 08:02:09.522971 17602 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:02:09.524091 17602 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:02:09.531698 17608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:09.531978 17607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:09.532934 17610 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:02:09.533674 17602 server_base.cc:1034] running on GCE node
I20240503 08:02:09.534200 17602 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:02:09.535173 17602 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:02:09.536352 17602 hybrid_clock.cc:648] HybridClock initialized: now 1714723329536325 us; error 41 us; skew 500 ppm
I20240503 08:02:09.538352 17602 webserver.cc:460] Webserver started at http://127.14.95.190:43525/ using document root <none> and password file <none>
I20240503 08:02:09.538915 17602 fs_manager.cc:359] Metadata directory not provided
I20240503 08:02:09.538970 17602 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:02:09.539148 17602 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:02:09.540839 17602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/master-0/data/instance:
uuid: "020d12da25c44bc0b79c5ae648120f41"
format_stamp: "Formatted at 2024-05-03 08:02:09 on dist-test-slave-0z1c"
I20240503 08:02:09.541345 17602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/master-0/wal/instance:
uuid: "020d12da25c44bc0b79c5ae648120f41"
format_stamp: "Formatted at 2024-05-03 08:02:09 on dist-test-slave-0z1c"
I20240503 08:02:09.544648 17602 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20240503 08:02:09.547142 17616 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:09.548161 17602 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240503 08:02:09.548274 17602 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/master-0/data,/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/master-0/wal
uuid: "020d12da25c44bc0b79c5ae648120f41"
format_stamp: "Formatted at 2024-05-03 08:02:09 on dist-test-slave-0z1c"
I20240503 08:02:09.548367 17602 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:02:09.561857 17602 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:02:09.562601 17602 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:02:09.562785 17602 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:02:09.569810 17602 rpc_server.cc:307] RPC server started. Bound to: 127.14.95.190:38815
I20240503 08:02:09.569849 17668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.95.190:38815 every 8 connection(s)
I20240503 08:02:09.570864 17602 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/master-0/data/info.pb
I20240503 08:02:09.572782 14718 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9G1ywP/build/debug/bin/kudu as pid 17602
I20240503 08:02:09.572896 14718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/master-0/wal/instance
I20240503 08:02:09.573854 17669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:09.579962 17669 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41: Bootstrap starting.
I20240503 08:02:09.582280 17669 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41: Neither blocks nor log segments found. Creating new log.
I20240503 08:02:09.583101 17669 log.cc:824] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41: Log is configured to *not* fsync() on all Append() calls
I20240503 08:02:09.584836 17669 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41: No bootstrap required, opened a new log
I20240503 08:02:09.587424 17669 raft_consensus.cc:348] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "020d12da25c44bc0b79c5ae648120f41" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 38815 } }
I20240503 08:02:09.587658 17669 raft_consensus.cc:374] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:02:09.587733 17669 raft_consensus.cc:729] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 020d12da25c44bc0b79c5ae648120f41, State: Initialized, Role: FOLLOWER
I20240503 08:02:09.588169 17669 consensus_queue.cc:260] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "020d12da25c44bc0b79c5ae648120f41" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 38815 } }
I20240503 08:02:09.588311 17669 raft_consensus.cc:388] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:09.588372 17669 raft_consensus.cc:482] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:09.588469 17669 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:02:09.589423 17669 raft_consensus.cc:504] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "020d12da25c44bc0b79c5ae648120f41" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 38815 } }
I20240503 08:02:09.589809 17669 leader_election.cc:302] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 020d12da25c44bc0b79c5ae648120f41; no voters:
I20240503 08:02:09.590107 17669 leader_election.cc:288] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:02:09.590204 17674 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:02:09.590412 17674 raft_consensus.cc:686] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41 [term 1 LEADER]: Becoming Leader. State: Replica: 020d12da25c44bc0b79c5ae648120f41, State: Running, Role: LEADER
I20240503 08:02:09.590946 17674 consensus_queue.cc:237] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "020d12da25c44bc0b79c5ae648120f41" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 38815 } }
I20240503 08:02:09.591187 17669 sys_catalog.cc:564] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41 [sys.catalog]: configured and running, proceeding with master startup.
I20240503 08:02:09.592450 17676 sys_catalog.cc:455] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 020d12da25c44bc0b79c5ae648120f41. Latest consensus state: current_term: 1 leader_uuid: "020d12da25c44bc0b79c5ae648120f41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "020d12da25c44bc0b79c5ae648120f41" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 38815 } } }
I20240503 08:02:09.592569 17676 sys_catalog.cc:458] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41 [sys.catalog]: This master's current role is: LEADER
I20240503 08:02:09.592835 17675 sys_catalog.cc:455] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "020d12da25c44bc0b79c5ae648120f41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "020d12da25c44bc0b79c5ae648120f41" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 38815 } } }
I20240503 08:02:09.592960 17683 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240503 08:02:09.592969 17675 sys_catalog.cc:458] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41 [sys.catalog]: This master's current role is: LEADER
I20240503 08:02:09.595829 17683 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240503 08:02:09.600831 17683 catalog_manager.cc:1347] Generated new cluster ID: e2cc2f3a640c49ab80881d77a051588f
I20240503 08:02:09.600916 17683 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240503 08:02:09.610210 17683 catalog_manager.cc:1370] Generated new certificate authority record
I20240503 08:02:09.611166 17683 catalog_manager.cc:1504] Loading token signing keys...
I20240503 08:02:09.631002 17683 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41: Generated new TSK 0
I20240503 08:02:09.631781 17683 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240503 08:02:09.638895 14718 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9G1ywP/build/debug/bin/kudu
/tmp/dist-test-task9G1ywP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.95.129:0
--local_ip_for_outbound_sockets=127.14.95.129
--webserver_interface=127.14.95.129
--webserver_port=0
--tserver_master_addrs=127.14.95.190:38815
--builtin_ntp_servers=127.14.95.148:45719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240503 08:02:09.753051 17693 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:02:09.753368 17693 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:02:09.753437 17693 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:02:09.757776 17693 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:02:09.757944 17693 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.95.129
I20240503 08:02:09.763252 17693 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.95.148:45719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.95.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.95.129
--webserver_port=0
--tserver_master_addrs=127.14.95.190:38815
--never_fsync=true
--heap_profile_path=/tmp/kudu.17693
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.95.129
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type DEBUG
built by None at 03 May 2024 07:43:15 UTC on 1a15035a6830
build id 101
I20240503 08:02:09.764429 17693 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:02:09.765676 17693 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:02:09.774097 17698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:09.774626 17699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:09.775467 17701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:02:09.776221 17693 server_base.cc:1034] running on GCE node
I20240503 08:02:09.776629 17693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:02:09.777252 17693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:02:09.778419 17693 hybrid_clock.cc:648] HybridClock initialized: now 1714723329778406 us; error 27 us; skew 500 ppm
I20240503 08:02:09.780455 17693 webserver.cc:460] Webserver started at http://127.14.95.129:33633/ using document root <none> and password file <none>
I20240503 08:02:09.781054 17693 fs_manager.cc:359] Metadata directory not provided
I20240503 08:02:09.781119 17693 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:02:09.781292 17693 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:02:09.782967 17693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-0/data/instance:
uuid: "5d46bba50f2f4f3c93d1f7b34ea38242"
format_stamp: "Formatted at 2024-05-03 08:02:09 on dist-test-slave-0z1c"
I20240503 08:02:09.783434 17693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-0/wal/instance:
uuid: "5d46bba50f2f4f3c93d1f7b34ea38242"
format_stamp: "Formatted at 2024-05-03 08:02:09 on dist-test-slave-0z1c"
I20240503 08:02:09.786862 17693 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20240503 08:02:09.789381 17707 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:09.790515 17693 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20240503 08:02:09.790638 17693 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-0/data,/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-0/wal
uuid: "5d46bba50f2f4f3c93d1f7b34ea38242"
format_stamp: "Formatted at 2024-05-03 08:02:09 on dist-test-slave-0z1c"
I20240503 08:02:09.790751 17693 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:02:09.802675 17693 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:02:09.803328 17693 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:02:09.803498 17693 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:02:09.804065 17693 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:02:09.804989 17693 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:02:09.805073 17693 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:09.805116 17693 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:02:09.805145 17693 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:09.813634 17693 rpc_server.cc:307] RPC server started. Bound to: 127.14.95.129:33965
I20240503 08:02:09.813656 17820 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.95.129:33965 every 8 connection(s)
I20240503 08:02:09.814623 17693 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-0/data/info.pb
I20240503 08:02:09.823387 17821 heartbeater.cc:347] Connected to a master server at 127.14.95.190:38815
I20240503 08:02:09.823622 17821 heartbeater.cc:464] Registering TS with master...
I20240503 08:02:09.824193 17821 heartbeater.cc:511] Master 127.14.95.190:38815 requested a full tablet report, sending...
I20240503 08:02:09.824718 14718 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9G1ywP/build/debug/bin/kudu as pid 17693
I20240503 08:02:09.824832 14718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-0/wal/instance
I20240503 08:02:09.825630 17633 ts_manager.cc:194] Registered new tserver with Master: 5d46bba50f2f4f3c93d1f7b34ea38242 (127.14.95.129:33965)
I20240503 08:02:09.826783 17633 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.95.129:36679
I20240503 08:02:09.826894 14718 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9G1ywP/build/debug/bin/kudu
/tmp/dist-test-task9G1ywP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.95.130:0
--local_ip_for_outbound_sockets=127.14.95.130
--webserver_interface=127.14.95.130
--webserver_port=0
--tserver_master_addrs=127.14.95.190:38815
--builtin_ntp_servers=127.14.95.148:45719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240503 08:02:09.935868 17824 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:02:09.936133 17824 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:02:09.936180 17824 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:02:09.939464 17824 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:02:09.939594 17824 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.95.130
I20240503 08:02:09.943607 17824 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.95.148:45719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.95.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.95.130
--webserver_port=0
--tserver_master_addrs=127.14.95.190:38815
--never_fsync=true
--heap_profile_path=/tmp/kudu.17824
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.95.130
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type DEBUG
built by None at 03 May 2024 07:43:15 UTC on 1a15035a6830
build id 101
I20240503 08:02:09.944664 17824 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:02:09.945932 17824 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:02:09.954939 17832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:09.955689 17829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:09.956517 17830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:02:09.957166 17824 server_base.cc:1034] running on GCE node
I20240503 08:02:09.957624 17824 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:02:09.958245 17824 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:02:09.959403 17824 hybrid_clock.cc:648] HybridClock initialized: now 1714723329959388 us; error 33 us; skew 500 ppm
I20240503 08:02:09.961524 17824 webserver.cc:460] Webserver started at http://127.14.95.130:38147/ using document root <none> and password file <none>
I20240503 08:02:09.962102 17824 fs_manager.cc:359] Metadata directory not provided
I20240503 08:02:09.962159 17824 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:02:09.962334 17824 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:02:09.964058 17824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-1/data/instance:
uuid: "ef62b4d05ed34560a5bc1c00327fabca"
format_stamp: "Formatted at 2024-05-03 08:02:09 on dist-test-slave-0z1c"
I20240503 08:02:09.964536 17824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-1/wal/instance:
uuid: "ef62b4d05ed34560a5bc1c00327fabca"
format_stamp: "Formatted at 2024-05-03 08:02:09 on dist-test-slave-0z1c"
I20240503 08:02:09.967905 17824 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20240503 08:02:09.970064 17838 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:09.971069 17824 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240503 08:02:09.971168 17824 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-1/data,/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-1/wal
uuid: "ef62b4d05ed34560a5bc1c00327fabca"
format_stamp: "Formatted at 2024-05-03 08:02:09 on dist-test-slave-0z1c"
I20240503 08:02:09.971259 17824 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:02:09.983916 17824 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:02:09.984591 17824 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:02:09.984752 17824 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:02:09.985350 17824 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:02:09.986289 17824 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:02:09.986343 17824 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:09.986393 17824 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:02:09.986421 17824 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:09.995028 17824 rpc_server.cc:307] RPC server started. Bound to: 127.14.95.130:39491
I20240503 08:02:09.995061 17951 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.95.130:39491 every 8 connection(s)
I20240503 08:02:09.996042 17824 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-1/data/info.pb
I20240503 08:02:10.002492 14718 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9G1ywP/build/debug/bin/kudu as pid 17824
I20240503 08:02:10.002615 14718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-1/wal/instance
I20240503 08:02:10.004915 17952 heartbeater.cc:347] Connected to a master server at 127.14.95.190:38815
I20240503 08:02:10.005173 17952 heartbeater.cc:464] Registering TS with master...
I20240503 08:02:10.005822 17952 heartbeater.cc:511] Master 127.14.95.190:38815 requested a full tablet report, sending...
I20240503 08:02:10.006783 17633 ts_manager.cc:194] Registered new tserver with Master: ef62b4d05ed34560a5bc1c00327fabca (127.14.95.130:39491)
I20240503 08:02:10.007354 17633 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.95.130:50069
I20240503 08:02:10.017051 14718 external_mini_cluster.cc:930] 2 TS(s) registered with all masters
I20240503 08:02:10.025383 14718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9G1ywP/build/debug/bin/kudu with pid 17824
I20240503 08:02:10.030740 14718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9G1ywP/build/debug/bin/kudu with pid 17602
I20240503 08:02:10.036712 14718 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9G1ywP/build/debug/bin/kudu
/tmp/dist-test-task9G1ywP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.95.190:38815
--webserver_interface=127.14.95.190
--webserver_port=43525
--builtin_ntp_servers=127.14.95.148:45719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.95.190:38815
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240503 08:02:10.147156 17960 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:02:10.147424 17960 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:02:10.147472 17960 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:02:10.150694 17960 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240503 08:02:10.150774 17960 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:02:10.150794 17960 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240503 08:02:10.150810 17960 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240503 08:02:10.154644 17960 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.95.148:45719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.14.95.190:38815
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.95.190:38815
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.95.190
--webserver_port=43525
--never_fsync=true
--heap_profile_path=/tmp/kudu.17960
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type DEBUG
built by None at 03 May 2024 07:43:15 UTC on 1a15035a6830
build id 101
I20240503 08:02:10.155578 17960 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:02:10.156734 17960 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:02:10.164798 17966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:10.165153 17968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:10.165746 17965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:02:10.166852 17960 server_base.cc:1034] running on GCE node
I20240503 08:02:10.167481 17960 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:02:10.168524 17960 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:02:10.169705 17960 hybrid_clock.cc:648] HybridClock initialized: now 1714723330169690 us; error 31 us; skew 500 ppm
I20240503 08:02:10.171742 17960 webserver.cc:460] Webserver started at http://127.14.95.190:43525/ using document root <none> and password file <none>
I20240503 08:02:10.172328 17960 fs_manager.cc:359] Metadata directory not provided
I20240503 08:02:10.172405 17960 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:02:10.176025 17960 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20240503 08:02:10.178469 17974 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:10.179613 17960 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240503 08:02:10.179761 17960 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/master-0/data,/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/master-0/wal
uuid: "020d12da25c44bc0b79c5ae648120f41"
format_stamp: "Formatted at 2024-05-03 08:02:09 on dist-test-slave-0z1c"
I20240503 08:02:10.180220 17960 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:02:10.199915 17960 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:02:10.200702 17960 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:02:10.200877 17960 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:02:10.208150 17960 rpc_server.cc:307] RPC server started. Bound to: 127.14.95.190:38815
I20240503 08:02:10.208158 18026 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.95.190:38815 every 8 connection(s)
I20240503 08:02:10.209318 17960 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/master-0/data/info.pb
I20240503 08:02:10.213300 18027 sys_catalog.cc:263] Verifying existing consensus state
I20240503 08:02:10.213519 14718 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9G1ywP/build/debug/bin/kudu as pid 17960
I20240503 08:02:10.215238 18027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41: Bootstrap starting.
I20240503 08:02:10.230018 18027 log.cc:824] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41: Log is configured to *not* fsync() on all Append() calls
I20240503 08:02:10.236284 18027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:02:10.236681 18027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41: Bootstrap complete.
I20240503 08:02:10.240160 18027 raft_consensus.cc:348] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "020d12da25c44bc0b79c5ae648120f41" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 38815 } }
I20240503 08:02:10.240502 18027 raft_consensus.cc:729] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 020d12da25c44bc0b79c5ae648120f41, State: Initialized, Role: FOLLOWER
I20240503 08:02:10.240936 18027 consensus_queue.cc:260] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "020d12da25c44bc0b79c5ae648120f41" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 38815 } }
I20240503 08:02:10.241078 18027 raft_consensus.cc:388] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:10.241142 18027 raft_consensus.cc:482] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:10.241261 18027 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:02:10.242833 18027 raft_consensus.cc:504] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "020d12da25c44bc0b79c5ae648120f41" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 38815 } }
I20240503 08:02:10.243144 18027 leader_election.cc:302] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 020d12da25c44bc0b79c5ae648120f41; no voters:
I20240503 08:02:10.243423 18027 leader_election.cc:288] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:02:10.243546 18032 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:02:10.243736 18032 raft_consensus.cc:686] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41 [term 2 LEADER]: Becoming Leader. State: Replica: 020d12da25c44bc0b79c5ae648120f41, State: Running, Role: LEADER
I20240503 08:02:10.244029 18032 consensus_queue.cc:237] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "020d12da25c44bc0b79c5ae648120f41" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 38815 } }
I20240503 08:02:10.244455 18027 sys_catalog.cc:564] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41 [sys.catalog]: configured and running, proceeding with master startup.
I20240503 08:02:10.245409 18034 sys_catalog.cc:455] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 020d12da25c44bc0b79c5ae648120f41. Latest consensus state: current_term: 2 leader_uuid: "020d12da25c44bc0b79c5ae648120f41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "020d12da25c44bc0b79c5ae648120f41" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 38815 } } }
I20240503 08:02:10.245545 18034 sys_catalog.cc:458] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41 [sys.catalog]: This master's current role is: LEADER
I20240503 08:02:10.245395 18033 sys_catalog.cc:455] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "020d12da25c44bc0b79c5ae648120f41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "020d12da25c44bc0b79c5ae648120f41" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 38815 } } }
I20240503 08:02:10.245687 18033 sys_catalog.cc:458] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41 [sys.catalog]: This master's current role is: LEADER
I20240503 08:02:10.246084 18041 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240503 08:02:10.249351 18041 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240503 08:02:10.249990 18041 catalog_manager.cc:1259] Loaded cluster ID: e2cc2f3a640c49ab80881d77a051588f
I20240503 08:02:10.250044 18041 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240503 08:02:10.251675 18041 catalog_manager.cc:1504] Loading token signing keys...
I20240503 08:02:10.252262 18041 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 020d12da25c44bc0b79c5ae648120f41: Loaded TSK: 0
I20240503 08:02:10.253263 18041 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240503 08:02:10.829066 17821 heartbeater.cc:503] Master 127.14.95.190:38815 was elected leader, sending a full tablet report...
I20240503 08:02:10.834261 17990 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "5d46bba50f2f4f3c93d1f7b34ea38242" instance_seqno: 1714723329811287) as {username='slave'} at 127.14.95.129:57119; Asking this server to re-register.
I20240503 08:02:10.834875 17821 heartbeater.cc:464] Registering TS with master...
I20240503 08:02:10.835062 17821 heartbeater.cc:511] Master 127.14.95.190:38815 requested a full tablet report, sending...
I20240503 08:02:10.836022 17990 ts_manager.cc:194] Registered new tserver with Master: 5d46bba50f2f4f3c93d1f7b34ea38242 (127.14.95.129:33965)
I20240503 08:02:10.845891 14718 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20240503 08:02:10.845980 14718 test_util.cc:268] Using random seed: 587590940
I20240503 08:02:10.862273 17990 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50428:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20240503 08:02:10.877462 17755 tablet_service.cc:1467] Processing CreateTablet for tablet 0279ff1a0aa543bc93e75e94bbe05d2e (DEFAULT_TABLE table=test-workload [id=242f45191578492f860fe5938bb805de]), partition=RANGE (key) PARTITION UNBOUNDED
I20240503 08:02:10.878338 17755 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0279ff1a0aa543bc93e75e94bbe05d2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:10.883405 18062 tablet_bootstrap.cc:492] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242: Bootstrap starting.
I20240503 08:02:10.885604 18062 tablet_bootstrap.cc:654] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242: Neither blocks nor log segments found. Creating new log.
I20240503 08:02:10.886305 18062 log.cc:824] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242: Log is configured to *not* fsync() on all Append() calls
I20240503 08:02:10.887940 18062 tablet_bootstrap.cc:492] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242: No bootstrap required, opened a new log
I20240503 08:02:10.888118 18062 ts_tablet_manager.cc:1367] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20240503 08:02:10.891192 18062 raft_consensus.cc:348] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d46bba50f2f4f3c93d1f7b34ea38242" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33965 } }
I20240503 08:02:10.891397 18062 raft_consensus.cc:374] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:02:10.891445 18062 raft_consensus.cc:729] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d46bba50f2f4f3c93d1f7b34ea38242, State: Initialized, Role: FOLLOWER
I20240503 08:02:10.891834 18062 consensus_queue.cc:260] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d46bba50f2f4f3c93d1f7b34ea38242" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33965 } }
I20240503 08:02:10.891966 18062 raft_consensus.cc:388] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:10.892030 18062 raft_consensus.cc:482] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:10.892135 18062 raft_consensus.cc:3037] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:02:10.892925 18062 raft_consensus.cc:504] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d46bba50f2f4f3c93d1f7b34ea38242" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33965 } }
I20240503 08:02:10.893273 18062 leader_election.cc:302] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5d46bba50f2f4f3c93d1f7b34ea38242; no voters:
I20240503 08:02:10.893566 18062 leader_election.cc:288] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:02:10.893699 18064 raft_consensus.cc:2781] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:02:10.893937 18064 raft_consensus.cc:686] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242 [term 1 LEADER]: Becoming Leader. State: Replica: 5d46bba50f2f4f3c93d1f7b34ea38242, State: Running, Role: LEADER
I20240503 08:02:10.894270 18064 consensus_queue.cc:237] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d46bba50f2f4f3c93d1f7b34ea38242" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33965 } }
I20240503 08:02:10.894476 18062 ts_tablet_manager.cc:1398] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20240503 08:02:10.898047 17990 catalog_manager.cc:5484] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d46bba50f2f4f3c93d1f7b34ea38242 (127.14.95.129). New cstate: current_term: 1 leader_uuid: "5d46bba50f2f4f3c93d1f7b34ea38242" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d46bba50f2f4f3c93d1f7b34ea38242" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33965 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:11.296015 14718 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9G1ywP/build/debug/bin/kudu
/tmp/dist-test-task9G1ywP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.95.130:39491
--local_ip_for_outbound_sockets=127.14.95.130
--tserver_master_addrs=127.14.95.190:38815
--webserver_port=38147
--webserver_interface=127.14.95.130
--builtin_ntp_servers=127.14.95.148:45719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240503 08:02:11.407014 18079 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:02:11.407255 18079 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:02:11.407301 18079 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:02:11.410521 18079 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:02:11.410651 18079 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.95.130
I20240503 08:02:11.414439 18079 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.95.148:45719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.95.130:39491
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.95.130
--webserver_port=38147
--tserver_master_addrs=127.14.95.190:38815
--never_fsync=true
--heap_profile_path=/tmp/kudu.18079
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.95.130
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type DEBUG
built by None at 03 May 2024 07:43:15 UTC on 1a15035a6830
build id 101
I20240503 08:02:11.415391 18079 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:02:11.416549 18079 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:02:11.425835 18084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:11.426578 18087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:11.427134 18085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:02:11.427788 18079 server_base.cc:1034] running on GCE node
I20240503 08:02:11.428260 18079 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:02:11.428889 18079 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:02:11.430058 18079 hybrid_clock.cc:648] HybridClock initialized: now 1714723331430024 us; error 59 us; skew 500 ppm
I20240503 08:02:11.432140 18079 webserver.cc:460] Webserver started at http://127.14.95.130:38147/ using document root <none> and password file <none>
I20240503 08:02:11.432750 18079 fs_manager.cc:359] Metadata directory not provided
I20240503 08:02:11.432828 18079 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:02:11.436316 18079 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20240503 08:02:11.438537 18093 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:11.439636 18079 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240503 08:02:11.439766 18079 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-1/data,/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-1/wal
uuid: "ef62b4d05ed34560a5bc1c00327fabca"
format_stamp: "Formatted at 2024-05-03 08:02:09 on dist-test-slave-0z1c"
I20240503 08:02:11.440196 18079 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:02:11.462040 18079 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:02:11.462738 18079 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:02:11.462921 18079 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:02:11.463476 18079 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:02:11.464458 18079 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:02:11.464510 18079 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:11.464566 18079 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:02:11.464593 18079 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:11.473227 18079 rpc_server.cc:307] RPC server started. Bound to: 127.14.95.130:39491
I20240503 08:02:11.473292 18206 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.95.130:39491 every 8 connection(s)
I20240503 08:02:11.474331 18079 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-1/data/info.pb
I20240503 08:02:11.481920 14718 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9G1ywP/build/debug/bin/kudu as pid 18079
I20240503 08:02:11.484150 18207 heartbeater.cc:347] Connected to a master server at 127.14.95.190:38815
I20240503 08:02:11.484411 18207 heartbeater.cc:464] Registering TS with master...
W20240503 08:02:11.484529 17815 generic_service.cc:139] {username='slave'} at 127.0.0.1:41884 forcing change of non-runtime-safe flag fault_crash_on_handle_tc_fetch_data
I20240503 08:02:11.484653 17815 generic_service.cc:175] {username='slave'} at 127.0.0.1:41884 changed flags via RPC: fault_crash_on_handle_tc_fetch_data from '0' to '1.0'
I20240503 08:02:11.485165 18207 heartbeater.cc:511] Master 127.14.95.190:38815 requested a full tablet report, sending...
I20240503 08:02:11.486289 17990 ts_manager.cc:194] Registered new tserver with Master: ef62b4d05ed34560a5bc1c00327fabca (127.14.95.130:39491)
I20240503 08:02:11.487260 17990 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.95.130:60013
I20240503 08:02:11.491415 18212 ts_tablet_manager.cc:902] T 0279ff1a0aa543bc93e75e94bbe05d2e P ef62b4d05ed34560a5bc1c00327fabca: Initiating tablet copy from peer 5d46bba50f2f4f3c93d1f7b34ea38242 (127.14.95.129:33965)
I20240503 08:02:11.492142 18212 tablet_copy_client.cc:308] T 0279ff1a0aa543bc93e75e94bbe05d2e P ef62b4d05ed34560a5bc1c00327fabca: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33965
I20240503 08:02:11.495793 17795 tablet_copy_service.cc:140] P 5d46bba50f2f4f3c93d1f7b34ea38242: Received BeginTabletCopySession request for tablet 0279ff1a0aa543bc93e75e94bbe05d2e from peer ef62b4d05ed34560a5bc1c00327fabca ({username='slave'} at 127.14.95.130:58837)
I20240503 08:02:11.495925 17795 tablet_copy_service.cc:161] P 5d46bba50f2f4f3c93d1f7b34ea38242: Beginning new tablet copy session on tablet 0279ff1a0aa543bc93e75e94bbe05d2e from peer ef62b4d05ed34560a5bc1c00327fabca at {username='slave'} at 127.14.95.130:58837: session id = ef62b4d05ed34560a5bc1c00327fabca-0279ff1a0aa543bc93e75e94bbe05d2e
I20240503 08:02:11.497107 17795 tablet_copy_source_session.cc:205] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:02:11.500084 18212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0279ff1a0aa543bc93e75e94bbe05d2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:11.506001 18212 tablet_copy_client.cc:783] T 0279ff1a0aa543bc93e75e94bbe05d2e P ef62b4d05ed34560a5bc1c00327fabca: tablet copy: Starting download of 0 data blocks...
I20240503 08:02:11.506214 18212 tablet_copy_client.cc:647] T 0279ff1a0aa543bc93e75e94bbe05d2e P ef62b4d05ed34560a5bc1c00327fabca: tablet copy: Starting download of 1 WAL segments...
W20240503 08:02:11.507306 17795 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20240503 08:02:11.507375 17795 fault_injection.cc:44] THIS SERVER MAY CRASH!
E20240503 08:02:11.507393 17795 fault_injection.cc:59] injecting fault for kudu (pid 17693): FLAGS_fault_crash_on_handle_tc_fetch_data (process will exit)
W20240503 08:02:11.512867 18212 ts_tablet_manager.cc:980] T 0279ff1a0aa543bc93e75e94bbe05d2e P ef62b4d05ed34560a5bc1c00327fabca: Tablet Copy: Unable to fetch data from remote peer 5d46bba50f2f4f3c93d1f7b34ea38242 (127.14.95.129:33965): Network error: Unable to download WAL segment with seq. number 1: unable to fetch data from remote: recv got EOF from 127.14.95.129:33965 (error 108)
I20240503 08:02:11.512962 18212 tablet_replica.cc:330] T 0279ff1a0aa543bc93e75e94bbe05d2e P ef62b4d05ed34560a5bc1c00327fabca: stopping tablet replica
I20240503 08:02:11.513147 18212 raft_consensus.cc:2229] T 0279ff1a0aa543bc93e75e94bbe05d2e P ef62b4d05ed34560a5bc1c00327fabca [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20240503 08:02:11.513267 18212 raft_consensus.cc:2258] T 0279ff1a0aa543bc93e75e94bbe05d2e P ef62b4d05ed34560a5bc1c00327fabca [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
W20240503 08:02:11.514083 18212 tablet_copy_client.cc:1107] T 0279ff1a0aa543bc93e75e94bbe05d2e P ef62b4d05ed34560a5bc1c00327fabca: tablet copy: Unable to close tablet copy session: Network error: failure ending tablet copy session: Client connection negotiation failed: client connection to 127.14.95.129:33965: connect: Connection refused (error 111)
W20240503 08:02:11.514681 18212 tablet_metadata.cc:474] failed to load DataDirGroup from superblock: Already present: tried to load directory group for tablet 0279ff1a0aa543bc93e75e94bbe05d2e but one is already registered
I20240503 08:02:11.514869 18212 ts_tablet_manager.cc:1875] T 0279ff1a0aa543bc93e75e94bbe05d2e P ef62b4d05ed34560a5bc1c00327fabca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 08:02:11.516669 18212 ts_tablet_manager.cc:1888] T 0279ff1a0aa543bc93e75e94bbe05d2e P ef62b4d05ed34560a5bc1c00327fabca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.0
I20240503 08:02:11.516764 18212 log.cc:1196] T 0279ff1a0aa543bc93e75e94bbe05d2e P ef62b4d05ed34560a5bc1c00327fabca: Deleting WAL directory at /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-1/wal/wals/0279ff1a0aa543bc93e75e94bbe05d2e
I20240503 08:02:11.519425 14718 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9G1ywP/build/debug/bin/kudu
/tmp/dist-test-task9G1ywP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.95.129:33965
--local_ip_for_outbound_sockets=127.14.95.129
--tserver_master_addrs=127.14.95.190:38815
--webserver_port=33633
--webserver_interface=127.14.95.129
--builtin_ntp_servers=127.14.95.148:45719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240503 08:02:11.629648 18217 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:02:11.629894 18217 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:02:11.629953 18217 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:02:11.633198 18217 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:02:11.633332 18217 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.95.129
I20240503 08:02:11.637259 18217 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.95.148:45719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.95.129:33965
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.95.129
--webserver_port=33633
--tserver_master_addrs=127.14.95.190:38815
--never_fsync=true
--heap_profile_path=/tmp/kudu.18217
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.95.129
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type DEBUG
built by None at 03 May 2024 07:43:15 UTC on 1a15035a6830
build id 101
I20240503 08:02:11.638278 18217 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:02:11.639456 18217 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:02:11.648626 18222 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:11.649178 18225 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:11.649490 18223 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:02:11.650569 18217 server_base.cc:1034] running on GCE node
I20240503 08:02:11.651002 18217 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:02:11.651644 18217 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:02:11.652827 18217 hybrid_clock.cc:648] HybridClock initialized: now 1714723331652806 us; error 34 us; skew 500 ppm
I20240503 08:02:11.654965 18217 webserver.cc:460] Webserver started at http://127.14.95.129:33633/ using document root <none> and password file <none>
I20240503 08:02:11.655539 18217 fs_manager.cc:359] Metadata directory not provided
I20240503 08:02:11.655615 18217 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:02:11.659090 18217 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20240503 08:02:11.661504 18231 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:11.662521 18217 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240503 08:02:11.662654 18217 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-0/data,/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-0/wal
uuid: "5d46bba50f2f4f3c93d1f7b34ea38242"
format_stamp: "Formatted at 2024-05-03 08:02:09 on dist-test-slave-0z1c"
I20240503 08:02:11.663061 18217 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:02:11.682758 18217 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:02:11.683459 18217 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:02:11.683641 18217 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:02:11.684187 18217 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:02:11.685477 18238 ts_tablet_manager.cc:516] Loading tablet metadata (0/1 complete)
I20240503 08:02:11.688529 18217 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240503 08:02:11.688594 18217 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.003s user 0.000s sys 0.000s
I20240503 08:02:11.688660 18217 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240503 08:02:11.690150 18217 ts_tablet_manager.cc:590] Registered 1 tablets
I20240503 08:02:11.690198 18217 ts_tablet_manager.cc:569] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20240503 08:02:11.690461 18238 tablet_bootstrap.cc:492] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242: Bootstrap starting.
I20240503 08:02:11.699569 18217 rpc_server.cc:307] RPC server started. Bound to: 127.14.95.129:33965
I20240503 08:02:11.699594 18345 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.95.129:33965 every 8 connection(s)
I20240503 08:02:11.700598 18217 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714723320929540-14718-0/minicluster-data/ts-0/data/info.pb
I20240503 08:02:11.705314 14718 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9G1ywP/build/debug/bin/kudu as pid 18217
I20240503 08:02:11.710940 18346 heartbeater.cc:347] Connected to a master server at 127.14.95.190:38815
I20240503 08:02:11.711201 18346 heartbeater.cc:464] Registering TS with master...
I20240503 08:02:11.711822 18346 heartbeater.cc:511] Master 127.14.95.190:38815 requested a full tablet report, sending...
I20240503 08:02:11.713761 17990 ts_manager.cc:194] Re-registered known tserver with Master: 5d46bba50f2f4f3c93d1f7b34ea38242 (127.14.95.129:33965)
I20240503 08:02:11.714504 17990 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.95.129:55061
I20240503 08:02:11.725212 18238 log.cc:824] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242: Log is configured to *not* fsync() on all Append() calls
I20240503 08:02:12.028367 18238 tablet_bootstrap.cc:492] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242: Bootstrap replayed 1/1 log segments. Stats: ops{read=212 overwritten=0 applied=212 ignored=0} inserts{seen=10550 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:02:12.028788 18238 tablet_bootstrap.cc:492] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242: Bootstrap complete.
I20240503 08:02:12.029840 18238 ts_tablet_manager.cc:1367] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242: Time spent bootstrapping tablet: real 0.340s user 0.318s sys 0.020s
I20240503 08:02:12.032223 18238 raft_consensus.cc:348] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d46bba50f2f4f3c93d1f7b34ea38242" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33965 } }
I20240503 08:02:12.032593 18238 raft_consensus.cc:729] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d46bba50f2f4f3c93d1f7b34ea38242, State: Initialized, Role: FOLLOWER
I20240503 08:02:12.033110 18238 consensus_queue.cc:260] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 212, Last appended: 1.212, Last appended by leader: 212, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d46bba50f2f4f3c93d1f7b34ea38242" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33965 } }
I20240503 08:02:12.033237 18238 raft_consensus.cc:388] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:12.033306 18238 raft_consensus.cc:482] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:12.033414 18238 raft_consensus.cc:3037] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:02:12.035158 18238 raft_consensus.cc:504] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d46bba50f2f4f3c93d1f7b34ea38242" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33965 } }
I20240503 08:02:12.035501 18238 leader_election.cc:302] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5d46bba50f2f4f3c93d1f7b34ea38242; no voters:
I20240503 08:02:12.035781 18238 leader_election.cc:288] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:02:12.035930 18351 raft_consensus.cc:2781] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:02:12.036166 18351 raft_consensus.cc:686] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242 [term 2 LEADER]: Becoming Leader. State: Replica: 5d46bba50f2f4f3c93d1f7b34ea38242, State: Running, Role: LEADER
I20240503 08:02:12.036392 18346 heartbeater.cc:503] Master 127.14.95.190:38815 was elected leader, sending a full tablet report...
I20240503 08:02:12.036625 18238 ts_tablet_manager.cc:1398] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20240503 08:02:12.036684 18351 consensus_queue.cc:237] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 212, Committed index: 212, Last appended: 1.212, Last appended by leader: 212, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d46bba50f2f4f3c93d1f7b34ea38242" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33965 } }
I20240503 08:02:12.039134 17990 catalog_manager.cc:5484] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "5d46bba50f2f4f3c93d1f7b34ea38242" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d46bba50f2f4f3c93d1f7b34ea38242" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33965 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:12.042593 18360 ts_tablet_manager.cc:902] T 0279ff1a0aa543bc93e75e94bbe05d2e P ef62b4d05ed34560a5bc1c00327fabca: Initiating tablet copy from peer 5d46bba50f2f4f3c93d1f7b34ea38242 (127.14.95.129:33965)
I20240503 08:02:12.043171 18360 tablet_copy_client.cc:308] T 0279ff1a0aa543bc93e75e94bbe05d2e P ef62b4d05ed34560a5bc1c00327fabca: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:33965
I20240503 08:02:12.047308 18320 tablet_copy_service.cc:140] P 5d46bba50f2f4f3c93d1f7b34ea38242: Received BeginTabletCopySession request for tablet 0279ff1a0aa543bc93e75e94bbe05d2e from peer ef62b4d05ed34560a5bc1c00327fabca ({username='slave'} at 127.14.95.130:48989)
I20240503 08:02:12.047498 18320 tablet_copy_service.cc:161] P 5d46bba50f2f4f3c93d1f7b34ea38242: Beginning new tablet copy session on tablet 0279ff1a0aa543bc93e75e94bbe05d2e from peer ef62b4d05ed34560a5bc1c00327fabca at {username='slave'} at 127.14.95.130:48989: session id = ef62b4d05ed34560a5bc1c00327fabca-0279ff1a0aa543bc93e75e94bbe05d2e
I20240503 08:02:12.048571 18320 tablet_copy_source_session.cc:205] T 0279ff1a0aa543bc93e75e94bbe05d2e P 5d46bba50f2f4f3c93d1f7b34ea38242: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:02:12.049751 18360 ts_tablet_manager.cc:1875] T 0279ff1a0aa543bc93e75e94bbe05d2e P ef62b4d05ed34560a5bc1c00327fabca: Deleting tablet data with delete state TABLET_DATA_COPYING
I20240503 08:02:12.051642 18360 ts_tablet_manager.cc:1888] T 0279ff1a0aa543bc93e75e94bbe05d2e P ef62b4d05ed34560a5bc1c00327fabca: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.0
I20240503 08:02:12.051822 18360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0279ff1a0aa543bc93e75e94bbe05d2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:12.052778 18360 tablet_copy_client.cc:783] T 0279ff1a0aa543bc93e75e94bbe05d2e P ef62b4d05ed34560a5bc1c00327fabca: tablet copy: Starting download of 0 data blocks...
I20240503 08:02:12.052893 18360 tablet_copy_client.cc:647] T 0279ff1a0aa543bc93e75e94bbe05d2e P ef62b4d05ed34560a5bc1c00327fabca: tablet copy: Starting download of 1 WAL segments...
I20240503 08:02:12.057358 18360 tablet_copy_client.cc:523] T 0279ff1a0aa543bc93e75e94bbe05d2e P ef62b4d05ed34560a5bc1c00327fabca: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:02:12.058844 18360 tablet_bootstrap.cc:492] T 0279ff1a0aa543bc93e75e94bbe05d2e P ef62b4d05ed34560a5bc1c00327fabca: Bootstrap starting.
I20240503 08:02:12.080842 18360 log.cc:824] T 0279ff1a0aa543bc93e75e94bbe05d2e P ef62b4d05ed34560a5bc1c00327fabca: Log is configured to *not* fsync() on all Append() calls
I20240503 08:02:12.383601 18360 tablet_bootstrap.cc:492] T 0279ff1a0aa543bc93e75e94bbe05d2e P ef62b4d05ed34560a5bc1c00327fabca: Bootstrap replayed 1/1 log segments. Stats: ops{read=213 overwritten=0 applied=213 ignored=0} inserts{seen=10550 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:02:12.383915 18360 tablet_bootstrap.cc:492] T 0279ff1a0aa543bc93e75e94bbe05d2e P ef62b4d05ed34560a5bc1c00327fabca: Bootstrap complete.
I20240503 08:02:12.384308 18360 ts_tablet_manager.cc:1367] T 0279ff1a0aa543bc93e75e94bbe05d2e P ef62b4d05ed34560a5bc1c00327fabca: Time spent bootstrapping tablet: real 0.326s user 0.303s sys 0.020s
I20240503 08:02:12.386914 18360 raft_consensus.cc:348] T 0279ff1a0aa543bc93e75e94bbe05d2e P ef62b4d05ed34560a5bc1c00327fabca [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d46bba50f2f4f3c93d1f7b34ea38242" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33965 } }
I20240503 08:02:12.387135 18360 raft_consensus.cc:729] T 0279ff1a0aa543bc93e75e94bbe05d2e P ef62b4d05ed34560a5bc1c00327fabca [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: ef62b4d05ed34560a5bc1c00327fabca, State: Initialized, Role: NON_PARTICIPANT
I20240503 08:02:12.387462 18360 consensus_queue.cc:260] T 0279ff1a0aa543bc93e75e94bbe05d2e P ef62b4d05ed34560a5bc1c00327fabca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 213, Last appended: 2.213, Last appended by leader: 213, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d46bba50f2f4f3c93d1f7b34ea38242" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 33965 } }
I20240503 08:02:12.388175 18207 heartbeater.cc:503] Master 127.14.95.190:38815 was elected leader, sending a full tablet report...
I20240503 08:02:12.388254 18360 ts_tablet_manager.cc:1398] T 0279ff1a0aa543bc93e75e94bbe05d2e P ef62b4d05ed34560a5bc1c00327fabca: Time spent starting tablet: real 0.004s user 0.007s sys 0.000s
I20240503 08:02:12.388979 18320 tablet_copy_service.cc:342] P 5d46bba50f2f4f3c93d1f7b34ea38242: Request end of tablet copy session ef62b4d05ed34560a5bc1c00327fabca-0279ff1a0aa543bc93e75e94bbe05d2e received from {username='slave'} at 127.14.95.130:48989
I20240503 08:02:12.389117 18320 tablet_copy_service.cc:433] P 5d46bba50f2f4f3c93d1f7b34ea38242: ending tablet copy session ef62b4d05ed34560a5bc1c00327fabca-0279ff1a0aa543bc93e75e94bbe05d2e on tablet 0279ff1a0aa543bc93e75e94bbe05d2e with peer ef62b4d05ed34560a5bc1c00327fabca
I20240503 08:02:12.395830 14718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9G1ywP/build/debug/bin/kudu with pid 18217
I20240503 08:02:12.401249 14718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9G1ywP/build/debug/bin/kudu with pid 18079
I20240503 08:02:12.406070 14718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9G1ywP/build/debug/bin/kudu with pid 17960
2024-05-03T08:02:12Z chronyd exiting
[ OK ] TabletCopyClientSessionITest.TestCopyFromCrashedSource (3014 ms)
[ RUN ] TabletCopyClientSessionITest.TestTabletCopyWithBusySource
2024-05-03T08:02:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-03T08:02:12Z Disabled control of system clock
I20240503 08:02:12.422544 14718 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9G1ywP/build/debug/bin/kudu
/tmp/dist-test-task9G1ywP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.95.190:46841
--webserver_interface=127.14.95.190
--webserver_port=0
--builtin_ntp_servers=127.14.95.148:36621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.95.190:46841
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240503 08:02:12.528638 18371 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:02:12.528892 18371 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:02:12.528932 18371 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:02:12.532040 18371 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240503 08:02:12.532109 18371 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:02:12.532128 18371 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240503 08:02:12.532145 18371 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240503 08:02:12.535954 18371 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.95.148:36621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.14.95.190:46841
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.95.190:46841
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.95.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.18371
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type DEBUG
built by None at 03 May 2024 07:43:15 UTC on 1a15035a6830
build id 101
I20240503 08:02:12.536857 18371 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:02:12.537986 18371 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:02:12.545642 18376 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:12.546437 18379 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:12.547091 18377 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:02:12.547772 18371 server_base.cc:1034] running on GCE node
I20240503 08:02:12.548314 18371 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:02:12.549310 18371 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:02:12.550477 18371 hybrid_clock.cc:648] HybridClock initialized: now 1714723332550451 us; error 43 us; skew 500 ppm
I20240503 08:02:12.552477 18371 webserver.cc:460] Webserver started at http://127.14.95.190:44699/ using document root <none> and password file <none>
I20240503 08:02:12.553072 18371 fs_manager.cc:359] Metadata directory not provided
I20240503 08:02:12.553138 18371 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:02:12.553320 18371 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:02:12.556102 18371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/master-0/data/instance:
uuid: "1aca7c165c2a40f3b3d1f5da6ca98c53"
format_stamp: "Formatted at 2024-05-03 08:02:12 on dist-test-slave-0z1c"
I20240503 08:02:12.556563 18371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/master-0/wal/instance:
uuid: "1aca7c165c2a40f3b3d1f5da6ca98c53"
format_stamp: "Formatted at 2024-05-03 08:02:12 on dist-test-slave-0z1c"
I20240503 08:02:12.559901 18371 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20240503 08:02:12.562101 18385 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:12.563107 18371 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240503 08:02:12.563225 18371 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/master-0/data,/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/master-0/wal
uuid: "1aca7c165c2a40f3b3d1f5da6ca98c53"
format_stamp: "Formatted at 2024-05-03 08:02:12 on dist-test-slave-0z1c"
I20240503 08:02:12.563310 18371 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:02:12.577069 18371 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:02:12.577759 18371 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:02:12.577925 18371 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:02:12.584530 18371 rpc_server.cc:307] RPC server started. Bound to: 127.14.95.190:46841
I20240503 08:02:12.584539 18437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.95.190:46841 every 8 connection(s)
I20240503 08:02:12.585616 18371 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/master-0/data/info.pb
I20240503 08:02:12.587455 14718 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9G1ywP/build/debug/bin/kudu as pid 18371
I20240503 08:02:12.587589 14718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/master-0/wal/instance
I20240503 08:02:12.588558 18438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:12.594199 18438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53: Bootstrap starting.
I20240503 08:02:12.596422 18438 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53: Neither blocks nor log segments found. Creating new log.
I20240503 08:02:12.597141 18438 log.cc:824] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53: Log is configured to *not* fsync() on all Append() calls
I20240503 08:02:12.598865 18438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53: No bootstrap required, opened a new log
I20240503 08:02:12.601794 18438 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aca7c165c2a40f3b3d1f5da6ca98c53" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 46841 } }
I20240503 08:02:12.601987 18438 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:02:12.602030 18438 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1aca7c165c2a40f3b3d1f5da6ca98c53, State: Initialized, Role: FOLLOWER
I20240503 08:02:12.602414 18438 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aca7c165c2a40f3b3d1f5da6ca98c53" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 46841 } }
I20240503 08:02:12.602540 18438 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:12.602577 18438 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:12.602671 18438 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:02:12.603525 18438 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aca7c165c2a40f3b3d1f5da6ca98c53" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 46841 } }
I20240503 08:02:12.603834 18438 leader_election.cc:302] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1aca7c165c2a40f3b3d1f5da6ca98c53; no voters:
I20240503 08:02:12.604094 18438 leader_election.cc:288] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:02:12.604483 18443 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:02:12.604676 18443 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53 [term 1 LEADER]: Becoming Leader. State: Replica: 1aca7c165c2a40f3b3d1f5da6ca98c53, State: Running, Role: LEADER
I20240503 08:02:12.604931 18443 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aca7c165c2a40f3b3d1f5da6ca98c53" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 46841 } }
I20240503 08:02:12.605216 18438 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53 [sys.catalog]: configured and running, proceeding with master startup.
I20240503 08:02:12.606330 18444 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1aca7c165c2a40f3b3d1f5da6ca98c53" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aca7c165c2a40f3b3d1f5da6ca98c53" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 46841 } } }
I20240503 08:02:12.606441 18444 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53 [sys.catalog]: This master's current role is: LEADER
I20240503 08:02:12.606813 18452 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240503 08:02:12.607623 18445 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1aca7c165c2a40f3b3d1f5da6ca98c53. Latest consensus state: current_term: 1 leader_uuid: "1aca7c165c2a40f3b3d1f5da6ca98c53" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aca7c165c2a40f3b3d1f5da6ca98c53" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 46841 } } }
I20240503 08:02:12.607710 18445 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53 [sys.catalog]: This master's current role is: LEADER
I20240503 08:02:12.609717 18452 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240503 08:02:12.615023 18452 catalog_manager.cc:1347] Generated new cluster ID: babe532d1ad34e55aeaa5fc5c1fffc24
I20240503 08:02:12.615096 18452 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240503 08:02:12.621361 18452 catalog_manager.cc:1370] Generated new certificate authority record
I20240503 08:02:12.622300 18452 catalog_manager.cc:1504] Loading token signing keys...
I20240503 08:02:12.627640 18452 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53: Generated new TSK 0
I20240503 08:02:12.628458 18452 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240503 08:02:12.631724 14718 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9G1ywP/build/debug/bin/kudu
/tmp/dist-test-task9G1ywP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.95.129:0
--local_ip_for_outbound_sockets=127.14.95.129
--webserver_interface=127.14.95.129
--webserver_port=0
--tserver_master_addrs=127.14.95.190:46841
--builtin_ntp_servers=127.14.95.148:36621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=20 with env {}
W20240503 08:02:12.741448 18462 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:02:12.741703 18462 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:02:12.741753 18462 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:02:12.745113 18462 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:02:12.745249 18462 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.95.129
I20240503 08:02:12.749274 18462 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.95.148:36621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.95.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.95.129
--webserver_port=0
--tserver_master_addrs=127.14.95.190:46841
--num_tablets_to_copy_simultaneously=20
--never_fsync=true
--heap_profile_path=/tmp/kudu.18462
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.95.129
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type DEBUG
built by None at 03 May 2024 07:43:15 UTC on 1a15035a6830
build id 101
I20240503 08:02:12.750283 18462 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:02:12.751489 18462 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:02:12.760457 18467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:12.760987 18470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:12.761817 18468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:02:12.762560 18462 server_base.cc:1034] running on GCE node
I20240503 08:02:12.763046 18462 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:02:12.763751 18462 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:02:12.764931 18462 hybrid_clock.cc:648] HybridClock initialized: now 1714723332764913 us; error 31 us; skew 500 ppm
I20240503 08:02:12.767004 18462 webserver.cc:460] Webserver started at http://127.14.95.129:46191/ using document root <none> and password file <none>
I20240503 08:02:12.767562 18462 fs_manager.cc:359] Metadata directory not provided
I20240503 08:02:12.767630 18462 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:02:12.767805 18462 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:02:12.769510 18462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-0/data/instance:
uuid: "230ccce6f4884106bafadcba4f2643f7"
format_stamp: "Formatted at 2024-05-03 08:02:12 on dist-test-slave-0z1c"
I20240503 08:02:12.769938 18462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-0/wal/instance:
uuid: "230ccce6f4884106bafadcba4f2643f7"
format_stamp: "Formatted at 2024-05-03 08:02:12 on dist-test-slave-0z1c"
I20240503 08:02:12.773286 18462 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20240503 08:02:12.775516 18476 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:12.776588 18462 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240503 08:02:12.776693 18462 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-0/data,/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-0/wal
uuid: "230ccce6f4884106bafadcba4f2643f7"
format_stamp: "Formatted at 2024-05-03 08:02:12 on dist-test-slave-0z1c"
I20240503 08:02:12.776788 18462 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:02:12.792778 18462 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:02:12.793449 18462 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:02:12.793622 18462 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:02:12.794169 18462 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:02:12.795075 18462 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:02:12.795121 18462 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:12.795161 18462 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:02:12.795189 18462 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:12.803709 18462 rpc_server.cc:307] RPC server started. Bound to: 127.14.95.129:43581
I20240503 08:02:12.803735 18589 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.95.129:43581 every 8 connection(s)
I20240503 08:02:12.804698 18462 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-0/data/info.pb
I20240503 08:02:12.807593 14718 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9G1ywP/build/debug/bin/kudu as pid 18462
I20240503 08:02:12.807709 14718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-0/wal/instance
I20240503 08:02:12.810215 14718 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9G1ywP/build/debug/bin/kudu
/tmp/dist-test-task9G1ywP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.95.130:0
--local_ip_for_outbound_sockets=127.14.95.130
--webserver_interface=127.14.95.130
--webserver_port=0
--tserver_master_addrs=127.14.95.190:46841
--builtin_ntp_servers=127.14.95.148:36621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=20 with env {}
I20240503 08:02:12.814517 18590 heartbeater.cc:347] Connected to a master server at 127.14.95.190:46841
I20240503 08:02:12.814805 18590 heartbeater.cc:464] Registering TS with master...
I20240503 08:02:12.815508 18590 heartbeater.cc:511] Master 127.14.95.190:46841 requested a full tablet report, sending...
I20240503 08:02:12.817119 18402 ts_manager.cc:194] Registered new tserver with Master: 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129:43581)
I20240503 08:02:12.818281 18402 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.95.129:48959
W20240503 08:02:12.919093 18593 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:02:12.919328 18593 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:02:12.919376 18593 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:02:12.922618 18593 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:02:12.922755 18593 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.95.130
I20240503 08:02:12.926551 18593 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.95.148:36621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.95.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.95.130
--webserver_port=0
--tserver_master_addrs=127.14.95.190:46841
--num_tablets_to_copy_simultaneously=20
--never_fsync=true
--heap_profile_path=/tmp/kudu.18593
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.95.130
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type DEBUG
built by None at 03 May 2024 07:43:15 UTC on 1a15035a6830
build id 101
I20240503 08:02:12.927495 18593 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:02:12.928678 18593 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:02:12.937399 18598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:12.937985 18601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:12.938845 18599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:02:12.939637 18593 server_base.cc:1034] running on GCE node
I20240503 08:02:12.940119 18593 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:02:12.940761 18593 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:02:12.941956 18593 hybrid_clock.cc:648] HybridClock initialized: now 1714723332941944 us; error 39 us; skew 500 ppm
I20240503 08:02:12.944092 18593 webserver.cc:460] Webserver started at http://127.14.95.130:33415/ using document root <none> and password file <none>
I20240503 08:02:12.944692 18593 fs_manager.cc:359] Metadata directory not provided
I20240503 08:02:12.944756 18593 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:02:12.944938 18593 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:02:12.946781 18593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-1/data/instance:
uuid: "5a05e724fe074ff1aba23f9f6996d51c"
format_stamp: "Formatted at 2024-05-03 08:02:12 on dist-test-slave-0z1c"
I20240503 08:02:12.947289 18593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-1/wal/instance:
uuid: "5a05e724fe074ff1aba23f9f6996d51c"
format_stamp: "Formatted at 2024-05-03 08:02:12 on dist-test-slave-0z1c"
I20240503 08:02:12.950999 18593 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20240503 08:02:12.953389 18607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:12.954425 18593 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240503 08:02:12.954545 18593 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-1/data,/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-1/wal
uuid: "5a05e724fe074ff1aba23f9f6996d51c"
format_stamp: "Formatted at 2024-05-03 08:02:12 on dist-test-slave-0z1c"
I20240503 08:02:12.954669 18593 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:02:12.982946 18593 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:02:12.983613 18593 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:02:12.983801 18593 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:02:12.984357 18593 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:02:12.985329 18593 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:02:12.985379 18593 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:12.985435 18593 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:02:12.985461 18593 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:12.994022 18593 rpc_server.cc:307] RPC server started. Bound to: 127.14.95.130:41103
I20240503 08:02:12.994055 18720 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.95.130:41103 every 8 connection(s)
I20240503 08:02:12.995035 18593 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-1/data/info.pb
I20240503 08:02:12.997105 14718 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9G1ywP/build/debug/bin/kudu as pid 18593
I20240503 08:02:12.997220 14718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-1/wal/instance
I20240503 08:02:13.004323 18721 heartbeater.cc:347] Connected to a master server at 127.14.95.190:46841
I20240503 08:02:13.004616 18721 heartbeater.cc:464] Registering TS with master...
I20240503 08:02:13.005270 18721 heartbeater.cc:511] Master 127.14.95.190:46841 requested a full tablet report, sending...
I20240503 08:02:13.006489 18402 ts_manager.cc:194] Registered new tserver with Master: 5a05e724fe074ff1aba23f9f6996d51c (127.14.95.130:41103)
I20240503 08:02:13.007120 18402 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.95.130:35015
I20240503 08:02:13.012071 14718 external_mini_cluster.cc:930] 2 TS(s) registered with all masters
I20240503 08:02:13.020164 14718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9G1ywP/build/debug/bin/kudu with pid 18593
I20240503 08:02:13.025153 14718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9G1ywP/build/debug/bin/kudu with pid 18371
I20240503 08:02:13.030903 14718 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9G1ywP/build/debug/bin/kudu
/tmp/dist-test-task9G1ywP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.95.190:46841
--webserver_interface=127.14.95.190
--webserver_port=44699
--builtin_ntp_servers=127.14.95.148:36621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.95.190:46841
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240503 08:02:13.140446 18729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:02:13.140697 18729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:02:13.140753 18729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:02:13.143842 18729 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240503 08:02:13.143913 18729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:02:13.143939 18729 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240503 08:02:13.143963 18729 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240503 08:02:13.147753 18729 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.95.148:36621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.14.95.190:46841
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.95.190:46841
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.95.190
--webserver_port=44699
--never_fsync=true
--heap_profile_path=/tmp/kudu.18729
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type DEBUG
built by None at 03 May 2024 07:43:15 UTC on 1a15035a6830
build id 101
I20240503 08:02:13.148731 18729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:02:13.149919 18729 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:02:13.157471 18737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:13.158082 18735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:13.158628 18734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:02:13.159534 18729 server_base.cc:1034] running on GCE node
I20240503 08:02:13.160073 18729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:02:13.161070 18729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:02:13.162262 18729 hybrid_clock.cc:648] HybridClock initialized: now 1714723333162241 us; error 41 us; skew 500 ppm
I20240503 08:02:13.164188 18729 webserver.cc:460] Webserver started at http://127.14.95.190:44699/ using document root <none> and password file <none>
I20240503 08:02:13.164741 18729 fs_manager.cc:359] Metadata directory not provided
I20240503 08:02:13.164819 18729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:02:13.168359 18729 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20240503 08:02:13.170568 18743 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:13.171743 18729 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240503 08:02:13.171867 18729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/master-0/data,/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/master-0/wal
uuid: "1aca7c165c2a40f3b3d1f5da6ca98c53"
format_stamp: "Formatted at 2024-05-03 08:02:12 on dist-test-slave-0z1c"
I20240503 08:02:13.172297 18729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:02:13.210144 18729 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:02:13.210855 18729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:02:13.211025 18729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:02:13.217777 18729 rpc_server.cc:307] RPC server started. Bound to: 127.14.95.190:46841
I20240503 08:02:13.217784 18795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.95.190:46841 every 8 connection(s)
I20240503 08:02:13.218941 18729 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/master-0/data/info.pb
I20240503 08:02:13.223141 18796 sys_catalog.cc:263] Verifying existing consensus state
I20240503 08:02:13.224664 18796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53: Bootstrap starting.
I20240503 08:02:13.226619 14718 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9G1ywP/build/debug/bin/kudu as pid 18729
I20240503 08:02:13.239583 18796 log.cc:824] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53: Log is configured to *not* fsync() on all Append() calls
I20240503 08:02:13.245388 18796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:02:13.245754 18796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53: Bootstrap complete.
I20240503 08:02:13.249289 18796 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aca7c165c2a40f3b3d1f5da6ca98c53" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 46841 } }
I20240503 08:02:13.249740 18796 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1aca7c165c2a40f3b3d1f5da6ca98c53, State: Initialized, Role: FOLLOWER
I20240503 08:02:13.250195 18796 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aca7c165c2a40f3b3d1f5da6ca98c53" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 46841 } }
I20240503 08:02:13.250316 18796 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:13.250376 18796 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:13.250478 18796 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:02:13.252151 18796 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aca7c165c2a40f3b3d1f5da6ca98c53" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 46841 } }
I20240503 08:02:13.252503 18796 leader_election.cc:302] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1aca7c165c2a40f3b3d1f5da6ca98c53; no voters:
I20240503 08:02:13.252785 18796 leader_election.cc:288] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:02:13.252898 18801 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:02:13.253119 18801 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53 [term 2 LEADER]: Becoming Leader. State: Replica: 1aca7c165c2a40f3b3d1f5da6ca98c53, State: Running, Role: LEADER
I20240503 08:02:13.253497 18801 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aca7c165c2a40f3b3d1f5da6ca98c53" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 46841 } }
I20240503 08:02:13.253872 18796 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53 [sys.catalog]: configured and running, proceeding with master startup.
I20240503 08:02:13.254874 18802 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "1aca7c165c2a40f3b3d1f5da6ca98c53" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aca7c165c2a40f3b3d1f5da6ca98c53" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 46841 } } }
I20240503 08:02:13.255033 18802 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53 [sys.catalog]: This master's current role is: LEADER
I20240503 08:02:13.254874 18803 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1aca7c165c2a40f3b3d1f5da6ca98c53. Latest consensus state: current_term: 2 leader_uuid: "1aca7c165c2a40f3b3d1f5da6ca98c53" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aca7c165c2a40f3b3d1f5da6ca98c53" member_type: VOTER last_known_addr { host: "127.14.95.190" port: 46841 } } }
I20240503 08:02:13.255429 18803 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53 [sys.catalog]: This master's current role is: LEADER
I20240503 08:02:13.255491 18810 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240503 08:02:13.258152 18810 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240503 08:02:13.258826 18810 catalog_manager.cc:1259] Loaded cluster ID: babe532d1ad34e55aeaa5fc5c1fffc24
I20240503 08:02:13.258878 18810 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240503 08:02:13.260708 18810 catalog_manager.cc:1504] Loading token signing keys...
I20240503 08:02:13.261380 18810 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1aca7c165c2a40f3b3d1f5da6ca98c53: Loaded TSK: 0
I20240503 08:02:13.262432 18810 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240503 08:02:13.820945 18590 heartbeater.cc:503] Master 127.14.95.190:46841 was elected leader, sending a full tablet report...
I20240503 08:02:13.825482 18760 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" instance_seqno: 1714723332801420) as {username='slave'} at 127.14.95.129:56903; Asking this server to re-register.
I20240503 08:02:13.826054 18590 heartbeater.cc:464] Registering TS with master...
I20240503 08:02:13.826220 18590 heartbeater.cc:511] Master 127.14.95.190:46841 requested a full tablet report, sending...
I20240503 08:02:13.827139 18760 ts_manager.cc:194] Registered new tserver with Master: 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129:43581)
I20240503 08:02:13.831216 14718 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20240503 08:02:13.831307 14718 test_util.cc:268] Using random seed: 590576267
I20240503 08:02:13.842021 18760 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35122:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "<redacted>""\004\001\000fff\006\004\001\000\314\314\314\014\004\001\000233\023\004\001\000\230\231\231\031\004\001\000\376\377\377\037\004\001\000dff&\004\001\000\312\314\314,\004\001\0000333\004\001\000\226\231\2319\004\001\000\374\377\377?\004\001\000bffF\004\001\000\310\314\314L\004\001\000.33S\004\001\000\224\231\231Y\004\001\000\372\377\377_\004\001\000`fff\004\001\000\306\314\314l\004\001\000,33s\004\001\000\222\231\231y"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20240503 08:02:13.862931 18509 tablet_service.cc:1467] Processing CreateTablet for tablet a504df8c6d7748f3a69a2ff947278f01 (DEFAULT_TABLE table=test-workload [id=4096562ca34248b9b2d9537b805b0016]), partition=RANGE (key) PARTITION 1610612730 <= VALUES < 1717986912
I20240503 08:02:13.863735 18522 tablet_service.cc:1467] Processing CreateTablet for tablet 1fce17000ee743faa8292d031a6bc9d7 (DEFAULT_TABLE table=test-workload [id=4096562ca34248b9b2d9537b805b0016]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 322122546
I20240503 08:02:13.863873 18508 tablet_service.cc:1467] Processing CreateTablet for tablet 4c9560832a4443e49e0be3b51feb4c35 (DEFAULT_TABLE table=test-workload [id=4096562ca34248b9b2d9537b805b0016]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1825361094
I20240503 08:02:13.864025 18520 tablet_service.cc:1467] Processing CreateTablet for tablet 8469e7783a644fa6bce033ee936573ab (DEFAULT_TABLE table=test-workload [id=4096562ca34248b9b2d9537b805b0016]), partition=RANGE (key) PARTITION 322122546 <= VALUES < 429496728
I20240503 08:02:13.862931 18516 tablet_service.cc:1467] Processing CreateTablet for tablet 8059190ad08f4675a4c5b67554d5ccf7 (DEFAULT_TABLE table=test-workload [id=4096562ca34248b9b2d9537b805b0016]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 966367638
I20240503 08:02:13.862973 18524 tablet_service.cc:1467] Processing CreateTablet for tablet 6acf2a0111884ee0b3e16e8230f906d5 (DEFAULT_TABLE table=test-workload [id=4096562ca34248b9b2d9537b805b0016]), partition=RANGE (key) PARTITION VALUES < 107374182
I20240503 08:02:13.862931 18515 tablet_service.cc:1467] Processing CreateTablet for tablet 2969eb2e9bf042b3b74de0931fd4512a (DEFAULT_TABLE table=test-workload [id=4096562ca34248b9b2d9537b805b0016]), partition=RANGE (key) PARTITION 966367638 <= VALUES < 1073741820
I20240503 08:02:13.864347 18505 tablet_service.cc:1467] Processing CreateTablet for tablet cfbac30e5c164eed8b87d92516612668 (DEFAULT_TABLE table=test-workload [id=4096562ca34248b9b2d9537b805b0016]), partition=RANGE (key) PARTITION 2040109458 <= VALUES
I20240503 08:02:13.864451 18514 tablet_service.cc:1467] Processing CreateTablet for tablet 2dbb77573e7541d4be6260c0d29c6668 (DEFAULT_TABLE table=test-workload [id=4096562ca34248b9b2d9537b805b0016]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1181116002
I20240503 08:02:13.863878 18521 tablet_service.cc:1467] Processing CreateTablet for tablet c8382412e13c4e25a852cad2d7bdc7ed (DEFAULT_TABLE table=test-workload [id=4096562ca34248b9b2d9537b805b0016]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 536870910
I20240503 08:02:13.864713 18510 tablet_service.cc:1467] Processing CreateTablet for tablet 5f447883016e4eeb94762f46df482dd9 (DEFAULT_TABLE table=test-workload [id=4096562ca34248b9b2d9537b805b0016]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1610612730
I20240503 08:02:13.863477 18518 tablet_service.cc:1467] Processing CreateTablet for tablet 947514e951cd4cfd8a9ecf315d113b94 (DEFAULT_TABLE table=test-workload [id=4096562ca34248b9b2d9537b805b0016]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 751619274
I20240503 08:02:13.864889 18507 tablet_service.cc:1467] Processing CreateTablet for tablet 2c6c74c1c01d42069114483dc4c0f6dc (DEFAULT_TABLE table=test-workload [id=4096562ca34248b9b2d9537b805b0016]), partition=RANGE (key) PARTITION 1825361094 <= VALUES < 1932735276
I20240503 08:02:13.863627 18519 tablet_service.cc:1467] Processing CreateTablet for tablet 21bd3b312b2c4a65b174cf60e87ecd22 (DEFAULT_TABLE table=test-workload [id=4096562ca34248b9b2d9537b805b0016]), partition=RANGE (key) PARTITION 536870910 <= VALUES < 644245092
I20240503 08:02:13.864637 18506 tablet_service.cc:1467] Processing CreateTablet for tablet 3db4892cd70f44e3a4cc40694a76a49d (DEFAULT_TABLE table=test-workload [id=4096562ca34248b9b2d9537b805b0016]), partition=RANGE (key) PARTITION 1932735276 <= VALUES < 2040109458
I20240503 08:02:13.863463 18511 tablet_service.cc:1467] Processing CreateTablet for tablet d158e8ecf4be4efba22cf094608766b7 (DEFAULT_TABLE table=test-workload [id=4096562ca34248b9b2d9537b805b0016]), partition=RANGE (key) PARTITION 1395864366 <= VALUES < 1503238548
I20240503 08:02:13.863124 18512 tablet_service.cc:1467] Processing CreateTablet for tablet 91d074cc385a4e2b8472275b83306411 (DEFAULT_TABLE table=test-workload [id=4096562ca34248b9b2d9537b805b0016]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1395864366
I20240503 08:02:13.863104 18517 tablet_service.cc:1467] Processing CreateTablet for tablet 3bff92f43b554c36aea44162bc8771cf (DEFAULT_TABLE table=test-workload [id=4096562ca34248b9b2d9537b805b0016]), partition=RANGE (key) PARTITION 751619274 <= VALUES < 858993456
I20240503 08:02:13.864351 18508 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c9560832a4443e49e0be3b51feb4c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:13.865466 18516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8059190ad08f4675a4c5b67554d5ccf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:13.865504 18523 tablet_service.cc:1467] Processing CreateTablet for tablet f72081e606b4476797b8aa85659243aa (DEFAULT_TABLE table=test-workload [id=4096562ca34248b9b2d9537b805b0016]), partition=RANGE (key) PARTITION 107374182 <= VALUES < 214748364
I20240503 08:02:13.865620 18522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1fce17000ee743faa8292d031a6bc9d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:13.865873 18505 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfbac30e5c164eed8b87d92516612668. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:13.866241 18520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8469e7783a644fa6bce033ee936573ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:13.866390 18524 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6acf2a0111884ee0b3e16e8230f906d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:13.866519 18518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 947514e951cd4cfd8a9ecf315d113b94. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:13.862931 18513 tablet_service.cc:1467] Processing CreateTablet for tablet efcad07bfa894e0c9c839b5ffb23bce4 (DEFAULT_TABLE table=test-workload [id=4096562ca34248b9b2d9537b805b0016]), partition=RANGE (key) PARTITION 1181116002 <= VALUES < 1288490184
I20240503 08:02:13.866673 18509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a504df8c6d7748f3a69a2ff947278f01. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:13.866799 18514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2dbb77573e7541d4be6260c0d29c6668. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:13.867064 18521 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8382412e13c4e25a852cad2d7bdc7ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:13.867200 18515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2969eb2e9bf042b3b74de0931fd4512a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:13.869163 18507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c6c74c1c01d42069114483dc4c0f6dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:13.872512 18506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3db4892cd70f44e3a4cc40694a76a49d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:13.873724 18510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f447883016e4eeb94762f46df482dd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:13.874451 18831 tablet_bootstrap.cc:492] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:13.875262 18517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bff92f43b554c36aea44162bc8771cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:13.875388 18511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d158e8ecf4be4efba22cf094608766b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:13.876541 18831 tablet_bootstrap.cc:654] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7: Neither blocks nor log segments found. Creating new log.
I20240503 08:02:13.877211 18512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91d074cc385a4e2b8472275b83306411. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:13.877358 18831 log.cc:824] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7: Log is configured to *not* fsync() on all Append() calls
I20240503 08:02:13.877420 18519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21bd3b312b2c4a65b174cf60e87ecd22. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:13.878315 18513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efcad07bfa894e0c9c839b5ffb23bce4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:13.878988 18523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f72081e606b4476797b8aa85659243aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:13.882678 18831 tablet_bootstrap.cc:492] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7: No bootstrap required, opened a new log
I20240503 08:02:13.882906 18831 ts_tablet_manager.cc:1367] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20240503 08:02:13.885715 18831 raft_consensus.cc:348] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.885901 18831 raft_consensus.cc:374] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:02:13.885934 18831 raft_consensus.cc:729] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:13.886327 18831 consensus_queue.cc:260] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.886442 18831 raft_consensus.cc:388] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:13.886504 18831 raft_consensus.cc:482] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:13.886603 18831 raft_consensus.cc:3037] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:02:13.887373 18831 raft_consensus.cc:504] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.887722 18831 leader_election.cc:302] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:13.888000 18831 leader_election.cc:288] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:02:13.888180 18833 raft_consensus.cc:2781] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:02:13.888376 18833 raft_consensus.cc:686] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7 [term 1 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:13.888661 18833 consensus_queue.cc:237] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.889173 18831 ts_tablet_manager.cc:1398] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20240503 08:02:13.889401 18831 tablet_bootstrap.cc:492] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:13.890415 18831 tablet_bootstrap.cc:654] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7: Neither blocks nor log segments found. Creating new log.
I20240503 08:02:13.891458 18831 tablet_bootstrap.cc:492] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7: No bootstrap required, opened a new log
I20240503 08:02:13.891530 18831 ts_tablet_manager.cc:1367] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:02:13.891991 18831 raft_consensus.cc:348] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.892081 18831 raft_consensus.cc:374] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:02:13.892102 18831 raft_consensus.cc:729] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:13.892216 18831 consensus_queue.cc:260] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.892284 18831 raft_consensus.cc:388] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:13.892306 18831 raft_consensus.cc:482] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:13.892350 18831 raft_consensus.cc:3037] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:02:13.892287 18760 catalog_manager.cc:5484] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129). New cstate: current_term: 1 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:13.893107 18831 raft_consensus.cc:504] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.893239 18831 leader_election.cc:302] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:13.893329 18831 leader_election.cc:288] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:02:13.893518 18831 ts_tablet_manager.cc:1398] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240503 08:02:13.893674 18831 tablet_bootstrap.cc:492] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:13.893927 18833 raft_consensus.cc:2781] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:02:13.894014 18833 raft_consensus.cc:686] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7 [term 1 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:13.894129 18833 consensus_queue.cc:237] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.894595 18831 tablet_bootstrap.cc:654] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7: Neither blocks nor log segments found. Creating new log.
I20240503 08:02:13.895609 18831 tablet_bootstrap.cc:492] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7: No bootstrap required, opened a new log
I20240503 08:02:13.895684 18831 ts_tablet_manager.cc:1367] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20240503 08:02:13.896049 18831 raft_consensus.cc:348] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.896139 18831 raft_consensus.cc:374] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:02:13.896178 18831 raft_consensus.cc:729] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:13.896284 18831 consensus_queue.cc:260] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.896348 18831 raft_consensus.cc:388] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:13.896381 18831 raft_consensus.cc:482] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:13.896421 18831 raft_consensus.cc:3037] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:02:13.896718 18760 catalog_manager.cc:5484] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129). New cstate: current_term: 1 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:13.897138 18831 raft_consensus.cc:504] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.897258 18831 leader_election.cc:302] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:13.897343 18831 leader_election.cc:288] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:02:13.897459 18835 raft_consensus.cc:2781] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:02:13.897553 18831 ts_tablet_manager.cc:1398] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240503 08:02:13.897643 18835 raft_consensus.cc:686] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7 [term 1 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:13.897697 18831 tablet_bootstrap.cc:492] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:13.897756 18835 consensus_queue.cc:237] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.898502 18831 tablet_bootstrap.cc:654] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7: Neither blocks nor log segments found. Creating new log.
I20240503 08:02:13.899781 18831 tablet_bootstrap.cc:492] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7: No bootstrap required, opened a new log
I20240503 08:02:13.899850 18831 ts_tablet_manager.cc:1367] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20240503 08:02:13.899771 18760 catalog_manager.cc:5484] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129). New cstate: current_term: 1 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:13.900197 18831 raft_consensus.cc:348] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.900271 18831 raft_consensus.cc:374] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:02:13.900300 18831 raft_consensus.cc:729] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:13.900414 18831 consensus_queue.cc:260] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.900483 18831 raft_consensus.cc:388] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:13.900522 18831 raft_consensus.cc:482] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:13.900568 18831 raft_consensus.cc:3037] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:02:13.901429 18831 raft_consensus.cc:504] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.901558 18831 leader_election.cc:302] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:13.901672 18831 leader_election.cc:288] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:02:13.901746 18835 raft_consensus.cc:2781] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:02:13.901854 18835 raft_consensus.cc:686] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7 [term 1 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:13.901885 18831 ts_tablet_manager.cc:1398] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:02:13.902015 18835 consensus_queue.cc:237] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.902088 18831 tablet_bootstrap.cc:492] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:13.902962 18831 tablet_bootstrap.cc:654] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7: Neither blocks nor log segments found. Creating new log.
I20240503 08:02:13.903404 18760 catalog_manager.cc:5484] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129). New cstate: current_term: 1 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:13.904178 18831 tablet_bootstrap.cc:492] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7: No bootstrap required, opened a new log
I20240503 08:02:13.904268 18831 ts_tablet_manager.cc:1367] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:02:13.904621 18831 raft_consensus.cc:348] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.904716 18831 raft_consensus.cc:374] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:02:13.904757 18831 raft_consensus.cc:729] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:13.904866 18831 consensus_queue.cc:260] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.904950 18831 raft_consensus.cc:388] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:13.904989 18831 raft_consensus.cc:482] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:13.905059 18831 raft_consensus.cc:3037] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:02:13.905916 18831 raft_consensus.cc:504] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.906028 18831 leader_election.cc:302] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:13.906113 18831 leader_election.cc:288] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:02:13.906224 18833 raft_consensus.cc:2781] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:02:13.906297 18831 ts_tablet_manager.cc:1398] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:02:13.906322 18833 raft_consensus.cc:686] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7 [term 1 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:13.906430 18831 tablet_bootstrap.cc:492] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:13.906446 18833 consensus_queue.cc:237] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.907259 18831 tablet_bootstrap.cc:654] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7: Neither blocks nor log segments found. Creating new log.
I20240503 08:02:13.908063 18760 catalog_manager.cc:5484] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129). New cstate: current_term: 1 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:13.908293 18831 tablet_bootstrap.cc:492] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7: No bootstrap required, opened a new log
I20240503 08:02:13.908370 18831 ts_tablet_manager.cc:1367] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:02:13.908855 18831 raft_consensus.cc:348] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.908946 18831 raft_consensus.cc:374] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:02:13.908980 18831 raft_consensus.cc:729] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:13.909116 18831 consensus_queue.cc:260] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.909190 18831 raft_consensus.cc:388] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:13.909220 18831 raft_consensus.cc:482] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:13.909269 18831 raft_consensus.cc:3037] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:02:13.910072 18831 raft_consensus.cc:504] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.910176 18831 leader_election.cc:302] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:13.910262 18831 leader_election.cc:288] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:02:13.910303 18835 raft_consensus.cc:2781] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:02:13.910393 18835 raft_consensus.cc:686] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7 [term 1 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:13.910488 18831 ts_tablet_manager.cc:1398] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:02:13.910498 18835 consensus_queue.cc:237] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.910650 18831 tablet_bootstrap.cc:492] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:13.911511 18831 tablet_bootstrap.cc:654] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7: Neither blocks nor log segments found. Creating new log.
I20240503 08:02:13.911804 18760 catalog_manager.cc:5484] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129). New cstate: current_term: 1 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:13.912730 18831 tablet_bootstrap.cc:492] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7: No bootstrap required, opened a new log
I20240503 08:02:13.912817 18831 ts_tablet_manager.cc:1367] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:02:13.913295 18831 raft_consensus.cc:348] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.913386 18831 raft_consensus.cc:374] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:02:13.913416 18831 raft_consensus.cc:729] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:13.913586 18831 consensus_queue.cc:260] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.913678 18831 raft_consensus.cc:388] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:13.913717 18831 raft_consensus.cc:482] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:13.913761 18831 raft_consensus.cc:3037] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:02:13.914537 18831 raft_consensus.cc:504] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.914670 18831 leader_election.cc:302] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:13.914749 18831 leader_election.cc:288] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:02:13.914860 18833 raft_consensus.cc:2781] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:02:13.914937 18833 raft_consensus.cc:686] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7 [term 1 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:13.914958 18831 ts_tablet_manager.cc:1398] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:02:13.915048 18833 consensus_queue.cc:237] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.915093 18831 tablet_bootstrap.cc:492] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:13.915925 18831 tablet_bootstrap.cc:654] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7: Neither blocks nor log segments found. Creating new log.
I20240503 08:02:13.916292 18760 catalog_manager.cc:5484] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129). New cstate: current_term: 1 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:13.916846 18831 tablet_bootstrap.cc:492] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7: No bootstrap required, opened a new log
I20240503 08:02:13.916929 18831 ts_tablet_manager.cc:1367] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:02:13.917366 18831 raft_consensus.cc:348] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.917444 18831 raft_consensus.cc:374] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:02:13.917467 18831 raft_consensus.cc:729] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:13.917568 18831 consensus_queue.cc:260] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.917651 18831 raft_consensus.cc:388] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:13.917683 18831 raft_consensus.cc:482] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:13.917727 18831 raft_consensus.cc:3037] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:02:13.918414 18831 raft_consensus.cc:504] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.918515 18831 leader_election.cc:302] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:13.918582 18831 leader_election.cc:288] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:02:13.918665 18834 raft_consensus.cc:2781] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:02:13.918736 18834 raft_consensus.cc:686] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7 [term 1 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:13.918790 18831 ts_tablet_manager.cc:1398] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240503 08:02:13.918838 18834 consensus_queue.cc:237] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.918932 18831 tablet_bootstrap.cc:492] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:13.919708 18831 tablet_bootstrap.cc:654] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7: Neither blocks nor log segments found. Creating new log.
I20240503 08:02:13.920212 18760 catalog_manager.cc:5484] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129). New cstate: current_term: 1 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:13.920655 18831 tablet_bootstrap.cc:492] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7: No bootstrap required, opened a new log
I20240503 08:02:13.920737 18831 ts_tablet_manager.cc:1367] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:02:13.921165 18831 raft_consensus.cc:348] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.921240 18831 raft_consensus.cc:374] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:02:13.921262 18831 raft_consensus.cc:729] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:13.921370 18831 consensus_queue.cc:260] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.921437 18831 raft_consensus.cc:388] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:13.921475 18831 raft_consensus.cc:482] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:13.921519 18831 raft_consensus.cc:3037] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:02:13.922514 18831 raft_consensus.cc:504] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.922670 18831 leader_election.cc:302] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:13.922775 18831 leader_election.cc:288] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:02:13.922834 18834 raft_consensus.cc:2781] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:02:13.922899 18834 raft_consensus.cc:686] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7 [term 1 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:13.922994 18831 ts_tablet_manager.cc:1398] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:02:13.922993 18834 consensus_queue.cc:237] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.923188 18831 tablet_bootstrap.cc:492] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:13.924036 18831 tablet_bootstrap.cc:654] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7: Neither blocks nor log segments found. Creating new log.
I20240503 08:02:13.924710 18760 catalog_manager.cc:5484] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129). New cstate: current_term: 1 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:13.925093 18831 tablet_bootstrap.cc:492] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7: No bootstrap required, opened a new log
I20240503 08:02:13.925165 18831 ts_tablet_manager.cc:1367] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:02:13.925673 18831 raft_consensus.cc:348] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.925779 18831 raft_consensus.cc:374] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:02:13.925808 18831 raft_consensus.cc:729] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:13.925908 18831 consensus_queue.cc:260] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.925987 18831 raft_consensus.cc:388] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:13.926021 18831 raft_consensus.cc:482] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:13.926065 18831 raft_consensus.cc:3037] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:02:13.926927 18831 raft_consensus.cc:504] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.927050 18831 leader_election.cc:302] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:13.927137 18831 leader_election.cc:288] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:02:13.927175 18834 raft_consensus.cc:2781] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:02:13.927251 18834 raft_consensus.cc:686] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7 [term 1 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:13.927359 18831 ts_tablet_manager.cc:1398] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240503 08:02:13.927356 18834 consensus_queue.cc:237] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.927561 18831 tablet_bootstrap.cc:492] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:13.928411 18831 tablet_bootstrap.cc:654] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7: Neither blocks nor log segments found. Creating new log.
I20240503 08:02:13.928761 18760 catalog_manager.cc:5484] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129). New cstate: current_term: 1 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:13.929517 18831 tablet_bootstrap.cc:492] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7: No bootstrap required, opened a new log
I20240503 08:02:13.929589 18831 ts_tablet_manager.cc:1367] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:02:13.929965 18831 raft_consensus.cc:348] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.930063 18831 raft_consensus.cc:374] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:02:13.930096 18831 raft_consensus.cc:729] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:13.930207 18831 consensus_queue.cc:260] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.930291 18831 raft_consensus.cc:388] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:13.930330 18831 raft_consensus.cc:482] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:13.930373 18831 raft_consensus.cc:3037] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:02:13.931196 18831 raft_consensus.cc:504] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.931319 18831 leader_election.cc:302] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:13.931419 18831 leader_election.cc:288] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:02:13.931478 18834 raft_consensus.cc:2781] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:02:13.931576 18834 raft_consensus.cc:686] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7 [term 1 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:13.931643 18831 ts_tablet_manager.cc:1398] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240503 08:02:13.931675 18834 consensus_queue.cc:237] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.931766 18831 tablet_bootstrap.cc:492] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:13.932642 18831 tablet_bootstrap.cc:654] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7: Neither blocks nor log segments found. Creating new log.
I20240503 08:02:13.933372 18760 catalog_manager.cc:5484] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129). New cstate: current_term: 1 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:13.933791 18831 tablet_bootstrap.cc:492] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7: No bootstrap required, opened a new log
I20240503 08:02:13.933858 18831 ts_tablet_manager.cc:1367] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:02:13.934175 18831 raft_consensus.cc:348] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.934253 18831 raft_consensus.cc:374] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:02:13.934275 18831 raft_consensus.cc:729] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:13.934370 18831 consensus_queue.cc:260] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.934435 18831 raft_consensus.cc:388] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:13.934458 18831 raft_consensus.cc:482] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:13.934487 18831 raft_consensus.cc:3037] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:02:13.935266 18831 raft_consensus.cc:504] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.935381 18831 leader_election.cc:302] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:13.935467 18831 leader_election.cc:288] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:02:13.935515 18834 raft_consensus.cc:2781] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:02:13.935607 18834 raft_consensus.cc:686] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7 [term 1 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:13.935705 18831 ts_tablet_manager.cc:1398] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:02:13.935711 18834 consensus_queue.cc:237] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.935882 18831 tablet_bootstrap.cc:492] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:13.936756 18831 tablet_bootstrap.cc:654] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7: Neither blocks nor log segments found. Creating new log.
I20240503 08:02:13.937237 18760 catalog_manager.cc:5484] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129). New cstate: current_term: 1 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:13.937853 18831 tablet_bootstrap.cc:492] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7: No bootstrap required, opened a new log
I20240503 08:02:13.937924 18831 ts_tablet_manager.cc:1367] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:02:13.938259 18831 raft_consensus.cc:348] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.938341 18831 raft_consensus.cc:374] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:02:13.938370 18831 raft_consensus.cc:729] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:13.938493 18831 consensus_queue.cc:260] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.938575 18831 raft_consensus.cc:388] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:13.938613 18831 raft_consensus.cc:482] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:13.938655 18831 raft_consensus.cc:3037] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:02:13.939682 18831 raft_consensus.cc:504] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.939815 18831 leader_election.cc:302] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:13.939910 18831 leader_election.cc:288] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:02:13.939954 18834 raft_consensus.cc:2781] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:02:13.940049 18834 raft_consensus.cc:686] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7 [term 1 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:13.940133 18831 ts_tablet_manager.cc:1398] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240503 08:02:13.940153 18834 consensus_queue.cc:237] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.940282 18831 tablet_bootstrap.cc:492] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:13.941190 18831 tablet_bootstrap.cc:654] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7: Neither blocks nor log segments found. Creating new log.
I20240503 08:02:13.941851 18760 catalog_manager.cc:5484] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129). New cstate: current_term: 1 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:13.942229 18831 tablet_bootstrap.cc:492] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7: No bootstrap required, opened a new log
I20240503 08:02:13.942296 18831 ts_tablet_manager.cc:1367] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:02:13.942698 18831 raft_consensus.cc:348] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.942803 18831 raft_consensus.cc:374] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:02:13.942838 18831 raft_consensus.cc:729] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:13.942947 18831 consensus_queue.cc:260] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.943024 18831 raft_consensus.cc:388] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:13.943071 18831 raft_consensus.cc:482] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:13.943140 18831 raft_consensus.cc:3037] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:02:13.943809 18831 raft_consensus.cc:504] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.943934 18831 leader_election.cc:302] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:13.944038 18831 leader_election.cc:288] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:02:13.944078 18834 raft_consensus.cc:2781] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:02:13.944162 18834 raft_consensus.cc:686] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7 [term 1 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:13.944249 18831 ts_tablet_manager.cc:1398] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:02:13.944273 18834 consensus_queue.cc:237] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.944396 18831 tablet_bootstrap.cc:492] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:13.945302 18831 tablet_bootstrap.cc:654] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7: Neither blocks nor log segments found. Creating new log.
I20240503 08:02:13.945506 18760 catalog_manager.cc:5484] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129). New cstate: current_term: 1 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:13.946388 18831 tablet_bootstrap.cc:492] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7: No bootstrap required, opened a new log
I20240503 08:02:13.946466 18831 ts_tablet_manager.cc:1367] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:02:13.946878 18831 raft_consensus.cc:348] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.946954 18831 raft_consensus.cc:374] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:02:13.946980 18831 raft_consensus.cc:729] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:13.947084 18831 consensus_queue.cc:260] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.947145 18831 raft_consensus.cc:388] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:13.947178 18831 raft_consensus.cc:482] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:13.947224 18831 raft_consensus.cc:3037] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:02:13.947940 18831 raft_consensus.cc:504] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.948050 18831 leader_election.cc:302] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:13.948137 18831 leader_election.cc:288] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:02:13.948194 18833 raft_consensus.cc:2781] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:02:13.948299 18833 raft_consensus.cc:686] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7 [term 1 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:13.948437 18831 ts_tablet_manager.cc:1398] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:02:13.948401 18833 consensus_queue.cc:237] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.948585 18831 tablet_bootstrap.cc:492] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:13.949590 18831 tablet_bootstrap.cc:654] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7: Neither blocks nor log segments found. Creating new log.
I20240503 08:02:13.949935 18760 catalog_manager.cc:5484] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129). New cstate: current_term: 1 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:13.950539 18831 tablet_bootstrap.cc:492] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7: No bootstrap required, opened a new log
I20240503 08:02:13.950623 18831 ts_tablet_manager.cc:1367] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:02:13.951207 18831 raft_consensus.cc:348] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.951284 18831 raft_consensus.cc:374] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:02:13.951304 18831 raft_consensus.cc:729] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:13.951426 18831 consensus_queue.cc:260] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.951493 18831 raft_consensus.cc:388] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:13.951522 18831 raft_consensus.cc:482] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:13.951566 18831 raft_consensus.cc:3037] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:02:13.952265 18831 raft_consensus.cc:504] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.952374 18831 leader_election.cc:302] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:13.952453 18831 leader_election.cc:288] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:02:13.952512 18833 raft_consensus.cc:2781] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:02:13.952602 18833 raft_consensus.cc:686] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7 [term 1 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:13.952679 18831 ts_tablet_manager.cc:1398] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:02:13.952698 18833 consensus_queue.cc:237] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.952816 18831 tablet_bootstrap.cc:492] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:13.954035 18760 catalog_manager.cc:5484] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129). New cstate: current_term: 1 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:13.977257 18831 tablet_bootstrap.cc:654] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7: Neither blocks nor log segments found. Creating new log.
I20240503 08:02:13.978900 18831 tablet_bootstrap.cc:492] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7: No bootstrap required, opened a new log
I20240503 08:02:13.979013 18831 ts_tablet_manager.cc:1367] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.000s
I20240503 08:02:13.979480 18831 raft_consensus.cc:348] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.979583 18831 raft_consensus.cc:374] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:02:13.979604 18831 raft_consensus.cc:729] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:13.979725 18831 consensus_queue.cc:260] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.979804 18831 raft_consensus.cc:388] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:13.979836 18831 raft_consensus.cc:482] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:13.979882 18831 raft_consensus.cc:3037] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:02:13.980685 18831 raft_consensus.cc:504] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.980820 18831 leader_election.cc:302] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:13.980924 18831 leader_election.cc:288] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:02:13.980979 18833 raft_consensus.cc:2781] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:02:13.981105 18833 raft_consensus.cc:686] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7 [term 1 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:13.981182 18831 ts_tablet_manager.cc:1398] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240503 08:02:13.981220 18833 consensus_queue.cc:237] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.981338 18831 tablet_bootstrap.cc:492] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:13.982318 18831 tablet_bootstrap.cc:654] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7: Neither blocks nor log segments found. Creating new log.
I20240503 08:02:13.982848 18760 catalog_manager.cc:5484] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129). New cstate: current_term: 1 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:13.983237 18831 tablet_bootstrap.cc:492] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7: No bootstrap required, opened a new log
I20240503 08:02:13.983309 18831 ts_tablet_manager.cc:1367] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:02:13.983652 18831 raft_consensus.cc:348] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.983716 18831 raft_consensus.cc:374] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:02:13.983734 18831 raft_consensus.cc:729] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:13.983842 18831 consensus_queue.cc:260] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.983925 18831 raft_consensus.cc:388] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:13.983964 18831 raft_consensus.cc:482] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:13.984010 18831 raft_consensus.cc:3037] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:02:13.984783 18831 raft_consensus.cc:504] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.984911 18831 leader_election.cc:302] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:13.985035 18831 leader_election.cc:288] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:02:13.985146 18834 raft_consensus.cc:2781] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:02:13.985219 18834 raft_consensus.cc:686] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7 [term 1 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:13.985324 18834 consensus_queue.cc:237] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.985888 18831 ts_tablet_manager.cc:1398] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20240503 08:02:13.986096 18831 tablet_bootstrap.cc:492] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:13.987088 18831 tablet_bootstrap.cc:654] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7: Neither blocks nor log segments found. Creating new log.
I20240503 08:02:13.987021 18760 catalog_manager.cc:5484] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129). New cstate: current_term: 1 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:13.988106 18831 tablet_bootstrap.cc:492] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7: No bootstrap required, opened a new log
I20240503 08:02:13.988183 18831 ts_tablet_manager.cc:1367] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20240503 08:02:13.988533 18831 raft_consensus.cc:348] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.988626 18831 raft_consensus.cc:374] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:02:13.988668 18831 raft_consensus.cc:729] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:13.988802 18831 consensus_queue.cc:260] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.988889 18831 raft_consensus.cc:388] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:13.988929 18831 raft_consensus.cc:482] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:13.988968 18831 raft_consensus.cc:3037] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:02:13.989630 18831 raft_consensus.cc:504] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.989742 18831 leader_election.cc:302] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:13.989846 18831 leader_election.cc:288] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:02:13.989892 18835 raft_consensus.cc:2781] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:02:13.989979 18835 raft_consensus.cc:686] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7 [term 1 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:13.990069 18831 ts_tablet_manager.cc:1398] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:02:13.990084 18835 consensus_queue.cc:237] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.990267 18831 tablet_bootstrap.cc:492] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:13.991305 18831 tablet_bootstrap.cc:654] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7: Neither blocks nor log segments found. Creating new log.
I20240503 08:02:13.992252 18831 tablet_bootstrap.cc:492] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7: No bootstrap required, opened a new log
I20240503 08:02:13.992327 18831 ts_tablet_manager.cc:1367] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:02:13.992695 18831 raft_consensus.cc:348] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.992784 18831 raft_consensus.cc:374] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:02:13.992811 18831 raft_consensus.cc:729] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:13.992919 18831 consensus_queue.cc:260] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.992980 18831 raft_consensus.cc:388] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:13.993048 18831 raft_consensus.cc:482] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:13.993095 18831 raft_consensus.cc:3037] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:02:13.993113 18760 catalog_manager.cc:5484] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129). New cstate: current_term: 1 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:13.993870 18831 raft_consensus.cc:504] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.993996 18831 leader_election.cc:302] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:13.994083 18831 leader_election.cc:288] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:02:13.994146 18835 raft_consensus.cc:2781] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:02:13.994220 18835 raft_consensus.cc:686] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7 [term 1 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:13.994359 18831 ts_tablet_manager.cc:1398] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:02:13.994333 18835 consensus_queue.cc:237] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:13.996268 18760 catalog_manager.cc:5484] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129). New cstate: current_term: 1 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:16.036391 14718 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9G1ywP/build/debug/bin/kudu
/tmp/dist-test-task9G1ywP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.95.130:41103
--local_ip_for_outbound_sockets=127.14.95.130
--tserver_master_addrs=127.14.95.190:46841
--webserver_port=33415
--webserver_interface=127.14.95.130
--builtin_ntp_servers=127.14.95.148:36621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=20 with env {}
W20240503 08:02:16.146471 18919 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:02:16.146726 18919 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:02:16.146790 18919 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:02:16.149955 18919 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:02:16.150105 18919 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.95.130
I20240503 08:02:16.153822 18919 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.95.148:36621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.95.130:41103
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.95.130
--webserver_port=33415
--tserver_master_addrs=127.14.95.190:46841
--num_tablets_to_copy_simultaneously=20
--never_fsync=true
--heap_profile_path=/tmp/kudu.18919
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.95.130
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type DEBUG
built by None at 03 May 2024 07:43:15 UTC on 1a15035a6830
build id 101
I20240503 08:02:16.154798 18919 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:02:16.155930 18919 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:02:16.164361 18924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:16.164844 18927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:16.166054 18925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:02:16.166868 18919 server_base.cc:1034] running on GCE node
I20240503 08:02:16.167806 18919 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:02:16.168414 18919 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:02:16.169574 18919 hybrid_clock.cc:648] HybridClock initialized: now 1714723336169549 us; error 44 us; skew 500 ppm
I20240503 08:02:16.171702 18919 webserver.cc:460] Webserver started at http://127.14.95.130:33415/ using document root <none> and password file <none>
I20240503 08:02:16.172279 18919 fs_manager.cc:359] Metadata directory not provided
I20240503 08:02:16.172350 18919 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:02:16.176048 18919 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20240503 08:02:16.178303 18933 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:16.179461 18919 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240503 08:02:16.179579 18919 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-1/data,/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-1/wal
uuid: "5a05e724fe074ff1aba23f9f6996d51c"
format_stamp: "Formatted at 2024-05-03 08:02:12 on dist-test-slave-0z1c"
I20240503 08:02:16.180011 18919 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:02:16.195737 18919 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:02:16.196367 18919 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:02:16.196548 18919 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:02:16.197131 18919 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:02:16.198042 18919 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:02:16.198091 18919 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:16.198143 18919 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:02:16.198168 18919 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:16.207003 18919 rpc_server.cc:307] RPC server started. Bound to: 127.14.95.130:41103
I20240503 08:02:16.207031 19046 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.95.130:41103 every 8 connection(s)
I20240503 08:02:16.208182 18919 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-1/data/info.pb
I20240503 08:02:16.212385 14718 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9G1ywP/build/debug/bin/kudu as pid 18919
I20240503 08:02:16.213212 14718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9G1ywP/build/debug/bin/kudu with pid 18462
I20240503 08:02:16.218523 19047 heartbeater.cc:347] Connected to a master server at 127.14.95.190:46841
I20240503 08:02:16.218801 19047 heartbeater.cc:464] Registering TS with master...
I20240503 08:02:16.219449 19047 heartbeater.cc:511] Master 127.14.95.190:46841 requested a full tablet report, sending...
I20240503 08:02:16.220731 18754 ts_manager.cc:194] Registered new tserver with Master: 5a05e724fe074ff1aba23f9f6996d51c (127.14.95.130:41103)
I20240503 08:02:16.221890 18754 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.95.130:59763
I20240503 08:02:16.222182 14718 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9G1ywP/build/debug/bin/kudu
/tmp/dist-test-task9G1ywP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.95.129:43581
--local_ip_for_outbound_sockets=127.14.95.129
--tserver_master_addrs=127.14.95.190:46841
--webserver_port=46191
--webserver_interface=127.14.95.129
--builtin_ntp_servers=127.14.95.148:36621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=20
--rpc_service_queue_length=1
--rpc_num_service_threads=1 with env {}
W20240503 08:02:16.330857 19051 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:02:16.331125 19051 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:02:16.331175 19051 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:02:16.334350 19051 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:02:16.334482 19051 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.95.129
I20240503 08:02:16.338328 19051 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.95.148:36621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.95.129:43581
--rpc_num_service_threads=1
--rpc_server_allow_ephemeral_ports=true
--rpc_service_queue_length=1
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.95.129
--webserver_port=46191
--tserver_master_addrs=127.14.95.190:46841
--num_tablets_to_copy_simultaneously=20
--never_fsync=true
--heap_profile_path=/tmp/kudu.19051
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.95.129
--log_dir=/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type DEBUG
built by None at 03 May 2024 07:43:15 UTC on 1a15035a6830
build id 101
I20240503 08:02:16.339282 19051 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:02:16.340373 19051 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:02:16.348438 19057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:16.349077 19056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:02:16.349889 19059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:02:16.350718 19051 server_base.cc:1034] running on GCE node
I20240503 08:02:16.351126 19051 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:02:16.351714 19051 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:02:16.352876 19051 hybrid_clock.cc:648] HybridClock initialized: now 1714723336352859 us; error 31 us; skew 500 ppm
I20240503 08:02:16.354909 19051 webserver.cc:460] Webserver started at http://127.14.95.129:46191/ using document root <none> and password file <none>
I20240503 08:02:16.355535 19051 fs_manager.cc:359] Metadata directory not provided
I20240503 08:02:16.355603 19051 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:02:16.359129 19051 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20240503 08:02:16.362179 19065 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:02:16.363334 19051 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240503 08:02:16.363438 19051 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-0/data,/tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-0/wal
uuid: "230ccce6f4884106bafadcba4f2643f7"
format_stamp: "Formatted at 2024-05-03 08:02:12 on dist-test-slave-0z1c"
I20240503 08:02:16.363890 19051 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:02:16.374446 19051 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:02:16.375166 19051 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:02:16.375339 19051 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:02:16.375924 19051 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:02:16.377336 19072 ts_tablet_manager.cc:516] Loading tablet metadata (0/20 complete)
I20240503 08:02:16.391561 19051 ts_tablet_manager.cc:559] Loaded tablet metadata (20 total tablets, 20 live tablets)
I20240503 08:02:16.391667 19051 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.015s user 0.001s sys 0.000s
I20240503 08:02:16.391746 19051 ts_tablet_manager.cc:574] Registering tablets (0/20 complete)
I20240503 08:02:16.394102 19072 tablet_bootstrap.cc:492] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:16.400697 19051 ts_tablet_manager.cc:590] Registered 20 tablets
I20240503 08:02:16.400769 19051 ts_tablet_manager.cc:569] Time spent register tablets: real 0.009s user 0.006s sys 0.000s
I20240503 08:02:16.405017 19051 rpc_server.cc:307] RPC server started. Bound to: 127.14.95.129:43581
I20240503 08:02:16.405063 19084 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.95.129:43581 every 8 connection(s)
I20240503 08:02:16.406034 19051 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9G1ywP/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714723320929540-14718-0/minicluster-data/ts-0/data/info.pb
I20240503 08:02:16.408221 14718 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9G1ywP/build/debug/bin/kudu as pid 19051
I20240503 08:02:16.415638 19085 heartbeater.cc:347] Connected to a master server at 127.14.95.190:46841
I20240503 08:02:16.415915 19085 heartbeater.cc:464] Registering TS with master...
I20240503 08:02:16.416625 19085 heartbeater.cc:511] Master 127.14.95.190:46841 requested a full tablet report, sending...
I20240503 08:02:16.419260 18754 ts_manager.cc:194] Re-registered known tserver with Master: 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129:43581)
I20240503 08:02:16.420688 19072 log.cc:824] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7: Log is configured to *not* fsync() on all Append() calls
I20240503 08:02:16.422750 18754 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.95.129:59397
I20240503 08:02:16.519903 19072 tablet_bootstrap.cc:492] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=189 overwritten=0 applied=189 ignored=0} inserts{seen=545 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:02:16.520298 19072 tablet_bootstrap.cc:492] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7: Bootstrap complete.
I20240503 08:02:16.521227 19072 ts_tablet_manager.cc:1367] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.127s user 0.102s sys 0.025s
I20240503 08:02:16.523240 19072 raft_consensus.cc:348] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:16.523577 19072 raft_consensus.cc:729] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:16.524013 19072 consensus_queue.cc:260] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 189, Last appended: 1.189, Last appended by leader: 189, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:16.524142 19072 raft_consensus.cc:388] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:16.524194 19072 raft_consensus.cc:482] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:16.524274 19072 raft_consensus.cc:3037] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:02:16.525843 19072 raft_consensus.cc:504] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:16.526199 19072 leader_election.cc:302] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:16.526489 19072 leader_election.cc:288] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:02:16.526623 19090 raft_consensus.cc:2781] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:02:16.526846 19090 raft_consensus.cc:686] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7 [term 2 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:16.527194 19085 heartbeater.cc:503] Master 127.14.95.190:46841 was elected leader, sending a full tablet report...
I20240503 08:02:16.527176 19090 consensus_queue.cc:237] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 189, Committed index: 189, Last appended: 1.189, Last appended by leader: 189, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:16.527403 19072 ts_tablet_manager.cc:1398] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20240503 08:02:16.527626 19072 tablet_bootstrap.cc:492] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:16.530872 18754 catalog_manager.cc:5484] T 8469e7783a644fa6bce033ee936573ab P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:16.641362 19072 tablet_bootstrap.cc:492] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=189 overwritten=0 applied=189 ignored=0} inserts{seen=528 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:02:16.641705 19072 tablet_bootstrap.cc:492] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap complete.
I20240503 08:02:16.642513 19072 ts_tablet_manager.cc:1367] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.115s user 0.098s sys 0.015s
I20240503 08:02:16.643151 19072 raft_consensus.cc:348] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:16.643278 19072 raft_consensus.cc:729] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:16.643416 19072 consensus_queue.cc:260] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 189, Last appended: 1.189, Last appended by leader: 189, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:16.643499 19072 raft_consensus.cc:388] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:16.643539 19072 raft_consensus.cc:482] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:16.643584 19072 raft_consensus.cc:3037] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:02:16.644340 19072 raft_consensus.cc:504] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:16.644480 19072 leader_election.cc:302] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:16.644580 19072 leader_election.cc:288] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:02:16.644636 19090 raft_consensus.cc:2781] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:02:16.644714 19090 raft_consensus.cc:686] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7 [term 2 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:16.644819 19072 ts_tablet_manager.cc:1398] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240503 08:02:16.644819 19090 consensus_queue.cc:237] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 189, Committed index: 189, Last appended: 1.189, Last appended by leader: 189, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:16.645056 19072 tablet_bootstrap.cc:492] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:16.646376 18754 catalog_manager.cc:5484] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:16.756665 19072 tablet_bootstrap.cc:492] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=190 overwritten=0 applied=190 ignored=0} inserts{seen=512 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:02:16.756958 19072 tablet_bootstrap.cc:492] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap complete.
I20240503 08:02:16.757777 19072 ts_tablet_manager.cc:1367] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.113s user 0.100s sys 0.011s
I20240503 08:02:16.758189 19072 raft_consensus.cc:348] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:16.758287 19072 raft_consensus.cc:729] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:16.758401 19072 consensus_queue.cc:260] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 190, Last appended: 1.190, Last appended by leader: 190, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:16.758478 19072 raft_consensus.cc:388] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:16.758502 19072 raft_consensus.cc:482] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:16.758528 19072 raft_consensus.cc:3037] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:02:16.759246 19072 raft_consensus.cc:504] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:16.759361 19072 leader_election.cc:302] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:16.759457 19072 leader_election.cc:288] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:02:16.759513 19090 raft_consensus.cc:2781] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:02:16.759629 19090 raft_consensus.cc:686] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7 [term 2 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:16.759685 19072 ts_tablet_manager.cc:1398] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240503 08:02:16.759742 19090 consensus_queue.cc:237] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 190, Committed index: 190, Last appended: 1.190, Last appended by leader: 190, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:16.759801 19072 tablet_bootstrap.cc:492] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:16.761344 18754 catalog_manager.cc:5484] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:16.872728 19072 tablet_bootstrap.cc:492] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=193 overwritten=0 applied=193 ignored=0} inserts{seen=522 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:02:16.873054 19072 tablet_bootstrap.cc:492] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7: Bootstrap complete.
I20240503 08:02:16.873777 19072 ts_tablet_manager.cc:1367] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.114s user 0.101s sys 0.012s
I20240503 08:02:16.874159 19072 raft_consensus.cc:348] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:16.874256 19072 raft_consensus.cc:729] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:16.874370 19072 consensus_queue.cc:260] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 193, Last appended: 1.193, Last appended by leader: 193, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:16.874450 19072 raft_consensus.cc:388] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:16.874482 19072 raft_consensus.cc:482] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:16.874511 19072 raft_consensus.cc:3037] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:02:16.875166 19072 raft_consensus.cc:504] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:16.875281 19072 leader_election.cc:302] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:16.875360 19072 leader_election.cc:288] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:02:16.875453 19090 raft_consensus.cc:2781] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:02:16.875536 19090 raft_consensus.cc:686] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7 [term 2 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:16.875602 19072 ts_tablet_manager.cc:1398] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:02:16.875666 19090 consensus_queue.cc:237] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 193, Committed index: 193, Last appended: 1.193, Last appended by leader: 193, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:16.875749 19072 tablet_bootstrap.cc:492] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:16.877434 18754 catalog_manager.cc:5484] T 3db4892cd70f44e3a4cc40694a76a49d P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:16.991922 19072 tablet_bootstrap.cc:492] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=195 overwritten=0 applied=195 ignored=0} inserts{seen=526 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:02:16.992246 19072 tablet_bootstrap.cc:492] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7: Bootstrap complete.
I20240503 08:02:16.992978 19072 ts_tablet_manager.cc:1367] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.117s user 0.093s sys 0.020s
I20240503 08:02:16.993420 19072 raft_consensus.cc:348] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:16.993518 19072 raft_consensus.cc:729] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:16.993656 19072 consensus_queue.cc:260] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:16.993728 19072 raft_consensus.cc:388] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:16.993758 19072 raft_consensus.cc:482] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:16.993803 19072 raft_consensus.cc:3037] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:02:16.994486 19072 raft_consensus.cc:504] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:16.994606 19072 leader_election.cc:302] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:16.994699 19072 leader_election.cc:288] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:02:16.994755 19090 raft_consensus.cc:2781] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:02:16.994864 19090 raft_consensus.cc:686] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7 [term 2 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:16.994917 19072 ts_tablet_manager.cc:1398] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240503 08:02:16.994971 19090 consensus_queue.cc:237] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 195, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:16.995025 19072 tablet_bootstrap.cc:492] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:16.996417 18754 catalog_manager.cc:5484] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:17.105854 19072 tablet_bootstrap.cc:492] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=194 overwritten=0 applied=194 ignored=0} inserts{seen=508 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:02:17.106164 19072 tablet_bootstrap.cc:492] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap complete.
I20240503 08:02:17.106885 19072 ts_tablet_manager.cc:1367] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.112s user 0.106s sys 0.004s
I20240503 08:02:17.107285 19072 raft_consensus.cc:348] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:17.107383 19072 raft_consensus.cc:729] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:17.107499 19072 consensus_queue.cc:260] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 194, Last appended: 1.194, Last appended by leader: 194, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:17.107581 19072 raft_consensus.cc:388] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:17.107610 19072 raft_consensus.cc:482] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:17.107643 19072 raft_consensus.cc:3037] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:02:17.108362 19072 raft_consensus.cc:504] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:17.108477 19072 leader_election.cc:302] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:17.108556 19072 leader_election.cc:288] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:02:17.108649 19090 raft_consensus.cc:2781] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:02:17.108762 19090 raft_consensus.cc:686] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7 [term 2 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:17.108769 19072 ts_tablet_manager.cc:1398] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240503 08:02:17.108908 19090 consensus_queue.cc:237] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 194, Committed index: 194, Last appended: 1.194, Last appended by leader: 194, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:17.108970 19072 tablet_bootstrap.cc:492] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:17.110515 18754 catalog_manager.cc:5484] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:17.219281 19072 tablet_bootstrap.cc:492] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=190 overwritten=0 applied=190 ignored=0} inserts{seen=540 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:02:17.219636 19072 tablet_bootstrap.cc:492] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7: Bootstrap complete.
I20240503 08:02:17.220667 19072 ts_tablet_manager.cc:1367] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.112s user 0.100s sys 0.008s
I20240503 08:02:17.221179 19072 raft_consensus.cc:348] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:17.221282 19072 raft_consensus.cc:729] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:17.221414 19072 consensus_queue.cc:260] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 190, Last appended: 1.190, Last appended by leader: 190, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:17.221493 19072 raft_consensus.cc:388] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:17.221529 19072 raft_consensus.cc:482] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:17.221563 19072 raft_consensus.cc:3037] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:02:17.222254 19072 raft_consensus.cc:504] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:17.222374 19072 leader_election.cc:302] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:17.222472 19072 leader_election.cc:288] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:02:17.222525 19090 raft_consensus.cc:2781] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:02:17.222631 19090 raft_consensus.cc:686] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7 [term 2 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:17.222705 19072 ts_tablet_manager.cc:1398] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
I20240503 08:02:17.222754 19090 consensus_queue.cc:237] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 190, Committed index: 190, Last appended: 1.190, Last appended by leader: 190, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:17.222859 19072 tablet_bootstrap.cc:492] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:17.224169 18754 catalog_manager.cc:5484] T f72081e606b4476797b8aa85659243aa P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:17.224869 19047 heartbeater.cc:503] Master 127.14.95.190:46841 was elected leader, sending a full tablet report...
I20240503 08:02:17.333503 19072 tablet_bootstrap.cc:492] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=190 overwritten=0 applied=190 ignored=0} inserts{seen=521 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:02:17.333837 19072 tablet_bootstrap.cc:492] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7: Bootstrap complete.
I20240503 08:02:17.334589 19072 ts_tablet_manager.cc:1367] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.112s user 0.110s sys 0.000s
I20240503 08:02:17.334997 19072 raft_consensus.cc:348] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:17.335096 19072 raft_consensus.cc:729] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:17.335229 19072 consensus_queue.cc:260] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 190, Last appended: 1.190, Last appended by leader: 190, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:17.335299 19072 raft_consensus.cc:388] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:17.335331 19072 raft_consensus.cc:482] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:17.335376 19072 raft_consensus.cc:3037] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:02:17.336066 19072 raft_consensus.cc:504] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:17.336200 19072 leader_election.cc:302] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:17.336292 19072 leader_election.cc:288] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:02:17.336335 19092 raft_consensus.cc:2781] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:02:17.336441 19092 raft_consensus.cc:686] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7 [term 2 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:17.336527 19072 ts_tablet_manager.cc:1398] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240503 08:02:17.336557 19092 consensus_queue.cc:237] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 190, Committed index: 190, Last appended: 1.190, Last appended by leader: 190, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:17.336676 19072 tablet_bootstrap.cc:492] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:17.338086 18754 catalog_manager.cc:5484] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:17.449757 19072 tablet_bootstrap.cc:492] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=193 overwritten=0 applied=193 ignored=0} inserts{seen=519 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:02:17.450070 19072 tablet_bootstrap.cc:492] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap complete.
I20240503 08:02:17.450819 19072 ts_tablet_manager.cc:1367] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.114s user 0.104s sys 0.008s
I20240503 08:02:17.451218 19072 raft_consensus.cc:348] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:17.451313 19072 raft_consensus.cc:729] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:17.451429 19072 consensus_queue.cc:260] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 193, Last appended: 1.193, Last appended by leader: 193, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:17.451498 19072 raft_consensus.cc:388] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:17.451519 19072 raft_consensus.cc:482] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:17.451546 19072 raft_consensus.cc:3037] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:02:17.452225 19072 raft_consensus.cc:504] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:17.452342 19072 leader_election.cc:302] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:17.452432 19072 leader_election.cc:288] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:02:17.452471 19092 raft_consensus.cc:2781] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:02:17.452555 19092 raft_consensus.cc:686] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7 [term 2 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:17.452677 19072 ts_tablet_manager.cc:1398] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240503 08:02:17.452682 19092 consensus_queue.cc:237] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 193, Committed index: 193, Last appended: 1.193, Last appended by leader: 193, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:17.452885 19072 tablet_bootstrap.cc:492] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:17.454358 18754 catalog_manager.cc:5484] T efcad07bfa894e0c9c839b5ffb23bce4 P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:17.562732 19072 tablet_bootstrap.cc:492] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=189 overwritten=0 applied=189 ignored=0} inserts{seen=485 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:02:17.563086 19072 tablet_bootstrap.cc:492] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap complete.
I20240503 08:02:17.563838 19072 ts_tablet_manager.cc:1367] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.111s user 0.084s sys 0.024s
I20240503 08:02:17.564239 19072 raft_consensus.cc:348] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:17.564332 19072 raft_consensus.cc:729] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:17.564433 19072 consensus_queue.cc:260] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 189, Last appended: 1.189, Last appended by leader: 189, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:17.564489 19072 raft_consensus.cc:388] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:17.564514 19072 raft_consensus.cc:482] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:17.564545 19072 raft_consensus.cc:3037] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:02:17.565263 19072 raft_consensus.cc:504] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:17.565372 19072 leader_election.cc:302] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:17.565450 19072 leader_election.cc:288] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:02:17.565510 19092 raft_consensus.cc:2781] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:02:17.565604 19092 raft_consensus.cc:686] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7 [term 2 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:17.565676 19072 ts_tablet_manager.cc:1398] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.000s sys 0.004s
I20240503 08:02:17.565722 19092 consensus_queue.cc:237] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 189, Committed index: 189, Last appended: 1.189, Last appended by leader: 189, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:17.565819 19072 tablet_bootstrap.cc:492] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:17.567274 18754 catalog_manager.cc:5484] T 91d074cc385a4e2b8472275b83306411 P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:17.679653 19072 tablet_bootstrap.cc:492] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=187 overwritten=0 applied=187 ignored=0} inserts{seen=532 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:02:17.679991 19072 tablet_bootstrap.cc:492] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7: Bootstrap complete.
I20240503 08:02:17.680754 19072 ts_tablet_manager.cc:1367] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.115s user 0.107s sys 0.004s
I20240503 08:02:17.681212 19072 raft_consensus.cc:348] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:17.681309 19072 raft_consensus.cc:729] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:17.681428 19072 consensus_queue.cc:260] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 187, Last appended: 1.187, Last appended by leader: 187, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:17.681496 19072 raft_consensus.cc:388] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:17.681527 19072 raft_consensus.cc:482] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:17.681577 19072 raft_consensus.cc:3037] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:02:17.682272 19072 raft_consensus.cc:504] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:17.682406 19072 leader_election.cc:302] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:17.682507 19072 leader_election.cc:288] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:02:17.682574 19092 raft_consensus.cc:2781] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:02:17.682691 19092 raft_consensus.cc:686] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7 [term 2 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:17.682741 19072 ts_tablet_manager.cc:1398] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
I20240503 08:02:17.682833 19092 consensus_queue.cc:237] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 187, Committed index: 187, Last appended: 1.187, Last appended by leader: 187, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:17.682914 19072 tablet_bootstrap.cc:492] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:17.684391 18754 catalog_manager.cc:5484] T 2969eb2e9bf042b3b74de0931fd4512a P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:17.796494 19072 tablet_bootstrap.cc:492] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=196 overwritten=0 applied=196 ignored=0} inserts{seen=524 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:02:17.796877 19072 tablet_bootstrap.cc:492] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap complete.
I20240503 08:02:17.797923 19072 ts_tablet_manager.cc:1367] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.115s user 0.094s sys 0.020s
I20240503 08:02:17.798357 19072 raft_consensus.cc:348] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:17.798453 19072 raft_consensus.cc:729] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:17.798561 19072 consensus_queue.cc:260] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 196, Last appended: 1.196, Last appended by leader: 196, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:17.798626 19072 raft_consensus.cc:388] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:17.798657 19072 raft_consensus.cc:482] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:17.798702 19072 raft_consensus.cc:3037] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:02:17.799397 19072 raft_consensus.cc:504] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:17.799511 19072 leader_election.cc:302] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:17.799602 19072 leader_election.cc:288] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:02:17.799679 19090 raft_consensus.cc:2781] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:02:17.799788 19090 raft_consensus.cc:686] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7 [term 2 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:17.799830 19072 ts_tablet_manager.cc:1398] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240503 08:02:17.799950 19072 tablet_bootstrap.cc:492] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:17.799898 19090 consensus_queue.cc:237] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 196, Committed index: 196, Last appended: 1.196, Last appended by leader: 196, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:17.801471 18754 catalog_manager.cc:5484] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:17.914129 19072 tablet_bootstrap.cc:492] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=192 overwritten=0 applied=192 ignored=0} inserts{seen=534 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:02:17.914424 19072 tablet_bootstrap.cc:492] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap complete.
I20240503 08:02:17.915172 19072 ts_tablet_manager.cc:1367] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.115s user 0.109s sys 0.004s
I20240503 08:02:17.915571 19072 raft_consensus.cc:348] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:17.915668 19072 raft_consensus.cc:729] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:17.915782 19072 consensus_queue.cc:260] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 192, Last appended: 1.192, Last appended by leader: 192, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:17.915858 19072 raft_consensus.cc:388] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:17.915886 19072 raft_consensus.cc:482] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:17.915921 19072 raft_consensus.cc:3037] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:02:17.916640 19072 raft_consensus.cc:504] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:17.916759 19072 leader_election.cc:302] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:17.916836 19072 leader_election.cc:288] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:02:17.916898 19090 raft_consensus.cc:2781] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:02:17.917042 19090 raft_consensus.cc:686] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7 [term 2 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:17.917085 19072 ts_tablet_manager.cc:1398] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
I20240503 08:02:17.917158 19090 consensus_queue.cc:237] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 192, Committed index: 192, Last appended: 1.192, Last appended by leader: 192, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:17.917239 19072 tablet_bootstrap.cc:492] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:17.918788 18754 catalog_manager.cc:5484] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:18.033128 19072 tablet_bootstrap.cc:492] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=189 overwritten=0 applied=189 ignored=0} inserts{seen=507 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:02:18.033440 19072 tablet_bootstrap.cc:492] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap complete.
I20240503 08:02:18.034144 19072 ts_tablet_manager.cc:1367] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.117s user 0.100s sys 0.016s
I20240503 08:02:18.034539 19072 raft_consensus.cc:348] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:18.034634 19072 raft_consensus.cc:729] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:18.034736 19072 consensus_queue.cc:260] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 189, Last appended: 1.189, Last appended by leader: 189, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:18.034790 19072 raft_consensus.cc:388] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:18.034816 19072 raft_consensus.cc:482] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:18.034847 19072 raft_consensus.cc:3037] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:02:18.035526 19072 raft_consensus.cc:504] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:18.035642 19072 leader_election.cc:302] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:18.035724 19072 leader_election.cc:288] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:02:18.035849 19091 raft_consensus.cc:2781] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:02:18.035961 19072 ts_tablet_manager.cc:1398] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240503 08:02:18.035969 19091 raft_consensus.cc:686] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7 [term 2 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:18.036123 19072 tablet_bootstrap.cc:492] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:18.036226 19091 consensus_queue.cc:237] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 189, Committed index: 189, Last appended: 1.189, Last appended by leader: 189, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:18.037846 18754 catalog_manager.cc:5484] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:18.149799 19072 tablet_bootstrap.cc:492] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=186 overwritten=0 applied=186 ignored=0} inserts{seen=486 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:02:18.150130 19072 tablet_bootstrap.cc:492] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap complete.
I20240503 08:02:18.150894 19072 ts_tablet_manager.cc:1367] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.115s user 0.097s sys 0.016s
I20240503 08:02:18.151319 19072 raft_consensus.cc:348] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:18.151422 19072 raft_consensus.cc:729] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:18.151556 19072 consensus_queue.cc:260] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 186, Last appended: 1.186, Last appended by leader: 186, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:18.151639 19072 raft_consensus.cc:388] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:18.151675 19072 raft_consensus.cc:482] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:18.151723 19072 raft_consensus.cc:3037] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:02:18.152453 19072 raft_consensus.cc:504] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:18.152585 19072 leader_election.cc:302] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:18.152685 19072 leader_election.cc:288] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:02:18.152832 19091 raft_consensus.cc:2781] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:02:18.152940 19072 ts_tablet_manager.cc:1398] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240503 08:02:18.152944 19091 raft_consensus.cc:686] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7 [term 2 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:18.153169 19072 tablet_bootstrap.cc:492] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:18.153151 19091 consensus_queue.cc:237] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 186, Committed index: 186, Last appended: 1.186, Last appended by leader: 186, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:18.154877 18754 catalog_manager.cc:5484] T 21bd3b312b2c4a65b174cf60e87ecd22 P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:18.284559 19072 tablet_bootstrap.cc:492] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=187 overwritten=0 applied=187 ignored=0} inserts{seen=485 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:02:18.284951 19072 tablet_bootstrap.cc:492] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap complete.
I20240503 08:02:18.286022 19072 ts_tablet_manager.cc:1367] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.133s user 0.100s sys 0.012s
I20240503 08:02:18.286510 19072 raft_consensus.cc:348] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:18.286610 19072 raft_consensus.cc:729] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:18.286720 19072 consensus_queue.cc:260] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 187, Last appended: 1.187, Last appended by leader: 187, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:18.286798 19072 raft_consensus.cc:388] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:18.286821 19072 raft_consensus.cc:482] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:18.286866 19072 raft_consensus.cc:3037] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:02:18.287585 19072 raft_consensus.cc:504] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:18.287704 19072 leader_election.cc:302] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:18.287796 19072 leader_election.cc:288] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:02:18.287861 19091 raft_consensus.cc:2781] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:02:18.287997 19091 raft_consensus.cc:686] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7 [term 2 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:18.288040 19072 ts_tablet_manager.cc:1398] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240503 08:02:18.288115 19091 consensus_queue.cc:237] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 187, Committed index: 187, Last appended: 1.187, Last appended by leader: 187, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:18.288161 19072 tablet_bootstrap.cc:492] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:18.289750 18754 catalog_manager.cc:5484] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:18.400951 19072 tablet_bootstrap.cc:492] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=189 overwritten=0 applied=189 ignored=0} inserts{seen=553 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:02:18.401357 19072 tablet_bootstrap.cc:492] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap complete.
I20240503 08:02:18.402168 19072 ts_tablet_manager.cc:1367] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.114s user 0.104s sys 0.008s
I20240503 08:02:18.402565 19072 raft_consensus.cc:348] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:18.402660 19072 raft_consensus.cc:729] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:18.402773 19072 consensus_queue.cc:260] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 189, Last appended: 1.189, Last appended by leader: 189, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:18.402846 19072 raft_consensus.cc:388] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:18.402874 19072 raft_consensus.cc:482] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:18.402906 19072 raft_consensus.cc:3037] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:02:18.403607 19072 raft_consensus.cc:504] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:18.403723 19072 leader_election.cc:302] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:18.403800 19072 leader_election.cc:288] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:02:18.403869 19091 raft_consensus.cc:2781] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:02:18.404026 19091 raft_consensus.cc:686] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7 [term 2 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:18.404026 19072 ts_tablet_manager.cc:1398] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240503 08:02:18.404186 19091 consensus_queue.cc:237] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 189, Committed index: 189, Last appended: 1.189, Last appended by leader: 189, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:18.404300 19072 tablet_bootstrap.cc:492] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:18.405733 18754 catalog_manager.cc:5484] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:18.517953 19072 tablet_bootstrap.cc:492] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=191 overwritten=0 applied=191 ignored=0} inserts{seen=486 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:02:18.518306 19072 tablet_bootstrap.cc:492] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap complete.
I20240503 08:02:18.519076 19072 ts_tablet_manager.cc:1367] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.115s user 0.085s sys 0.028s
I20240503 08:02:18.519518 19072 raft_consensus.cc:348] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:18.519623 19072 raft_consensus.cc:729] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:18.519737 19072 consensus_queue.cc:260] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 191, Last appended: 1.191, Last appended by leader: 191, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:18.519820 19072 raft_consensus.cc:388] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:18.519845 19072 raft_consensus.cc:482] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:18.519889 19072 raft_consensus.cc:3037] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:02:18.520632 19072 raft_consensus.cc:504] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:18.520753 19072 leader_election.cc:302] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:18.520859 19072 leader_election.cc:288] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:02:18.520960 19091 raft_consensus.cc:2781] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:02:18.521121 19072 ts_tablet_manager.cc:1398] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
I20240503 08:02:18.521121 19091 raft_consensus.cc:686] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7 [term 2 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:18.521344 19072 tablet_bootstrap.cc:492] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:18.521412 19091 consensus_queue.cc:237] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 191, Committed index: 191, Last appended: 1.191, Last appended by leader: 191, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:18.523135 18754 catalog_manager.cc:5484] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:18.630407 19072 tablet_bootstrap.cc:492] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=188 overwritten=0 applied=188 ignored=0} inserts{seen=497 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:02:18.630735 19072 tablet_bootstrap.cc:492] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7: Bootstrap complete.
I20240503 08:02:18.631489 19072 ts_tablet_manager.cc:1367] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.110s user 0.099s sys 0.008s
I20240503 08:02:18.631896 19072 raft_consensus.cc:348] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:18.631995 19072 raft_consensus.cc:729] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:18.632122 19072 consensus_queue.cc:260] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 188, Last appended: 1.188, Last appended by leader: 188, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:18.632190 19072 raft_consensus.cc:388] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:18.632220 19072 raft_consensus.cc:482] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:18.632265 19072 raft_consensus.cc:3037] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:02:18.632952 19072 raft_consensus.cc:504] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:18.633100 19072 leader_election.cc:302] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:18.633194 19072 leader_election.cc:288] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:02:18.633284 19091 raft_consensus.cc:2781] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:02:18.633394 19091 raft_consensus.cc:686] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7 [term 2 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:18.633410 19072 ts_tablet_manager.cc:1398] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
I20240503 08:02:18.633504 19091 consensus_queue.cc:237] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 188, Committed index: 188, Last appended: 1.188, Last appended by leader: 188, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:18.633590 19072 tablet_bootstrap.cc:492] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7: Bootstrap starting.
I20240503 08:02:18.635094 18754 catalog_manager.cc:5484] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:18.750566 19072 tablet_bootstrap.cc:492] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=195 overwritten=0 applied=195 ignored=0} inserts{seen=540 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:02:18.750919 19072 tablet_bootstrap.cc:492] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7: Bootstrap complete.
I20240503 08:02:18.751977 19072 ts_tablet_manager.cc:1367] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7: Time spent bootstrapping tablet: real 0.118s user 0.103s sys 0.012s
I20240503 08:02:18.752485 19072 raft_consensus.cc:348] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:18.752581 19072 raft_consensus.cc:729] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Initialized, Role: FOLLOWER
I20240503 08:02:18.752702 19072 consensus_queue.cc:260] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:18.752770 19072 raft_consensus.cc:388] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:02:18.752802 19072 raft_consensus.cc:482] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:02:18.752868 19072 raft_consensus.cc:3037] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:02:18.753614 19072 raft_consensus.cc:504] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:18.753734 19072 leader_election.cc:302] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 230ccce6f4884106bafadcba4f2643f7; no voters:
I20240503 08:02:18.753829 19072 leader_election.cc:288] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:02:18.753885 19091 raft_consensus.cc:2781] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:02:18.754004 19091 raft_consensus.cc:686] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7 [term 2 LEADER]: Becoming Leader. State: Replica: 230ccce6f4884106bafadcba4f2643f7, State: Running, Role: LEADER
I20240503 08:02:18.754086 19072 ts_tablet_manager.cc:1398] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7: Time spent starting tablet: real 0.002s user 0.000s sys 0.004s
I20240503 08:02:18.754127 19091 consensus_queue.cc:237] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 195, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } }
I20240503 08:02:18.755669 18754 catalog_manager.cc:5484] T c8382412e13c4e25a852cad2d7bdc7ed P 230ccce6f4884106bafadcba4f2643f7 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "230ccce6f4884106bafadcba4f2643f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "230ccce6f4884106bafadcba4f2643f7" member_type: VOTER last_known_addr { host: "127.14.95.129" port: 43581 } health_report { overall_health: HEALTHY } } }
I20240503 08:02:18.771391 19166 ts_tablet_manager.cc:902] T 4c9560832a4443e49e0be3b51feb4c35 P 5a05e724fe074ff1aba23f9f6996d51c: Initiating tablet copy from peer 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129:43581)
I20240503 08:02:18.771637 19160 ts_tablet_manager.cc:902] T d158e8ecf4be4efba22cf094608766b7 P 5a05e724fe074ff1aba23f9f6996d51c: Initiating tablet copy from peer 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129:43581)
I20240503 08:02:18.771842 19164 ts_tablet_manager.cc:902] T cfbac30e5c164eed8b87d92516612668 P 5a05e724fe074ff1aba23f9f6996d51c: Initiating tablet copy from peer 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129:43581)
I20240503 08:02:18.772279 19166 tablet_copy_client.cc:308] T 4c9560832a4443e49e0be3b51feb4c35 P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:43581
I20240503 08:02:18.772264 19160 tablet_copy_client.cc:308] T d158e8ecf4be4efba22cf094608766b7 P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:43581
I20240503 08:02:18.772289 19164 tablet_copy_client.cc:308] T cfbac30e5c164eed8b87d92516612668 P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:43581
I20240503 08:02:18.772365 19162 ts_tablet_manager.cc:902] T a504df8c6d7748f3a69a2ff947278f01 P 5a05e724fe074ff1aba23f9f6996d51c: Initiating tablet copy from peer 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129:43581)
I20240503 08:02:18.773206 19163 ts_tablet_manager.cc:902] T 5f447883016e4eeb94762f46df482dd9 P 5a05e724fe074ff1aba23f9f6996d51c: Initiating tablet copy from peer 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129:43581)
I20240503 08:02:18.773386 19162 tablet_copy_client.cc:308] T a504df8c6d7748f3a69a2ff947278f01 P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:43581
I20240503 08:02:18.773526 19171 ts_tablet_manager.cc:902] T 1fce17000ee743faa8292d031a6bc9d7 P 5a05e724fe074ff1aba23f9f6996d51c: Initiating tablet copy from peer 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129:43581)
I20240503 08:02:18.773550 19170 ts_tablet_manager.cc:902] T 947514e951cd4cfd8a9ecf315d113b94 P 5a05e724fe074ff1aba23f9f6996d51c: Initiating tablet copy from peer 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129:43581)
I20240503 08:02:18.773885 19163 tablet_copy_client.cc:308] T 5f447883016e4eeb94762f46df482dd9 P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:43581
I20240503 08:02:18.773986 19170 tablet_copy_client.cc:308] T 947514e951cd4cfd8a9ecf315d113b94 P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:43581
I20240503 08:02:18.773380 19172 ts_tablet_manager.cc:902] T 2969eb2e9bf042b3b74de0931fd4512a P 5a05e724fe074ff1aba23f9f6996d51c: Initiating tablet copy from peer 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129:43581)
I20240503 08:02:18.773418 19169 ts_tablet_manager.cc:902] T 3db4892cd70f44e3a4cc40694a76a49d P 5a05e724fe074ff1aba23f9f6996d51c: Initiating tablet copy from peer 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129:43581)
I20240503 08:02:18.774374 19168 ts_tablet_manager.cc:902] T 2c6c74c1c01d42069114483dc4c0f6dc P 5a05e724fe074ff1aba23f9f6996d51c: Initiating tablet copy from peer 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129:43581)
I20240503 08:02:18.773260 19167 ts_tablet_manager.cc:902] T 21bd3b312b2c4a65b174cf60e87ecd22 P 5a05e724fe074ff1aba23f9f6996d51c: Initiating tablet copy from peer 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129:43581)
I20240503 08:02:18.774509 19172 tablet_copy_client.cc:308] T 2969eb2e9bf042b3b74de0931fd4512a P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:43581
I20240503 08:02:18.774829 19168 tablet_copy_client.cc:308] T 2c6c74c1c01d42069114483dc4c0f6dc P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:43581
I20240503 08:02:18.774940 19167 tablet_copy_client.cc:308] T 21bd3b312b2c4a65b174cf60e87ecd22 P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:43581
I20240503 08:02:18.774004 19173 ts_tablet_manager.cc:902] T 3bff92f43b554c36aea44162bc8771cf P 5a05e724fe074ff1aba23f9f6996d51c: Initiating tablet copy from peer 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129:43581)
I20240503 08:02:18.775043 19183 ts_tablet_manager.cc:902] T 91d074cc385a4e2b8472275b83306411 P 5a05e724fe074ff1aba23f9f6996d51c: Initiating tablet copy from peer 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129:43581)
I20240503 08:02:18.775346 19169 tablet_copy_client.cc:308] T 3db4892cd70f44e3a4cc40694a76a49d P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:43581
I20240503 08:02:18.775456 19173 tablet_copy_client.cc:308] T 3bff92f43b554c36aea44162bc8771cf P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:43581
I20240503 08:02:18.775486 19183 tablet_copy_client.cc:308] T 91d074cc385a4e2b8472275b83306411 P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:43581
I20240503 08:02:18.773337 19175 ts_tablet_manager.cc:902] T 2dbb77573e7541d4be6260c0d29c6668 P 5a05e724fe074ff1aba23f9f6996d51c: Initiating tablet copy from peer 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129:43581)
I20240503 08:02:18.773955 19171 tablet_copy_client.cc:308] T 1fce17000ee743faa8292d031a6bc9d7 P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:43581
I20240503 08:02:18.775633 19174 ts_tablet_manager.cc:902] T 6acf2a0111884ee0b3e16e8230f906d5 P 5a05e724fe074ff1aba23f9f6996d51c: Initiating tablet copy from peer 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129:43581)
I20240503 08:02:18.776059 19174 tablet_copy_client.cc:308] T 6acf2a0111884ee0b3e16e8230f906d5 P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:43581
I20240503 08:02:18.776324 19161 ts_tablet_manager.cc:902] T 8059190ad08f4675a4c5b67554d5ccf7 P 5a05e724fe074ff1aba23f9f6996d51c: Initiating tablet copy from peer 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129:43581)
I20240503 08:02:18.776463 19175 tablet_copy_client.cc:308] T 2dbb77573e7541d4be6260c0d29c6668 P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:43581
I20240503 08:02:18.776809 19161 tablet_copy_client.cc:308] T 8059190ad08f4675a4c5b67554d5ccf7 P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.95.129:43581
I20240503 08:02:18.777069 19165 ts_tablet_manager.cc:902] T 8469e7783a644fa6bce033ee936573ab P 5a05e724fe074ff1aba23f9f6996d51c: Initiating tablet copy from peer 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129:43581)
I20240503 08:02:18.777305 19189 ts_tablet_manager.cc:902] T f72081e606b4476797b8aa85659243aa P 5a05e724fe074ff1aba23f9f6996d51c: Initiating tablet copy from peer 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129:43581)
I20240503 08:02:18.777608 19190 ts_tablet_manager.cc:902] T efcad07bfa894e0c9c839b5ffb23bce4 P 5a05e724fe074ff1aba23f9f6996d51c: Initiating tablet copy from peer 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129:43581)
F20240503 08:02:18.777210 19165 trace_metrics.cc:68] Check failed: g_intern_map->size() < 100 (100 vs. 100) Too many interned strings: (MaintenanceMgr.queue_time_us, MaintenanceMgr.queue_time_us) (MaintenanceMgr.run_cpu_time_us, MaintenanceMgr.run_cpu_time_us) (MaintenanceMgr.run_wall_time_us, MaintenanceMgr.run_wall_time_us) (apply.queue_time_us, apply.queue_time_us) (apply.run_cpu_time_us, apply.run_cpu_time_us) (apply.run_wall_time_us, apply.run_wall_time_us) (client-negotiator.queue_time_us, client-negotiator.queue_time_us) (client-negotiator.run_cpu_time_us, client-negotiator.run_cpu_time_us) (client-negotiator.run_wall_time_us, client-negotiator.run_wall_time_us) (compiler_manager_pool.queue_time_us, compiler_manager_pool.queue_time_us) (compiler_manager_pool.run_cpu_time_us, compiler_manager_pool.run_cpu_time_us) (compiler_manager_pool.run_wall_time_us, compiler_manager_pool.run_wall_time_us) (dirs.queue_time_us, dirs.queue_time_us) (dirs.run_cpu_time_us, dirs.run_cpu_time_us) (dirs.run_wall_time_us, dirs.run_wall_time_us) (dns-resolver.queue_time_us, dns-resolver.queue_time_us) (dns-resolver.run_cpu_time_us, dns-resolver.run_cpu_time_us) (dns-resolver.run_wall_time_us, dns-resolver.run_wall_time_us) (prepare.queue_time_us, prepare.queue_time_us) (prepare.run_cpu_time_us, prepare.run_cpu_time_us) (prepare.run_wall_time_us, prepare.run_wall_time_us) (raft.queue_time_us, raft.queue_time_us) (raft.run_cpu_time_us, raft.run_cpu_time_us) (raft.run_wall_time_us, raft.run_wall_time_us) (repair_pool.queue_time_us, repair_pool.queue_time_us) (repair_pool.run_cpu_time_us, repair_pool.run_cpu_time_us) (repair_pool.run_wall_time_us, repair_pool.run_wall_time_us) (server-negotiator.queue_time_us, server-negotiator.queue_time_us) (server-negotiator.run_cpu_time_us, server-negotiator.run_cpu_time_us) (server-negotiator.run_wall_time_us, server-negotiator.run_wall_time_us) (tablet-copy.queue_time_us, tablet-copy.queue_time_us) (tablet-copy.run_cpu_time_us, tablet-copy.run_cpu_time_us) (tablet-copy.run_wall_time_us, tablet-copy.run_wall_time_us) (tablet-delete.queue_time_us, tablet-delete.queue_time_us) (tablet-delete.run_cpu_time_us, tablet-delete.run_cpu_time_us) (tablet-delete.run_wall_time_us, tablet-delete.run_wall_time_us) (tablet-download-pool-1fce17000ee743faa8292d031a6bc9d7.queue_time_us, tablet-download-pool-1fce17000ee743faa8292d031a6bc9d7.queue_time_us) (tablet-download-pool-1fce17000ee743faa8292d031a6bc9d7.run_cpu_time_us, tablet-download-pool-1fce17000ee743faa8292d031a6bc9d7.run_cpu_time_us) (tablet-download-pool-1fce17000ee743faa8292d031a6bc9d7.run_wall_time_us, tablet-download-pool-1fce17000ee743faa8292d031a6bc9d7.run_wall_time_us) (tablet-download-pool-21bd3b312b2c4a65b174cf60e87ecd22.queue_time_us, tablet-download-pool-21bd3b312b2c4a65b174cf60e87ecd22.queue_time_us) (tablet-download-pool-21bd3b312b2c4a65b174cf60e87ecd22.run_cpu_time_us, tablet-download-pool-21bd3b312b2c4a65b174cf60e87ecd22.run_cpu_time_us) (tablet-download-pool-21bd3b312b2c4a65b174cf60e87ecd22.run_wall_time_us, tablet-download-pool-21bd3b312b2c4a65b174cf60e87ecd22.run_wall_time_us) (tablet-download-pool-2969eb2e9bf042b3b74de0931fd4512a.queue_time_us, tablet-download-pool-2969eb2e9bf042b3b74de0931fd4512a.queue_time_us) (tablet-download-pool-2969eb2e9bf042b3b74de0931fd4512a.run_cpu_time_us, tablet-download-pool-2969eb2e9bf042b3b74de0931fd4512a.run_cpu_time_us) (tablet-download-pool-2969eb2e9bf042b3b74de0931fd4512a.run_wall_time_us, tablet-download-pool-2969eb2e9bf042b3b74de0931fd4512a.run_wall_time_us) (tablet-download-pool-2c6c74c1c01d42069114483dc4c0f6dc.queue_time_us, tablet-download-pool-2c6c74c1c01d42069114483dc4c0f6dc.queue_time_us) (tablet-download-pool-2c6c74c1c01d42069114483dc4c0f6dc.run_cpu_time_us, tablet-download-pool-2c6c74c1c01d42069114483dc4c0f6dc.run_cpu_time_us) (tablet-download-pool-2c6c74c1c01d42069114483dc4c0f6dc.run_wall_time_us, tablet-download-pool-2c6c74c1c01d42069114483dc4c0f6dc.run_wall_time_us) (tablet-download-pool-2dbb77573e7541d4be6260c0d29c6668.queue_time_us, tablet-download-pool-2dbb77573e7541d4be6260c0d29c6668.queue_time_us) (tablet-download-pool-2dbb77573e7541d4be6260c0d29c6668.run_cpu_time_us, tablet-download-pool-2dbb77573e7541d4be6260c0d29c6668.run_cpu_time_us) (tablet-download-pool-2dbb77573e7541d4be6260c0d29c6668.run_wall_time_us, tablet-download-pool-2dbb77573e7541d4be6260c0d29c6668.run_wall_time_us) (tablet-download-pool-3bff92f43b554c36aea44162bc8771cf.queue_time_us, tablet-download-pool-3bff92f43b554c36aea44162bc8771cf.queue_time_us) (tablet-download-pool-3bff92f43b554c36aea44162bc8771cf.run_cpu_time_us, tablet-download-pool-3bff92f43b554c36aea44162bc8771cf.run_cpu_time_us) (tablet-download-pool-3bff92f43b554c36aea44162bc8771cf.run_wall_time_us, tablet-download-pool-3bff92f43b554c36aea44162bc8771cf.run_wall_time_us) (tablet-download-pool-3db4892cd70f44e3a4cc40694a76a49d.queue_time_us, tablet-download-pool-3db4892cd70f44e3a4cc40694a76a49d.queue_time_us) (tablet-download-pool-3db4892cd70f44e3a4cc40694a76a49d.run_cpu_time_us, tablet-download-pool-3db4892cd70f44e3a4cc40694a76a49d.run_cpu_time_us) (tablet-download-pool-3db4892cd70f44e3a4cc40694a76a49d.run_wall_time_us, tablet-download-pool-3db4892cd70f44e3a4cc40694a76a49d.run_wall_time_us) (tablet-download-pool-4c9560832a4443e49e0be3b51feb4c35.queue_time_us, tablet-download-pool-4c9560832a4443e49e0be3b51feb4c35.queue_time_us) (tablet-download-pool-4c9560832a4443e49e0be3b51feb4c35.run_cpu_time_us, tablet-download-pool-4c9560832a4443e49e0be3b51feb4c35.run_cpu_time_us) (tablet-download-pool-4c9560832a4443e49e0be3b51feb4c35.run_wall_time_us, tablet-download-pool-4c9560832a4443e49e0be3b51feb4c35.run_wall_time_us) (tablet-download-pool-5f447883016e4eeb94762f46df482dd9.queue_time_us, tablet-download-pool-5f447883016e4eeb94762f46df482dd9.queue_time_us) (tablet-download-pool-5f447883016e4eeb94762f46df482dd9.run_cpu_time_us, tablet-download-pool-5f447883016e4eeb94762f46df482dd9.run_cpu_time_us) (tablet-download-pool-5f447883016e4eeb94762f46df482dd9.run_wall_time_us, tablet-download-pool-5f447883016e4eeb94762f46df482dd9.run_wall_time_us) (tablet-download-pool-6acf2a0111884ee0b3e16e8230f906d5.queue_time_us, tablet-download-pool-6acf2a0111884ee0b3e16e8230f906d5.queue_time_us) (tablet-download-pool-6acf2a0111884ee0b3e16e8230f906d5.run_cpu_time_us, tablet-download-pool-6acf2a0111884ee0b3e16e8230f906d5.run_cpu_time_us) (tablet-download-pool-6acf2a0111884ee0b3e16e8230f906d5.run_wall_time_us, tablet-download-pool-6acf2a0111884ee0b3e16e8230f906d5.run_wall_time_us) (tablet-download-pool-8059190ad08f4675a4c5b67554d5ccf7.queue_time_us, tablet-download-pool-8059190ad08f4675a4c5b67554d5ccf7.queue_time_us) (tablet-download-pool-8059190ad08f4675a4c5b67554d5ccf7.run_cpu_time_us, tablet-download-pool-8059190ad08f4675a4c5b67554d5ccf7.run_cpu_time_us) (tablet-download-pool-8059190ad08f4675a4c5b67554d5ccf7.run_wall_time_us, tablet-download-pool-8059190ad08f4675a4c5b67554d5ccf7.run_wall_time_us) (tablet-download-pool-8469e7783a644fa6bce033ee936573ab.queue_time_us, tablet-download-pool-8469e7783a644fa6bce033ee936573ab.queue_time_us) (tablet-download-pool-91d074cc385a4e2b8472275b83306411.queue_time_us, tablet-download-pool-91d074cc385a4e2b8472275b83306411.queue_time_us) (tablet-download-pool-91d074cc385a4e2b8472275b83306411.run_cpu_time_us, tablet-download-pool-91d074cc385a4e2b8472275b83306411.run_cpu_time_us) (tablet-download-pool-91d074cc385a4e2b8472275b83306411.run_wall_time_us, tablet-download-pool-91d074cc385a4e2b8472275b83306411.run_wall_time_us) (tablet-download-pool-947514e951cd4cfd8a9ecf315d113b94.queue_time_us, tablet-download-pool-947514e951cd4cfd8a9ecf315d113b94.queue_time_us) (tablet-download-pool-947514e951cd4cfd8a9ecf315d113b94.run_cpu_time_us, tablet-download-pool-947514e951cd4cfd8a9ecf315d113b94.run_cpu_time_us) (tablet-download-pool-947514e951cd4cfd8a9ecf315d113b94.run_wall_time_us, tablet-download-pool-947514e951cd4cfd8a9ecf315d113b94.run_wall_time_us) (tablet-download-pool-a504df8c6d7748f3a69a2ff947278f01.queue_time_us, tablet-download-pool-a504df8c6d7748f3a69a2ff947278f01.queue_time_us) (tablet-download-pool-a504df8c6d7748f3a69a2ff947278f01.run_cpu_time_us, tablet-download-pool-a504df8c6d7748f3a69a2ff947278f01.run_cpu_time_us) (tablet-download-pool-a504df8c6d7748f3a69a2ff947278f01.run_wall_time_us, tablet-download-pool-a504df8c6d7748f3a69a2ff947278f01.run_wall_time_us) (tablet-download-pool-cfbac30e5c164eed8b87d92516612668.queue_time_us, tablet-download-pool-cfbac30e5c164eed8b87d92516612668.queue_time_us) (tablet-download-pool-cfbac30e5c164eed8b87d92516612668.run_cpu_time_us, tablet-download-pool-cfbac30e5c164eed8b87d92516612668.run_cpu_time_us) (tablet-download-pool-cfbac30e5c164eed8b87d92516612668.run_wall_time_us, tablet-download-pool-cfbac30e5c164eed8b87d92516612668.run_wall_time_us) (tablet-download-pool-d158e8ecf4be4efba22cf094608766b7.queue_time_us, tablet-download-pool-d158e8ecf4be4efba22cf094608766b7.queue_time_us) (tablet-download-pool-d158e8ecf4be4efba22cf094608766b7.run_cpu_time_us, tablet-download-pool-d158e8ecf4be4efba22cf094608766b7.run_cpu_time_us) (tablet-download-pool-d158e8ecf4be4efba22cf094608766b7.run_wall_time_us, tablet-download-pool-d158e8ecf4be4efba22cf094608766b7.run_wall_time_us) (tablet-open.queue_time_us, tablet-open.queue_time_us) (tablet-open.run_cpu_time_us, tablet-open.run_cpu_time_us) (tablet-open.run_wall_time_us, tablet-open.run_wall_time_us) (txn-commit.queue_time_us, txn-commit.queue_time_us) (txn-commit.run_cpu_time_us, txn-commit.run_cpu_time_us) (txn-commit.run_wall_time_us, txn-commit.run_wall_time_us) (txn-participant-registration.queue_time_us, txn-participant-registration.queue_time_us) (txn-participant-registration.run_cpu_time_us, txn-participant-registration.run_cpu_time_us) (txn-participant-registration.run_wall_time_us, txn-participant-registration.run_wall_time_us) (txn-status-manager.queue_time_us, txn-status-manager.queue_time_us) (txn-status-manager.run_cpu_time_us, txn-status-manager.run_cpu_time_us) (txn-status-manager.run_wall_time_us, txn-status-manager.run_wall_time_us) (txn-status-tablet-reload.queue_time_us, txn-status-tablet-reload.queue_time_us) (txn-status-tablet-reload.run_cpu_time_us, txn-status-tablet-reload.run_cpu_time_us) (txn-status-tablet-reload.run_wall_time_us, txn-status-tablet-reload.run_wall_time_us)
*** Check failure stack trace: ***
I20240503 08:02:18.778141 19191 ts_tablet_manager.cc:902] T c8382412e13c4e25a852cad2d7bdc7ed P 5a05e724fe074ff1aba23f9f6996d51c: Initiating tablet copy from peer 230ccce6f4884106bafadcba4f2643f7 (127.14.95.129:43581)
W20240503 08:02:18.778352 19069 service_pool.cc:135] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items.
I20240503 08:02:18.778600 19069 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 1)
I20240503 08:02:18.778875 19069 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 1)
I20240503 08:02:18.779023 19069 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 1)
I20240503 08:02:18.779170 19069 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 1)
I20240503 08:02:18.779320 19069 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 1)
I20240503 08:02:18.779462 19069 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 1)
I20240503 08:02:18.779598 19069 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 1)
I20240503 08:02:18.779737 19069 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 1)
I20240503 08:02:18.779879 19069 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 1)
I20240503 08:02:18.781445 19078 tablet_copy_service.cc:140] P 230ccce6f4884106bafadcba4f2643f7: Received BeginTabletCopySession request for tablet cfbac30e5c164eed8b87d92516612668 from peer 5a05e724fe074ff1aba23f9f6996d51c ({username='slave'} at 127.14.95.130:34989)
I20240503 08:02:18.781611 19078 tablet_copy_service.cc:161] P 230ccce6f4884106bafadcba4f2643f7: Beginning new tablet copy session on tablet cfbac30e5c164eed8b87d92516612668 from peer 5a05e724fe074ff1aba23f9f6996d51c at {username='slave'} at 127.14.95.130:34989: session id = 5a05e724fe074ff1aba23f9f6996d51c-cfbac30e5c164eed8b87d92516612668
I20240503 08:02:18.782281 19069 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 1)
I20240503 08:02:18.782424 19069 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 1)
@ 0x7f92f14c8dcd google::LogMessage::Fail() at ??:0
I20240503 08:02:18.782516 19069 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 1)
I20240503 08:02:18.782603 19069 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 1)
I20240503 08:02:18.782683 19069 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 1)
I20240503 08:02:18.782945 19078 tablet_copy_source_session.cc:205] T cfbac30e5c164eed8b87d92516612668 P 230ccce6f4884106bafadcba4f2643f7: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:02:18.783835 19078 tablet_copy_service.cc:140] P 230ccce6f4884106bafadcba4f2643f7: Received BeginTabletCopySession request for tablet d158e8ecf4be4efba22cf094608766b7 from peer 5a05e724fe074ff1aba23f9f6996d51c ({username='slave'} at 127.14.95.130:34989)
I20240503 08:02:18.783931 19078 tablet_copy_service.cc:161] P 230ccce6f4884106bafadcba4f2643f7: Beginning new tablet copy session on tablet d158e8ecf4be4efba22cf094608766b7 from peer 5a05e724fe074ff1aba23f9f6996d51c at {username='slave'} at 127.14.95.130:34989: session id = 5a05e724fe074ff1aba23f9f6996d51c-d158e8ecf4be4efba22cf094608766b7
@ 0x7f92f14ccb93 google::LogMessage::SendToLog() at ??:0
I20240503 08:02:18.784752 19078 tablet_copy_source_session.cc:205] T d158e8ecf4be4efba22cf094608766b7 P 230ccce6f4884106bafadcba4f2643f7: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:02:18.788362 19160 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d158e8ecf4be4efba22cf094608766b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:18.789095 19164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfbac30e5c164eed8b87d92516612668. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f92f14c87cc google::LogMessage::Flush() at ??:0
I20240503 08:02:18.790318 19069 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 18)
I20240503 08:02:18.790947 19069 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 18)
I20240503 08:02:18.791093 19069 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 18)
I20240503 08:02:18.791244 19069 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 21)
I20240503 08:02:18.791388 19069 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 21)
@ 0x7f92f14c9f59 google::LogMessageFatal::~LogMessageFatal() at ??:0
I20240503 08:02:18.792037 19069 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 21)
I20240503 08:02:18.792644 19069 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 24)
I20240503 08:02:18.792791 19069 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 24)
I20240503 08:02:18.792914 19069 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 24)
I20240503 08:02:18.793092 19069 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 24)
I20240503 08:02:18.794571 19069 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 24)
I20240503 08:02:18.794739 19069 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 24)
@ 0x7f92f2932044 kudu::TraceMetrics::InternName() at ??:0
I20240503 08:02:18.796370 19078 tablet_copy_service.cc:140] P 230ccce6f4884106bafadcba4f2643f7: Received BeginTabletCopySession request for tablet 4c9560832a4443e49e0be3b51feb4c35 from peer 5a05e724fe074ff1aba23f9f6996d51c ({username='slave'} at 127.14.95.130:34989)
I20240503 08:02:18.796465 19078 tablet_copy_service.cc:161] P 230ccce6f4884106bafadcba4f2643f7: Beginning new tablet copy session on tablet 4c9560832a4443e49e0be3b51feb4c35 from peer 5a05e724fe074ff1aba23f9f6996d51c at {username='slave'} at 127.14.95.130:34989: session id = 5a05e724fe074ff1aba23f9f6996d51c-4c9560832a4443e49e0be3b51feb4c35
I20240503 08:02:18.796644 19160 tablet_copy_client.cc:783] T d158e8ecf4be4efba22cf094608766b7 P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Starting download of 0 data blocks...
I20240503 08:02:18.796833 19160 tablet_copy_client.cc:647] T d158e8ecf4be4efba22cf094608766b7 P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Starting download of 1 WAL segments...
I20240503 08:02:18.797652 19069 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 24)
I20240503 08:02:18.798501 19078 tablet_copy_source_session.cc:205] T 4c9560832a4443e49e0be3b51feb4c35 P 230ccce6f4884106bafadcba4f2643f7: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:02:18.798746 19078 tablet_copy_service.cc:140] P 230ccce6f4884106bafadcba4f2643f7: Received BeginTabletCopySession request for tablet a504df8c6d7748f3a69a2ff947278f01 from peer 5a05e724fe074ff1aba23f9f6996d51c ({username='slave'} at 127.14.95.130:34989)
I20240503 08:02:18.798828 19078 tablet_copy_service.cc:161] P 230ccce6f4884106bafadcba4f2643f7: Beginning new tablet copy session on tablet a504df8c6d7748f3a69a2ff947278f01 from peer 5a05e724fe074ff1aba23f9f6996d51c at {username='slave'} at 127.14.95.130:34989: session id = 5a05e724fe074ff1aba23f9f6996d51c-a504df8c6d7748f3a69a2ff947278f01
I20240503 08:02:18.799558 19078 tablet_copy_source_session.cc:205] T a504df8c6d7748f3a69a2ff947278f01 P 230ccce6f4884106bafadcba4f2643f7: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:02:18.800297 19166 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c9560832a4443e49e0be3b51feb4c35. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f92f2916f98 kudu::ThreadPool::ThreadPool() at ??:0
I20240503 08:02:18.802506 19166 tablet_copy_client.cc:783] T 4c9560832a4443e49e0be3b51feb4c35 P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Starting download of 0 data blocks...
I20240503 08:02:18.802667 19166 tablet_copy_client.cc:647] T 4c9560832a4443e49e0be3b51feb4c35 P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Starting download of 1 WAL segments...
I20240503 08:02:18.803411 19162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a504df8c6d7748f3a69a2ff947278f01. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:18.803447 19164 tablet_copy_client.cc:783] T cfbac30e5c164eed8b87d92516612668 P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Starting download of 0 data blocks...
I20240503 08:02:18.803555 19164 tablet_copy_client.cc:647] T cfbac30e5c164eed8b87d92516612668 P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Starting download of 1 WAL segments...
I20240503 08:02:18.805552 19166 tablet_copy_client.cc:523] T 4c9560832a4443e49e0be3b51feb4c35 P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:02:18.805634 19162 tablet_copy_client.cc:783] T a504df8c6d7748f3a69a2ff947278f01 P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Starting download of 0 data blocks...
I20240503 08:02:18.805737 19162 tablet_copy_client.cc:647] T a504df8c6d7748f3a69a2ff947278f01 P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Starting download of 1 WAL segments...
I20240503 08:02:18.807399 19166 tablet_bootstrap.cc:492] T 4c9560832a4443e49e0be3b51feb4c35 P 5a05e724fe074ff1aba23f9f6996d51c: Bootstrap starting.
@ 0x7f92f2914efc kudu::ThreadPoolBuilder::Build() at ??:0
I20240503 08:02:18.808521 19069 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.14.95.130:34989 (request call id 33)
I20240503 08:02:18.808706 19069 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.14.95.130:34989 (request call id 33)
@ 0x7f92f54c777a kudu::tserver::TabletCopyClient::TabletCopyClient() at ??:0
I20240503 08:02:18.813464 19078 tablet_copy_service.cc:140] P 230ccce6f4884106bafadcba4f2643f7: Received BeginTabletCopySession request for tablet 1fce17000ee743faa8292d031a6bc9d7 from peer 5a05e724fe074ff1aba23f9f6996d51c ({username='slave'} at 127.14.95.130:34989)
I20240503 08:02:18.813578 19078 tablet_copy_service.cc:161] P 230ccce6f4884106bafadcba4f2643f7: Beginning new tablet copy session on tablet 1fce17000ee743faa8292d031a6bc9d7 from peer 5a05e724fe074ff1aba23f9f6996d51c at {username='slave'} at 127.14.95.130:34989: session id = 5a05e724fe074ff1aba23f9f6996d51c-1fce17000ee743faa8292d031a6bc9d7
I20240503 08:02:18.814579 19078 tablet_copy_source_session.cc:205] T 1fce17000ee743faa8292d031a6bc9d7 P 230ccce6f4884106bafadcba4f2643f7: Tablet Copy: opened 0 blocks and 1 log segments
@ 0x7f92f54d0a45 kudu::tserver::RemoteTabletCopyClient::RemoteTabletCopyClient() at ??:0
I20240503 08:02:18.815507 19171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1fce17000ee743faa8292d031a6bc9d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:18.817699 19171 tablet_copy_client.cc:783] T 1fce17000ee743faa8292d031a6bc9d7 P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Starting download of 0 data blocks...
I20240503 08:02:18.817842 19171 tablet_copy_client.cc:647] T 1fce17000ee743faa8292d031a6bc9d7 P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Starting download of 1 WAL segments...
I20240503 08:02:18.818567 19069 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 37)
I20240503 08:02:18.818749 19069 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 39)
I20240503 08:02:18.819334 19069 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 39)
I20240503 08:02:18.819481 19069 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 39)
I20240503 08:02:18.819828 19069 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 39)
I20240503 08:02:18.820001 19069 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 39)
I20240503 08:02:18.820575 19069 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 39)
I20240503 08:02:18.820842 19078 tablet_copy_service.cc:140] P 230ccce6f4884106bafadcba4f2643f7: Received BeginTabletCopySession request for tablet 3bff92f43b554c36aea44162bc8771cf from peer 5a05e724fe074ff1aba23f9f6996d51c ({username='slave'} at 127.14.95.130:34989)
I20240503 08:02:18.820938 19078 tablet_copy_service.cc:161] P 230ccce6f4884106bafadcba4f2643f7: Beginning new tablet copy session on tablet 3bff92f43b554c36aea44162bc8771cf from peer 5a05e724fe074ff1aba23f9f6996d51c at {username='slave'} at 127.14.95.130:34989: session id = 5a05e724fe074ff1aba23f9f6996d51c-3bff92f43b554c36aea44162bc8771cf
I20240503 08:02:18.821072 19160 tablet_copy_client.cc:523] T d158e8ecf4be4efba22cf094608766b7 P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:02:18.821925 19078 tablet_copy_source_session.cc:205] T 3bff92f43b554c36aea44162bc8771cf P 230ccce6f4884106bafadcba4f2643f7: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:02:18.822443 19078 tablet_copy_service.cc:140] P 230ccce6f4884106bafadcba4f2643f7: Received BeginTabletCopySession request for tablet 947514e951cd4cfd8a9ecf315d113b94 from peer 5a05e724fe074ff1aba23f9f6996d51c ({username='slave'} at 127.14.95.130:34989)
I20240503 08:02:18.822531 19078 tablet_copy_service.cc:161] P 230ccce6f4884106bafadcba4f2643f7: Beginning new tablet copy session on tablet 947514e951cd4cfd8a9ecf315d113b94 from peer 5a05e724fe074ff1aba23f9f6996d51c at {username='slave'} at 127.14.95.130:34989: session id = 5a05e724fe074ff1aba23f9f6996d51c-947514e951cd4cfd8a9ecf315d113b94
I20240503 08:02:18.822602 19173 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bff92f43b554c36aea44162bc8771cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:18.823377 19078 tablet_copy_source_session.cc:205] T 947514e951cd4cfd8a9ecf315d113b94 P 230ccce6f4884106bafadcba4f2643f7: Tablet Copy: opened 0 blocks and 1 log segments
@ 0x7f92f555176f kudu::tserver::TSTabletManager::RunTabletCopy() at ??:0
I20240503 08:02:18.824100 19170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 947514e951cd4cfd8a9ecf315d113b94. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:18.824786 19173 tablet_copy_client.cc:783] T 3bff92f43b554c36aea44162bc8771cf P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Starting download of 0 data blocks...
I20240503 08:02:18.824932 19173 tablet_copy_client.cc:647] T 3bff92f43b554c36aea44162bc8771cf P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Starting download of 1 WAL segments...
I20240503 08:02:18.826213 19170 tablet_copy_client.cc:783] T 947514e951cd4cfd8a9ecf315d113b94 P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Starting download of 0 data blocks...
I20240503 08:02:18.826360 19170 tablet_copy_client.cc:647] T 947514e951cd4cfd8a9ecf315d113b94 P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Starting download of 1 WAL segments...
I20240503 08:02:18.826956 19069 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 46)
I20240503 08:02:18.827133 19069 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 46)
I20240503 08:02:18.827311 19078 tablet_copy_service.cc:140] P 230ccce6f4884106bafadcba4f2643f7: Received BeginTabletCopySession request for tablet 5f447883016e4eeb94762f46df482dd9 from peer 5a05e724fe074ff1aba23f9f6996d51c ({username='slave'} at 127.14.95.130:34989)
I20240503 08:02:18.827387 19078 tablet_copy_service.cc:161] P 230ccce6f4884106bafadcba4f2643f7: Beginning new tablet copy session on tablet 5f447883016e4eeb94762f46df482dd9 from peer 5a05e724fe074ff1aba23f9f6996d51c at {username='slave'} at 127.14.95.130:34989: session id = 5a05e724fe074ff1aba23f9f6996d51c-5f447883016e4eeb94762f46df482dd9
@ 0x7f92f55654f6 kudu::tserver::TabletCopyRunnable::Run() at ??:0
I20240503 08:02:18.828402 19078 tablet_copy_source_session.cc:205] T 5f447883016e4eeb94762f46df482dd9 P 230ccce6f4884106bafadcba4f2643f7: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:02:18.829735 19163 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f447883016e4eeb94762f46df482dd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:18.829952 19069 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.14.95.130:34989 (request call id 49)
I20240503 08:02:18.831861 19163 tablet_copy_client.cc:783] T 5f447883016e4eeb94762f46df482dd9 P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Starting download of 0 data blocks...
I20240503 08:02:18.831988 19163 tablet_copy_client.cc:647] T 5f447883016e4eeb94762f46df482dd9 P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Starting download of 1 WAL segments...
I20240503 08:02:18.833797 19160 tablet_bootstrap.cc:492] T d158e8ecf4be4efba22cf094608766b7 P 5a05e724fe074ff1aba23f9f6996d51c: Bootstrap starting.
@ 0x7f92f5550226 _ZZN4kudu7tserver15TSTabletManager15StartTabletCopyEPKNS_9consensus24StartTabletCopyRequestPBESt8functionIFvRKNS_6StatusENS0_24TabletServerErrorPB_CodeEEEENKUlvE_clEv at ??:0
@ 0x7f92f555fc0a _ZNSt17_Function_handlerIFvvEZN4kudu7tserver15TSTabletManager15StartTabletCopyEPKNS1_9consensus24StartTabletCopyRequestPBESt8functionIFvRKNS1_6StatusENS2_24TabletServerErrorPB_CodeEEEEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x56121c18a75c std::function<>::operator()() at ??:0
I20240503 08:02:18.839031 19069 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 52)
I20240503 08:02:18.839676 19170 tablet_copy_client.cc:523] T 947514e951cd4cfd8a9ecf315d113b94 P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:02:18.841100 19170 tablet_bootstrap.cc:492] T 947514e951cd4cfd8a9ecf315d113b94 P 5a05e724fe074ff1aba23f9f6996d51c: Bootstrap starting.
@ 0x7f92f2919e06 kudu::ThreadPool::DispatchThread() at ??:0
I20240503 08:02:18.845686 19171 tablet_copy_client.cc:523] T 1fce17000ee743faa8292d031a6bc9d7 P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:02:18.847036 19171 tablet_bootstrap.cc:492] T 1fce17000ee743faa8292d031a6bc9d7 P 5a05e724fe074ff1aba23f9f6996d51c: Bootstrap starting.
I20240503 08:02:18.854776 19069 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 52)
I20240503 08:02:18.855212 19069 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 52)
I20240503 08:02:18.855571 19078 tablet_copy_service.cc:140] P 230ccce6f4884106bafadcba4f2643f7: Received BeginTabletCopySession request for tablet 2dbb77573e7541d4be6260c0d29c6668 from peer 5a05e724fe074ff1aba23f9f6996d51c ({username='slave'} at 127.14.95.130:34989)
I20240503 08:02:18.855665 19078 tablet_copy_service.cc:161] P 230ccce6f4884106bafadcba4f2643f7: Beginning new tablet copy session on tablet 2dbb77573e7541d4be6260c0d29c6668 from peer 5a05e724fe074ff1aba23f9f6996d51c at {username='slave'} at 127.14.95.130:34989: session id = 5a05e724fe074ff1aba23f9f6996d51c-2dbb77573e7541d4be6260c0d29c6668
I20240503 08:02:18.856613 19078 tablet_copy_source_session.cc:205] T 2dbb77573e7541d4be6260c0d29c6668 P 230ccce6f4884106bafadcba4f2643f7: Tablet Copy: opened 0 blocks and 1 log segments
@ 0x7f92f291a6ef _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
I20240503 08:02:18.857424 19175 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2dbb77573e7541d4be6260c0d29c6668. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:02:18.859496 19175 tablet_copy_client.cc:783] T 2dbb77573e7541d4be6260c0d29c6668 P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Starting download of 0 data blocks...
I20240503 08:02:18.859638 19175 tablet_copy_client.cc:647] T 2dbb77573e7541d4be6260c0d29c6668 P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Starting download of 1 WAL segments...
@ 0x7f92f291c03b _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x56121c18a75c std::function<>::operator()() at ??:0
I20240503 08:02:18.862010 19069 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 52)
I20240503 08:02:18.862591 19069 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 52)
I20240503 08:02:18.863276 19069 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 52)
I20240503 08:02:18.867072 19166 log.cc:824] T 4c9560832a4443e49e0be3b51feb4c35 P 5a05e724fe074ff1aba23f9f6996d51c: Log is configured to *not* fsync() on all Append() calls
I20240503 08:02:18.867705 19078 tablet_copy_service.cc:140] P 230ccce6f4884106bafadcba4f2643f7: Received BeginTabletCopySession request for tablet 6acf2a0111884ee0b3e16e8230f906d5 from peer 5a05e724fe074ff1aba23f9f6996d51c ({username='slave'} at 127.14.95.130:34989)
I20240503 08:02:18.867815 19078 tablet_copy_service.cc:161] P 230ccce6f4884106bafadcba4f2643f7: Beginning new tablet copy session on tablet 6acf2a0111884ee0b3e16e8230f906d5 from peer 5a05e724fe074ff1aba23f9f6996d51c at {username='slave'} at 127.14.95.130:34989: session id = 5a05e724fe074ff1aba23f9f6996d51c-6acf2a0111884ee0b3e16e8230f906d5
I20240503 08:02:18.868692 19078 tablet_copy_source_session.cc:205] T 6acf2a0111884ee0b3e16e8230f906d5 P 230ccce6f4884106bafadcba4f2643f7: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:02:18.869485 19174 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6acf2a0111884ee0b3e16e8230f906d5. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f92f2909807 kudu::Thread::SuperviseThread() at ??:0
I20240503 08:02:18.871624 19174 tablet_copy_client.cc:783] T 6acf2a0111884ee0b3e16e8230f906d5 P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Starting download of 0 data blocks...
I20240503 08:02:18.871764 19174 tablet_copy_client.cc:647] T 6acf2a0111884ee0b3e16e8230f906d5 P 5a05e724fe074ff1aba23f9f6996d51c: tablet copy: Starting download of 1 WAL segments...
@ 0x7f92f31476db start_thread at ??:0
I20240503 08:02:18.873373 19069 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.95.130:34989 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.95.130:34989 (request call id 61)
I20240503 08:02:18.875181 19078 tablet_copy_service.cc:140] P 230ccce6f4884106bafadcba4f2643f7: Received BeginTabletCopySession request for tablet 2c6c74c1c01d42069114483dc4c0f6dc from peer 5a05e724fe074ff1aba23f9f6996d51c ({username='slave'} at 127.14.95.130:34989)
I20240503 08:02:18.875276 19078 tablet_copy_service.cc:161] P 230ccce6f4884106bafadcba4f2643f7: Beginning new tablet copy session on tablet 2c6c74c1c01d42069114483dc4c0f6dc from peer 5a05e724fe074ff1aba23f9f6996d51c at {username='slave'} at 127.14.95.130:34989: session id = 5a05e724fe074ff1aba23f9f6996d51c-2c6c74c1c01d42069114483dc4c0f6dc
@ 0x7f92f067f71f clone at ??:0
I20240503 08:02:18.876720 19078 tablet_copy_source_session.cc:205] T 2c6c74c1c01d42069114483dc4c0f6dc P 230ccce6f4884106bafadcba4f2643f7: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:02:18.877046 19078 tablet_copy_service.cc:140] P 230ccce6f4884106bafadcba4f2643f7: Received BeginTabletCopySession request for tablet 8059190ad08f4675a4c5b67554d5ccf7 from peer 5a05e724fe074ff1aba23f9f6996d51c ({username='slave'} at 127.14.95.130:34989)
I20240503 08:02:18.877137 19078 tablet_copy_service.cc:161] P 230ccce6f4884106bafadcba4f2643f7: Beginning new tablet copy session on tablet 8059190ad08f4675a4c5b67554d5ccf7 from peer 5a05e724fe074ff1aba23f9f6996d51c at {username='slave'} at 127.14.95.130:34989: session id = 5a05e724fe074ff1aba23f9f6996d51c-8059190ad08f4675a4c5b67554d5ccf7
I20240503 08:02:18.877933 19078 tablet_copy_source_session.cc:205] T 8059190ad08f4675a4c5b67554d5ccf7 P 230ccce6f4884106bafadcba4f2643f7: Tablet Copy: opened 0 blocks and 1 log segments
W20240503 08:02:19.058280 19069 connection.cc:535] server connection from 127.14.95.130:34989 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20240503 08:02:19.058370 18368 connection.cc:535] client connection to 127.14.95.130:41103 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
F20240503 08:02:19.058768 19143 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
*** Aborted at 1714723339 (unix time) try "date -d @1714723339" if you are using GNU date ***
F20240503 08:02:19.058768 19143 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.058820 19155 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
F20240503 08:02:19.058768 19143 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.058820 19155 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.058871 19140 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
F20240503 08:02:19.058768 19143 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.058820 19155 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.058871 19140 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.058743 19153 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
F20240503 08:02:19.058768 19143 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.058820 19155 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.058871 19140 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.058743 19153 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.058959 19151 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
F20240503 08:02:19.058768 19143 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.058820 19155 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.058871 19140 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.058743 19153 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.058959 19151 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.058856 19145 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
F20240503 08:02:19.058768 19143 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.058820 19155 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.058871 19140 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.058743 19153 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.058959 19151 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.058856 19145 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.059031 19159 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
F20240503 08:02:19.058768 19143 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.058820 19155 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.058871 19140 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.058743 19153 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.058959 19151 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.058856 19145 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.059031 19159 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.058759 19154 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
F20240503 08:02:19.058768 19143 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.058820 19155 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.058871 19140 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.058743 19153 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.058959 19151 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.058856 19145 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.059031 19159 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.058759 19154 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:02:19.058745 19157 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
F20240503 08:02:19.058743 19138 tablet_copy_client_session-itest.cc:313] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e80000397e) received by PID 14718 (TID 0x7f527f2b4700) from PID 14718; stack trace: ***
@ 0x7f52954cc980 (unknown) at ??:0
@ 0x7f52933bafb7 gsignal at ??:0
@ 0x7f52933bc921 abort at ??:0
@ 0x7f5294225dcd google::LogMessage::Fail() at ??:0
@ 0x7f5294229b93 google::LogMessage::SendToLog() at ??:0
@ 0x7f52942257cc google::LogMessage::Flush() at ??:0
@ 0x7f5294226f59 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x564426afd088 _ZZN4kudu62TabletCopyClientSessionITest_TestTabletCopyWithBusySource_Test8TestBodyEvENKUlvE_clEv at ??:0
@ 0x564426b00a35 _ZSt13__invoke_implIvZN4kudu62TabletCopyClientSessionITest_TestTabletCopyWithBusySource_Test8TestBodyEvEUlvE_JEET_St14__invoke_otherOT0_DpOT1_ at ??:0
@ 0x564426b00207 _ZSt8__invokeIZN4kudu62TabletCopyClientSessionITest_TestTabletCopyWithBusySource_Test8TestBodyEvEUlvE_JEENSt15__invoke_resultIT_JDpT0_EE4typeEOS4_DpOS5_ at ??:0
@ 0x564426b026e6 _ZNSt6thread8_InvokerISt5tupleIJZN4kudu62TabletCopyClientSessionITest_TestTabletCopyWithBusySource_Test8TestBodyEvEUlvE_EEE9_M_invokeIJLm0EEEEDTcl8__invokespcl10_S_declvalIXT_EEEEESt12_Index_tupleIJXspT_EEE at ??:0
@ 0x564426b0265f _ZNSt6thread8_InvokerISt5tupleIJZN4kudu62TabletCopyClientSessionITest_TestTabletCopyWithBusySource_Test8TestBodyEvEUlvE_EEEclEv at ??:0
@ 0x564426b025f6 _ZNSt6thread11_State_implINS_8_InvokerISt5tupleIJZN4kudu62TabletCopyClientSessionITest_TestTabletCopyWithBusySource_Test8TestBodyEvEUlvE_EEEEE6_M_runEv at ??:0
@ 0x7f5293a426df (unknown) at ??:0
@ 0x7f52954c16db start_thread at ??:0
@ 0x7f529349d71f clone at ??:0