[==========] Running 5 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 5 tests from TabletCopyClientSessionITest
[ RUN ] TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping
2024-05-03T08:15:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-03T08:15:03Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20240503 08:15:03.333336 7506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqhmq97/build/asan/bin/kudu
/tmp/dist-test-taskqhmq97/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.84.190:42907
--webserver_interface=127.7.84.190
--webserver_port=0
--builtin_ntp_servers=127.7.84.148:40539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.84.190:42907
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240503 08:15:03.636463 7514 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:15:03.636766 7514 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:15:03.636901 7514 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:15:03.644043 7514 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240503 08:15:03.644147 7514 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:15:03.644225 7514 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240503 08:15:03.644304 7514 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240503 08:15:03.652891 7514 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.84.148:40539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.7.84.190:42907
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.84.190:42907
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.84.190
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 07:43:23 UTC on efd1337a2aa3
build id 103
ASAN enabled
I20240503 08:15:03.654106 7514 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:15:03.655797 7514 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:15:03.665988 7520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:03.666420 7519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:03.666669 7522 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:15:03.667169 7514 server_base.cc:1034] running on GCE node
I20240503 08:15:03.667883 7514 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:15:03.669157 7514 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:15:03.670357 7514 hybrid_clock.cc:648] HybridClock initialized: now 1714724103670299 us; error 34 us; skew 500 ppm
I20240503 08:15:03.670648 7514 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:15:03.672748 7514 webserver.cc:460] Webserver started at http://127.7.84.190:44063/ using document root <none> and password file <none>
I20240503 08:15:03.673455 7514 fs_manager.cc:359] Metadata directory not provided
I20240503 08:15:03.673573 7514 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:15:03.673842 7514 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:15:03.676319 7514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/master-0/data/instance:
uuid: "5549e64e15144b4f992a9f95b6e3d3be"
format_stamp: "Formatted at 2024-05-03 08:15:03 on dist-test-slave-2jf9"
I20240503 08:15:03.677017 7514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/master-0/wal/instance:
uuid: "5549e64e15144b4f992a9f95b6e3d3be"
format_stamp: "Formatted at 2024-05-03 08:15:03 on dist-test-slave-2jf9"
I20240503 08:15:03.682006 7514 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20240503 08:15:03.685068 7528 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:03.686259 7514 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20240503 08:15:03.686412 7514 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/master-0/data,/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/master-0/wal
uuid: "5549e64e15144b4f992a9f95b6e3d3be"
format_stamp: "Formatted at 2024-05-03 08:15:03 on dist-test-slave-2jf9"
I20240503 08:15:03.686748 7514 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:15:03.705981 7514 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:15:03.706753 7514 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:15:03.707016 7514 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:15:03.723383 7514 rpc_server.cc:307] RPC server started. Bound to: 127.7.84.190:42907
I20240503 08:15:03.723421 7579 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.84.190:42907 every 8 connection(s)
I20240503 08:15:03.724841 7514 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/master-0/data/info.pb
I20240503 08:15:03.728300 7580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:03.734817 7506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqhmq97/build/asan/bin/kudu as pid 7514
I20240503 08:15:03.735052 7506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/master-0/wal/instance
I20240503 08:15:03.736804 7580 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be: Bootstrap starting.
I20240503 08:15:03.740008 7580 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be: Neither blocks nor log segments found. Creating new log.
I20240503 08:15:03.741320 7580 log.cc:824] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be: Log is configured to *not* fsync() on all Append() calls
I20240503 08:15:03.743721 7580 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be: No bootstrap required, opened a new log
I20240503 08:15:03.750028 7580 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5549e64e15144b4f992a9f95b6e3d3be" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 42907 } }
I20240503 08:15:03.750351 7580 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:15:03.750463 7580 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5549e64e15144b4f992a9f95b6e3d3be, State: Initialized, Role: FOLLOWER
I20240503 08:15:03.751031 7580 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5549e64e15144b4f992a9f95b6e3d3be" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 42907 } }
I20240503 08:15:03.751216 7580 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:03.751323 7580 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:03.751469 7580 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:15:03.753489 7580 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5549e64e15144b4f992a9f95b6e3d3be" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 42907 } }
I20240503 08:15:03.753921 7580 leader_election.cc:302] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5549e64e15144b4f992a9f95b6e3d3be; no voters:
I20240503 08:15:03.754424 7580 leader_election.cc:288] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:15:03.754585 7585 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:15:03.755971 7585 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be [term 1 LEADER]: Becoming Leader. State: Replica: 5549e64e15144b4f992a9f95b6e3d3be, State: Running, Role: LEADER
I20240503 08:15:03.756525 7585 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5549e64e15144b4f992a9f95b6e3d3be" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 42907 } }
I20240503 08:15:03.757161 7580 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be [sys.catalog]: configured and running, proceeding with master startup.
I20240503 08:15:03.759856 7587 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5549e64e15144b4f992a9f95b6e3d3be. Latest consensus state: current_term: 1 leader_uuid: "5549e64e15144b4f992a9f95b6e3d3be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5549e64e15144b4f992a9f95b6e3d3be" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 42907 } } }
I20240503 08:15:03.760109 7587 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be [sys.catalog]: This master's current role is: LEADER
I20240503 08:15:03.761693 7586 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5549e64e15144b4f992a9f95b6e3d3be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5549e64e15144b4f992a9f95b6e3d3be" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 42907 } } }
I20240503 08:15:03.761909 7586 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be [sys.catalog]: This master's current role is: LEADER
I20240503 08:15:03.763262 7591 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240503 08:15:03.768172 7591 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240503 08:15:03.780269 7591 catalog_manager.cc:1347] Generated new cluster ID: afa7d53a46ed47d9ad758c5ecb4f69be
I20240503 08:15:03.780431 7591 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240503 08:15:03.793818 7591 catalog_manager.cc:1370] Generated new certificate authority record
I20240503 08:15:03.795418 7591 catalog_manager.cc:1504] Loading token signing keys...
I20240503 08:15:03.811045 7591 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be: Generated new TSK 0
I20240503 08:15:03.811973 7591 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240503 08:15:03.825719 7506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqhmq97/build/asan/bin/kudu
/tmp/dist-test-taskqhmq97/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.84.129:0
--local_ip_for_outbound_sockets=127.7.84.129
--webserver_interface=127.7.84.129
--webserver_port=0
--tserver_master_addrs=127.7.84.190:42907
--builtin_ntp_servers=127.7.84.148:40539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240503 08:15:04.153762 7604 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:15:04.154011 7604 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:15:04.154099 7604 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:15:04.161247 7604 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:15:04.161419 7604 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.84.129
I20240503 08:15:04.170157 7604 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.84.148:40539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.84.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.84.129
--webserver_port=0
--tserver_master_addrs=127.7.84.190:42907
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.84.129
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 07:43:23 UTC on efd1337a2aa3
build id 103
ASAN enabled
I20240503 08:15:04.171435 7604 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:15:04.173245 7604 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:15:04.184432 7609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:04.184707 7612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:04.185144 7610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:15:04.185734 7604 server_base.cc:1034] running on GCE node
I20240503 08:15:04.186239 7604 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:15:04.187106 7604 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:15:04.188302 7604 hybrid_clock.cc:648] HybridClock initialized: now 1714724104188244 us; error 37 us; skew 500 ppm
I20240503 08:15:04.188576 7604 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:15:04.193723 7604 webserver.cc:460] Webserver started at http://127.7.84.129:45175/ using document root <none> and password file <none>
I20240503 08:15:04.194387 7604 fs_manager.cc:359] Metadata directory not provided
I20240503 08:15:04.194507 7604 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:15:04.194779 7604 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:15:04.197211 7604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/data/instance:
uuid: "d996cd72cfab427d82c659abb0408095"
format_stamp: "Formatted at 2024-05-03 08:15:04 on dist-test-slave-2jf9"
I20240503 08:15:04.197898 7604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/wal/instance:
uuid: "d996cd72cfab427d82c659abb0408095"
format_stamp: "Formatted at 2024-05-03 08:15:04 on dist-test-slave-2jf9"
I20240503 08:15:04.202507 7604 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20240503 08:15:04.205577 7618 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:04.206738 7604 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240503 08:15:04.206873 7604 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/wal
uuid: "d996cd72cfab427d82c659abb0408095"
format_stamp: "Formatted at 2024-05-03 08:15:04 on dist-test-slave-2jf9"
I20240503 08:15:04.207029 7604 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:15:04.233636 7604 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:15:04.234331 7604 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:15:04.234584 7604 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:15:04.235383 7604 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:15:04.236789 7604 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:15:04.236861 7604 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:04.236971 7604 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:15:04.237020 7604 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:04.271421 7604 rpc_server.cc:307] RPC server started. Bound to: 127.7.84.129:43579
I20240503 08:15:04.271479 7730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.84.129:43579 every 8 connection(s)
I20240503 08:15:04.273028 7604 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/data/info.pb
I20240503 08:15:04.273504 7506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqhmq97/build/asan/bin/kudu as pid 7604
I20240503 08:15:04.273702 7506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/wal/instance
I20240503 08:15:04.277657 7506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqhmq97/build/asan/bin/kudu
/tmp/dist-test-taskqhmq97/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.84.130:0
--local_ip_for_outbound_sockets=127.7.84.130
--webserver_interface=127.7.84.130
--webserver_port=0
--tserver_master_addrs=127.7.84.190:42907
--builtin_ntp_servers=127.7.84.148:40539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240503 08:15:04.292694 7731 heartbeater.cc:347] Connected to a master server at 127.7.84.190:42907
I20240503 08:15:04.292968 7731 heartbeater.cc:464] Registering TS with master...
I20240503 08:15:04.293721 7731 heartbeater.cc:511] Master 127.7.84.190:42907 requested a full tablet report, sending...
I20240503 08:15:04.295569 7545 ts_manager.cc:194] Registered new tserver with Master: d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:04.297008 7545 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.84.129:43101
W20240503 08:15:04.587668 7735 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:15:04.587945 7735 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:15:04.588038 7735 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:15:04.595268 7735 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:15:04.595464 7735 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.84.130
I20240503 08:15:04.604130 7735 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.84.148:40539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.84.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.84.130
--webserver_port=0
--tserver_master_addrs=127.7.84.190:42907
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.84.130
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 07:43:23 UTC on efd1337a2aa3
build id 103
ASAN enabled
I20240503 08:15:04.605343 7735 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:15:04.606998 7735 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:15:04.618122 7740 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:04.618584 7741 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:04.619004 7743 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:15:04.619282 7735 server_base.cc:1034] running on GCE node
I20240503 08:15:04.619859 7735 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:15:04.620677 7735 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:15:04.621887 7735 hybrid_clock.cc:648] HybridClock initialized: now 1714724104621824 us; error 38 us; skew 500 ppm
I20240503 08:15:04.622182 7735 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:15:04.624269 7735 webserver.cc:460] Webserver started at http://127.7.84.130:40021/ using document root <none> and password file <none>
I20240503 08:15:04.624941 7735 fs_manager.cc:359] Metadata directory not provided
I20240503 08:15:04.625061 7735 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:15:04.625331 7735 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:15:04.627970 7735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data/instance:
uuid: "02e1007970d643568e7b76a5a341364c"
format_stamp: "Formatted at 2024-05-03 08:15:04 on dist-test-slave-2jf9"
I20240503 08:15:04.631789 7735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/wal/instance:
uuid: "02e1007970d643568e7b76a5a341364c"
format_stamp: "Formatted at 2024-05-03 08:15:04 on dist-test-slave-2jf9"
I20240503 08:15:04.636917 7735 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20240503 08:15:04.640066 7749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:04.641288 7735 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20240503 08:15:04.641429 7735 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/wal
uuid: "02e1007970d643568e7b76a5a341364c"
format_stamp: "Formatted at 2024-05-03 08:15:04 on dist-test-slave-2jf9"
I20240503 08:15:04.641604 7735 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:15:04.666009 7735 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:15:04.666759 7735 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:15:04.667011 7735 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:15:04.667888 7735 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:15:04.669271 7735 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:15:04.669340 7735 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:04.669451 7735 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:15:04.669503 7735 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:04.697649 7735 rpc_server.cc:307] RPC server started. Bound to: 127.7.84.130:41355
I20240503 08:15:04.697683 7861 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.84.130:41355 every 8 connection(s)
I20240503 08:15:04.698864 7735 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data/info.pb
I20240503 08:15:04.704998 7506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqhmq97/build/asan/bin/kudu as pid 7735
I20240503 08:15:04.705194 7506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/wal/instance
I20240503 08:15:04.710747 7862 heartbeater.cc:347] Connected to a master server at 127.7.84.190:42907
I20240503 08:15:04.711021 7862 heartbeater.cc:464] Registering TS with master...
I20240503 08:15:04.711784 7862 heartbeater.cc:511] Master 127.7.84.190:42907 requested a full tablet report, sending...
I20240503 08:15:04.713001 7545 ts_manager.cc:194] Registered new tserver with Master: 02e1007970d643568e7b76a5a341364c (127.7.84.130:41355)
I20240503 08:15:04.713747 7545 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.84.130:45611
I20240503 08:15:04.720661 7506 external_mini_cluster.cc:930] 2 TS(s) registered with all masters
I20240503 08:15:04.738569 7506 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqhmq97/build/asan/bin/kudu pid 7735
I20240503 08:15:04.746676 7857 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 08:15:04.824326 7506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqhmq97/build/asan/bin/kudu with pid 7735
I20240503 08:15:04.837684 7506 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqhmq97/build/asan/bin/kudu pid 7514
I20240503 08:15:04.838742 7575 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 08:15:04.934784 7506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqhmq97/build/asan/bin/kudu with pid 7514
I20240503 08:15:04.950523 7506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqhmq97/build/asan/bin/kudu
/tmp/dist-test-taskqhmq97/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.84.190:42907
--webserver_interface=127.7.84.190
--webserver_port=44063
--builtin_ntp_servers=127.7.84.148:40539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.84.190:42907
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240503 08:15:05.250180 7874 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:15:05.250485 7874 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:15:05.250614 7874 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:15:05.257783 7874 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240503 08:15:05.257891 7874 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:15:05.257962 7874 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240503 08:15:05.258038 7874 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240503 08:15:05.266656 7874 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.84.148:40539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.7.84.190:42907
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.84.190:42907
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.84.190
--webserver_port=44063
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 07:43:23 UTC on efd1337a2aa3
build id 103
ASAN enabled
I20240503 08:15:05.267891 7874 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:15:05.269526 7874 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:15:05.279349 7879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:05.279820 7880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:15:05.280067 7874 server_base.cc:1034] running on GCE node
W20240503 08:15:05.280390 7882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:15:05.281085 7874 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:15:05.282300 7874 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:15:05.283504 7874 hybrid_clock.cc:648] HybridClock initialized: now 1714724105283436 us; error 38 us; skew 500 ppm
I20240503 08:15:05.283792 7874 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:15:05.285789 7874 webserver.cc:460] Webserver started at http://127.7.84.190:44063/ using document root <none> and password file <none>
I20240503 08:15:05.286438 7874 fs_manager.cc:359] Metadata directory not provided
I20240503 08:15:05.286581 7874 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:15:05.291311 7874 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20240503 08:15:05.293920 7888 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:05.295063 7874 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240503 08:15:05.295212 7874 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/master-0/data,/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/master-0/wal
uuid: "5549e64e15144b4f992a9f95b6e3d3be"
format_stamp: "Formatted at 2024-05-03 08:15:03 on dist-test-slave-2jf9"
I20240503 08:15:05.296041 7874 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:15:05.299751 7731 heartbeater.cc:503] Master 127.7.84.190:42907 was elected leader, sending a full tablet report...
W20240503 08:15:05.301080 7731 heartbeater.cc:644] Failed to heartbeat to 127.7.84.190:42907 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.7.84.190:42907: connect: Connection refused (error 111)
I20240503 08:15:05.310115 7874 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:15:05.310835 7874 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:15:05.311062 7874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:15:05.327142 7874 rpc_server.cc:307] RPC server started. Bound to: 127.7.84.190:42907
I20240503 08:15:05.327147 7940 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.84.190:42907 every 8 connection(s)
I20240503 08:15:05.328552 7874 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/master-0/data/info.pb
I20240503 08:15:05.333139 7506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqhmq97/build/asan/bin/kudu as pid 7874
I20240503 08:15:05.335042 7941 sys_catalog.cc:263] Verifying existing consensus state
I20240503 08:15:05.338205 7941 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be: Bootstrap starting.
I20240503 08:15:05.353062 7941 log.cc:824] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be: Log is configured to *not* fsync() on all Append() calls
I20240503 08:15:05.360777 7941 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:15:05.361230 7941 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be: Bootstrap complete.
I20240503 08:15:05.367666 7941 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5549e64e15144b4f992a9f95b6e3d3be" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 42907 } }
I20240503 08:15:05.368386 7941 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5549e64e15144b4f992a9f95b6e3d3be, State: Initialized, Role: FOLLOWER
I20240503 08:15:05.368938 7941 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5549e64e15144b4f992a9f95b6e3d3be" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 42907 } }
I20240503 08:15:05.369149 7941 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:05.369248 7941 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:05.369421 7941 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:15:05.373019 7941 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5549e64e15144b4f992a9f95b6e3d3be" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 42907 } }
I20240503 08:15:05.373476 7941 leader_election.cc:302] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5549e64e15144b4f992a9f95b6e3d3be; no voters:
I20240503 08:15:05.373986 7941 leader_election.cc:288] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:15:05.374109 7946 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:15:05.374650 7946 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be [term 2 LEADER]: Becoming Leader. State: Replica: 5549e64e15144b4f992a9f95b6e3d3be, State: Running, Role: LEADER
I20240503 08:15:05.375121 7946 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5549e64e15144b4f992a9f95b6e3d3be" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 42907 } }
I20240503 08:15:05.375761 7941 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be [sys.catalog]: configured and running, proceeding with master startup.
I20240503 08:15:05.377388 7948 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5549e64e15144b4f992a9f95b6e3d3be. Latest consensus state: current_term: 2 leader_uuid: "5549e64e15144b4f992a9f95b6e3d3be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5549e64e15144b4f992a9f95b6e3d3be" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 42907 } } }
I20240503 08:15:05.377650 7947 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "5549e64e15144b4f992a9f95b6e3d3be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5549e64e15144b4f992a9f95b6e3d3be" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 42907 } } }
I20240503 08:15:05.377826 7948 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be [sys.catalog]: This master's current role is: LEADER
I20240503 08:15:05.377928 7947 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be [sys.catalog]: This master's current role is: LEADER
I20240503 08:15:05.378856 7953 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240503 08:15:05.385118 7953 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240503 08:15:05.386482 7953 catalog_manager.cc:1259] Loaded cluster ID: afa7d53a46ed47d9ad758c5ecb4f69be
I20240503 08:15:05.386576 7953 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240503 08:15:05.390394 7953 catalog_manager.cc:1504] Loading token signing keys...
I20240503 08:15:05.391777 7953 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5549e64e15144b4f992a9f95b6e3d3be: Loaded TSK: 0
I20240503 08:15:05.393321 7953 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240503 08:15:06.307214 7731 heartbeater.cc:347] Connected to a master server at 127.7.84.190:42907
I20240503 08:15:06.307449 7731 heartbeater.cc:503] Master 127.7.84.190:42907 was elected leader, sending a full tablet report...
I20240503 08:15:06.309150 7906 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "d996cd72cfab427d82c659abb0408095" instance_seqno: 1714724104263461) as {username='slave'} at 127.7.84.129:38811; Asking this server to re-register.
I20240503 08:15:06.309800 7731 heartbeater.cc:464] Registering TS with master...
I20240503 08:15:06.310007 7731 heartbeater.cc:511] Master 127.7.84.190:42907 requested a full tablet report, sending...
I20240503 08:15:06.311187 7906 ts_manager.cc:194] Registered new tserver with Master: d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:06.313724 7506 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20240503 08:15:06.313978 7506 test_util.cc:268] Using random seed: 1363058903
I20240503 08:15:06.334928 7906 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54940:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20240503 08:15:06.357792 7666 tablet_service.cc:1467] Processing CreateTablet for tablet 929484f89c924e2f8dcf51e618a4e6a0 (DEFAULT_TABLE table=test-workload [id=fcda02ea317c4e1e9654b17f4f1e2bb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20240503 08:15:06.358990 7666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 929484f89c924e2f8dcf51e618a4e6a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:06.368633 7976 tablet_bootstrap.cc:492] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095: Bootstrap starting.
I20240503 08:15:06.371206 7976 tablet_bootstrap.cc:654] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095: Neither blocks nor log segments found. Creating new log.
I20240503 08:15:06.372177 7976 log.cc:824] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095: Log is configured to *not* fsync() on all Append() calls
I20240503 08:15:06.374321 7976 tablet_bootstrap.cc:492] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095: No bootstrap required, opened a new log
I20240503 08:15:06.374557 7976 ts_tablet_manager.cc:1367] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20240503 08:15:06.380370 7976 raft_consensus.cc:348] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d996cd72cfab427d82c659abb0408095" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 43579 } }
I20240503 08:15:06.380682 7976 raft_consensus.cc:374] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:15:06.380779 7976 raft_consensus.cc:729] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d996cd72cfab427d82c659abb0408095, State: Initialized, Role: FOLLOWER
I20240503 08:15:06.381319 7976 consensus_queue.cc:260] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d996cd72cfab427d82c659abb0408095" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 43579 } }
I20240503 08:15:06.381512 7976 raft_consensus.cc:388] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:06.381623 7976 raft_consensus.cc:482] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:06.381758 7976 raft_consensus.cc:3037] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:15:06.383581 7976 raft_consensus.cc:504] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d996cd72cfab427d82c659abb0408095" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 43579 } }
I20240503 08:15:06.384024 7976 leader_election.cc:302] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d996cd72cfab427d82c659abb0408095; no voters:
I20240503 08:15:06.384547 7976 leader_election.cc:288] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:15:06.384693 7978 raft_consensus.cc:2781] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:15:06.385222 7978 raft_consensus.cc:686] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [term 1 LEADER]: Becoming Leader. State: Replica: d996cd72cfab427d82c659abb0408095, State: Running, Role: LEADER
I20240503 08:15:06.386097 7976 ts_tablet_manager.cc:1398] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095: Time spent starting tablet: real 0.011s user 0.008s sys 0.004s
I20240503 08:15:06.386257 7978 consensus_queue.cc:237] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d996cd72cfab427d82c659abb0408095" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 43579 } }
I20240503 08:15:06.391058 7906 catalog_manager.cc:5484] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 reported cstate change: term changed from 0 to 1, leader changed from <none> to d996cd72cfab427d82c659abb0408095 (127.7.84.129). New cstate: current_term: 1 leader_uuid: "d996cd72cfab427d82c659abb0408095" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d996cd72cfab427d82c659abb0408095" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 43579 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:07.003861 7506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqhmq97/build/asan/bin/kudu
/tmp/dist-test-taskqhmq97/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.84.130:41355
--local_ip_for_outbound_sockets=127.7.84.130
--tserver_master_addrs=127.7.84.190:42907
--webserver_port=40021
--webserver_interface=127.7.84.130
--builtin_ntp_servers=127.7.84.148:40539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240503 08:15:07.308737 7994 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:15:07.309001 7994 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:15:07.309096 7994 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:15:07.316373 7994 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:15:07.316601 7994 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.84.130
I20240503 08:15:07.325403 7994 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.84.148:40539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.84.130:41355
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.84.130
--webserver_port=40021
--tserver_master_addrs=127.7.84.190:42907
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.84.130
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 07:43:23 UTC on efd1337a2aa3
build id 103
ASAN enabled
I20240503 08:15:07.326884 7994 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:15:07.328586 7994 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:15:07.341013 7999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:07.341542 8000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:07.342028 8002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:15:07.342348 7994 server_base.cc:1034] running on GCE node
I20240503 08:15:07.342908 7994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:15:07.343797 7994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:15:07.344998 7994 hybrid_clock.cc:648] HybridClock initialized: now 1714724107344933 us; error 39 us; skew 500 ppm
I20240503 08:15:07.345281 7994 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:15:07.347322 7994 webserver.cc:460] Webserver started at http://127.7.84.130:40021/ using document root <none> and password file <none>
I20240503 08:15:07.348012 7994 fs_manager.cc:359] Metadata directory not provided
I20240503 08:15:07.348142 7994 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:15:07.353021 7994 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20240503 08:15:07.355620 8008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:07.356851 7994 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240503 08:15:07.357000 7994 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/wal
uuid: "02e1007970d643568e7b76a5a341364c"
format_stamp: "Formatted at 2024-05-03 08:15:04 on dist-test-slave-2jf9"
I20240503 08:15:07.357790 7994 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:15:07.373227 7994 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:15:07.373987 7994 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:15:07.374233 7994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:15:07.375109 7994 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:15:07.376591 7994 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:15:07.376680 7994 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:07.376785 7994 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:15:07.376850 7994 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:07.405144 7994 rpc_server.cc:307] RPC server started. Bound to: 127.7.84.130:41355
I20240503 08:15:07.405217 8120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.84.130:41355 every 8 connection(s)
I20240503 08:15:07.406548 7994 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data/info.pb
I20240503 08:15:07.408231 7506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqhmq97/build/asan/bin/kudu as pid 7994
I20240503 08:15:07.413865 7506 tablet_copy_client_session-itest.cc:139] Starting loop 0
I20240503 08:15:07.414036 7506 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqhmq97/build/asan/bin/kudu pid 7604
I20240503 08:15:07.414992 7726 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 08:15:07.420069 8121 heartbeater.cc:347] Connected to a master server at 127.7.84.190:42907
I20240503 08:15:07.420337 8121 heartbeater.cc:464] Registering TS with master...
I20240503 08:15:07.421093 8121 heartbeater.cc:511] Master 127.7.84.190:42907 requested a full tablet report, sending...
I20240503 08:15:07.422524 7897 ts_manager.cc:194] Registered new tserver with Master: 02e1007970d643568e7b76a5a341364c (127.7.84.130:41355)
I20240503 08:15:07.424154 7897 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.84.130:42863
I20240503 08:15:07.511505 7506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqhmq97/build/asan/bin/kudu with pid 7604
I20240503 08:15:07.532470 7506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqhmq97/build/asan/bin/kudu
/tmp/dist-test-taskqhmq97/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.84.129:43579
--local_ip_for_outbound_sockets=127.7.84.129
--tserver_master_addrs=127.7.84.190:42907
--webserver_port=45175
--webserver_interface=127.7.84.129
--builtin_ntp_servers=127.7.84.148:40539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240503 08:15:07.552567 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.561560 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.570968 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.572042 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.575985 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.577484 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.584190 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.585276 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.605715 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.606853 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.609675 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.610613 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.618288 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.619619 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.629094 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.630126 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.633838 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.635641 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.665617 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.666744 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.671021 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.672494 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.674649 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.681859 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.683717 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.684715 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.696457 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.697556 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.699574 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.700644 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.702991 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.707857 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.728700 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.730211 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.739130 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.740200 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.745270 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.746692 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.767166 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.768338 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.777146 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.778402 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.782385 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.783421 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.801574 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.802850 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.814397 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.815438 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.818969 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.819952 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.821839 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.822783 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.841873 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.842934 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.848282 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.849267 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.857244 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.858201 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.862614 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.863607 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
W20240503 08:15:07.870172 8132 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:15:07.870432 8132 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:15:07.870527 8132 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:15:07.877786 8132 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:15:07.877939 8132 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.84.129
I20240503 08:15:07.882943 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.883976 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.887298 8132 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.84.148:40539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.84.129:43579
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.84.129
--webserver_port=45175
--tserver_master_addrs=127.7.84.190:42907
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.84.129
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 07:43:23 UTC on efd1337a2aa3
build id 103
ASAN enabled
I20240503 08:15:07.888585 8132 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:15:07.890328 8132 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20240503 08:15:07.890740 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.898855 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.901057 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.902034 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
W20240503 08:15:07.905344 8269 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:07.905450 8272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:07.905854 8268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:15:07.906594 8132 server_base.cc:1034] running on GCE node
I20240503 08:15:07.907128 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.907224 8132 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:15:07.908151 8132 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:15:07.909363 8132 hybrid_clock.cc:648] HybridClock initialized: now 1714724107909286 us; error 59 us; skew 500 ppm
I20240503 08:15:07.909658 8132 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:15:07.911770 8132 webserver.cc:460] Webserver started at http://127.7.84.129:45175/ using document root <none> and password file <none>
I20240503 08:15:07.912446 8132 fs_manager.cc:359] Metadata directory not provided
I20240503 08:15:07.912575 8132 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:15:07.919711 8132 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.004s
I20240503 08:15:07.922713 8284 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:07.922977 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.924273 8132 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240503 08:15:07.924430 8132 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/wal
uuid: "d996cd72cfab427d82c659abb0408095"
format_stamp: "Formatted at 2024-05-03 08:15:04 on dist-test-slave-2jf9"
I20240503 08:15:07.925397 8132 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:15:07.927655 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.928617 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.942291 8132 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:15:07.943053 8132 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:15:07.943289 8132 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:15:07.944159 8132 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:15:07.946038 8297 ts_tablet_manager.cc:522] Loading tablet metadata (0/1 complete)
I20240503 08:15:07.946132 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.947149 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.950924 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.951787 8132 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240503 08:15:07.951872 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.951903 8132 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20240503 08:15:07.952004 8132 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240503 08:15:07.955093 8132 ts_tablet_manager.cc:590] Registered 1 tablets
I20240503 08:15:07.955166 8132 ts_tablet_manager.cc:569] Time spent register tablets: real 0.003s user 0.000s sys 0.000s
I20240503 08:15:07.955529 8297 tablet_bootstrap.cc:492] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095: Bootstrap starting.
I20240503 08:15:07.956897 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.963083 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:07.987485 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:07.992094 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.002643 8132 rpc_server.cc:307] RPC server started. Bound to: 127.7.84.129:43579
I20240503 08:15:08.002753 8419 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.84.129:43579 every 8 connection(s)
I20240503 08:15:08.004190 8132 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/data/info.pb
I20240503 08:15:08.010155 7506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqhmq97/build/asan/bin/kudu as pid 8132
I20240503 08:15:08.012984 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.018451 8420 heartbeater.cc:347] Connected to a master server at 127.7.84.190:42907
I20240503 08:15:08.018754 8420 heartbeater.cc:464] Registering TS with master...
I20240503 08:15:08.019665 8420 heartbeater.cc:511] Master 127.7.84.190:42907 requested a full tablet report, sending...
I20240503 08:15:08.022070 7897 ts_manager.cc:194] Re-registered known tserver with Master: d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.023612 7897 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.84.129:58499
I20240503 08:15:08.027750 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.036321 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.036599 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.038326 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.055424 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.056533 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.057142 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.057292 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.057456 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.057543 8297 log.cc:824] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095: Log is configured to *not* fsync() on all Append() calls
I20240503 08:15:08.061450 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.062575 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.063179 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.063302 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.063499 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.075568 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.076593 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.077216 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.077399 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.077582 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.087191 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.088714 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.089357 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.089562 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.089788 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.092715 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.093674 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.094230 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.094394 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.094581 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.097739 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.098687 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.099326 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.099479 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.099649 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.102809 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.103816 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.104375 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.104539 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.104718 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.109869 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.114159 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.114790 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.114948 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.115129 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.118759 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.119730 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.120232 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.120370 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.120522 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.126713 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.127674 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.128230 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.128357 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.128541 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.130103 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.131088 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.131668 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.131801 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.131959 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.134783 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.135702 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.136322 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.136477 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.136652 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.139691 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.140650 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.141206 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.141355 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.141515 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.158917 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.160001 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.160640 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.160805 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.160997 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.165674 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.166651 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.167208 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.167411 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.167614 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.171005 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.175657 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.176426 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.176604 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.176805 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.188839 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.189899 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.190505 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.190687 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.190878 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.205161 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.206179 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.206794 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.206954 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.207180 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.210284 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.211208 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.211757 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.211918 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.212107 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.222103 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.223081 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.223718 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.223866 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.224045 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.235216 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.244397 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.245030 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.245213 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.245398 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.251510 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.252514 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.253122 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.253252 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.253405 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.254820 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.255784 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.256320 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.256456 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.256604 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.258455 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.259356 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.259990 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.260124 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.260270 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.263859 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.264807 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.265383 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.265535 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.265708 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.299156 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.300307 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.300985 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.301119 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.301309 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.303607 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.304535 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.305128 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.305294 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.305476 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.307085 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.311658 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.312274 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.312423 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.312623 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.323935 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.336079 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.336769 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.336947 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.337116 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.348706 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.350076 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.350734 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.350896 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.351099 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.355702 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.356707 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.357308 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.357479 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.357656 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.367205 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.368314 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.368942 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.369112 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.369321 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.373034 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.374071 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.374676 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.374843 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.375039 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.377414 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.378331 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.378927 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.379045 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.379206 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.387547 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.388520 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.389106 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.389273 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.389442 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.402287 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.403472 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.404281 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.404448 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.404650 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.426841 8121 heartbeater.cc:503] Master 127.7.84.190:42907 was elected leader, sending a full tablet report...
I20240503 08:15:08.437179 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.438338 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.438992 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.439145 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.439327 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.441025 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.447676 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.448321 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.448453 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.448639 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.450711 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.456218 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.456884 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.457062 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.457228 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.467236 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.468564 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.469218 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.469394 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.469588 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.475091 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.476780 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.477551 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.477792 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.477990 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.483083 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.485288 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.485873 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.485988 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.486160 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.497603 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.498625 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.499197 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.499344 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.499572 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.503602 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.504601 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.505158 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.505285 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.505470 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.516763 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.520617 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.521440 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.521709 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.522035 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.526997 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.528075 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.528761 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.528929 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.529199 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.532544 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.533520 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.534107 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.534284 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.534440 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.558815 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.560396 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.561089 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.561246 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.561429 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.564677 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.570940 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.571616 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.571820 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.572017 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.575421 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.579679 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.580338 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.580474 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.580657 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.583529 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.590551 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.591202 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.591347 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.591568 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.595867 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.599639 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.600337 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.600510 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.600710 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.602963 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.603945 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.604523 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.604665 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.604822 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.606849 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.607926 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.608485 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.608601 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.608774 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.613085 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.614032 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.614563 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.614694 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.614867 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.622800 8297 tablet_bootstrap.cc:492] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095: Bootstrap replayed 1/1 log segments. Stats: ops{read=215 overwritten=0 applied=215 ignored=0} inserts{seen=10700 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:15:08.623275 8297 tablet_bootstrap.cc:492] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095: Bootstrap complete.
I20240503 08:15:08.624336 8297 ts_tablet_manager.cc:1367] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095: Time spent bootstrapping tablet: real 0.669s user 0.618s sys 0.047s
I20240503 08:15:08.626857 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.627941 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.628588 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.628769 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:08.628937 8391 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:51629: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:08.629503 8297 raft_consensus.cc:348] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d996cd72cfab427d82c659abb0408095" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 43579 } }
I20240503 08:15:08.630457 8297 raft_consensus.cc:729] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d996cd72cfab427d82c659abb0408095, State: Initialized, Role: FOLLOWER
I20240503 08:15:08.631103 8297 consensus_queue.cc:260] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 215, Last appended: 1.215, Last appended by leader: 215, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d996cd72cfab427d82c659abb0408095" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 43579 } }
I20240503 08:15:08.631314 8297 raft_consensus.cc:388] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:08.631453 8297 raft_consensus.cc:482] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:08.631623 8297 raft_consensus.cc:3037] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:15:08.634871 8297 raft_consensus.cc:504] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d996cd72cfab427d82c659abb0408095" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 43579 } }
I20240503 08:15:08.635324 8297 leader_election.cc:302] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d996cd72cfab427d82c659abb0408095; no voters:
I20240503 08:15:08.635823 8297 leader_election.cc:288] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:15:08.635948 8655 raft_consensus.cc:2781] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:15:08.636428 8655 raft_consensus.cc:686] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [term 2 LEADER]: Becoming Leader. State: Replica: d996cd72cfab427d82c659abb0408095, State: Running, Role: LEADER
I20240503 08:15:08.636801 8420 heartbeater.cc:503] Master 127.7.84.190:42907 was elected leader, sending a full tablet report...
I20240503 08:15:08.636952 8655 consensus_queue.cc:237] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 215, Committed index: 215, Last appended: 1.215, Last appended by leader: 215, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d996cd72cfab427d82c659abb0408095" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 43579 } }
I20240503 08:15:08.637302 8297 ts_tablet_manager.cc:1398] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095: Time spent starting tablet: real 0.013s user 0.009s sys 0.004s
I20240503 08:15:08.639148 8134 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:08.640410 7897 catalog_manager.cc:5484] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "d996cd72cfab427d82c659abb0408095" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d996cd72cfab427d82c659abb0408095" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 43579 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:08.640619 8134 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:08.641172 8391 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:51629)
I20240503 08:15:08.641305 8391 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:51629: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
I20240503 08:15:08.644027 8391 tablet_copy_source_session.cc:205] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:15:08.648425 8134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 929484f89c924e2f8dcf51e618a4e6a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:08.658089 8134 tablet_copy_client.cc:783] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Starting download of 0 data blocks...
I20240503 08:15:08.658349 8134 tablet_copy_client.cc:647] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Starting download of 1 WAL segments...
I20240503 08:15:08.662516 8134 tablet_copy_client.cc:523] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:15:08.665540 8134 tablet_bootstrap.cc:492] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Bootstrap starting.
I20240503 08:15:08.728108 8134 log.cc:824] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Log is configured to *not* fsync() on all Append() calls
I20240503 08:15:09.256772 8134 tablet_bootstrap.cc:492] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Bootstrap replayed 1/1 log segments. Stats: ops{read=216 overwritten=0 applied=216 ignored=0} inserts{seen=10700 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:15:09.257342 8134 tablet_bootstrap.cc:492] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Bootstrap complete.
I20240503 08:15:09.257959 8134 ts_tablet_manager.cc:1367] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Time spent bootstrapping tablet: real 0.593s user 0.535s sys 0.056s
I20240503 08:15:09.263510 8134 raft_consensus.cc:348] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d996cd72cfab427d82c659abb0408095" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 43579 } }
I20240503 08:15:09.263870 8134 raft_consensus.cc:729] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 02e1007970d643568e7b76a5a341364c, State: Initialized, Role: NON_PARTICIPANT
I20240503 08:15:09.264348 8134 consensus_queue.cc:260] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 216, Last appended: 2.216, Last appended by leader: 216, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d996cd72cfab427d82c659abb0408095" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 43579 } }
I20240503 08:15:09.265666 8134 ts_tablet_manager.cc:1398] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Time spent starting tablet: real 0.008s user 0.009s sys 0.000s
I20240503 08:15:09.266569 8391 tablet_copy_service.cc:342] P d996cd72cfab427d82c659abb0408095: Request end of tablet copy session 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0 received from {username='slave'} at 127.7.84.130:51629
I20240503 08:15:09.266732 8391 tablet_copy_service.cc:433] P d996cd72cfab427d82c659abb0408095: ending tablet copy session 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0 on tablet 929484f89c924e2f8dcf51e618a4e6a0 with peer 02e1007970d643568e7b76a5a341364c
W20240503 08:15:09.271544 8134 ts_tablet_manager.cc:701] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Tablet Copy: Invalid argument: Leader has replica of tablet 929484f89c924e2f8dcf51e618a4e6a0 with term 0, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20240503 08:15:09.282593 8134 ts_tablet_manager.cc:701] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Tablet Copy: Invalid argument: Leader has replica of tablet 929484f89c924e2f8dcf51e618a4e6a0 with term 0, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20240503 08:15:09.306046 8134 ts_tablet_manager.cc:701] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Tablet Copy: Invalid argument: Leader has replica of tablet 929484f89c924e2f8dcf51e618a4e6a0 with term 0, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
I20240503 08:15:09.308620 8056 tablet_service.cc:1514] Processing DeleteTablet for tablet 929484f89c924e2f8dcf51e618a4e6a0 with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:44342
I20240503 08:15:09.309260 8670 tablet_replica.cc:330] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: stopping tablet replica
I20240503 08:15:09.309666 8670 raft_consensus.cc:2229] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c [term 2 NON_PARTICIPANT]: Raft consensus shutting down.
I20240503 08:15:09.309978 8670 raft_consensus.cc:2258] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c [term 2 NON_PARTICIPANT]: Raft consensus is shut down!
I20240503 08:15:09.311116 8670 ts_tablet_manager.cc:1875] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20240503 08:15:09.315315 8670 ts_tablet_manager.cc:1888] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.216
I20240503 08:15:09.315462 8670 log.cc:1196] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Deleting WAL directory at /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/wal/wals/929484f89c924e2f8dcf51e618a4e6a0
I20240503 08:15:09.315929 8670 ts_tablet_manager.cc:1909] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Deleting consensus metadata
I20240503 08:15:09.317476 7506 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqhmq97/build/asan/bin/kudu pid 7994
I20240503 08:15:09.318341 8116 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 08:15:09.419425 7506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqhmq97/build/asan/bin/kudu with pid 7994
I20240503 08:15:09.435250 7506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqhmq97/build/asan/bin/kudu
/tmp/dist-test-taskqhmq97/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.84.130:41355
--local_ip_for_outbound_sockets=127.7.84.130
--tserver_master_addrs=127.7.84.190:42907
--webserver_port=40021
--webserver_interface=127.7.84.130
--builtin_ntp_servers=127.7.84.148:40539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240503 08:15:09.745853 8672 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:15:09.746146 8672 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:15:09.746268 8672 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:15:09.753540 8672 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:15:09.753741 8672 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.84.130
I20240503 08:15:09.762580 8672 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.84.148:40539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.84.130:41355
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.84.130
--webserver_port=40021
--tserver_master_addrs=127.7.84.190:42907
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.84.130
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 07:43:23 UTC on efd1337a2aa3
build id 103
ASAN enabled
I20240503 08:15:09.763911 8672 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:15:09.765583 8672 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:15:09.776957 8677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:09.777511 8680 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:09.777639 8678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:15:09.778398 8672 server_base.cc:1034] running on GCE node
I20240503 08:15:09.778959 8672 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:15:09.779914 8672 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:15:09.781131 8672 hybrid_clock.cc:648] HybridClock initialized: now 1714724109781072 us; error 37 us; skew 500 ppm
I20240503 08:15:09.781441 8672 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:15:09.783561 8672 webserver.cc:460] Webserver started at http://127.7.84.130:40021/ using document root <none> and password file <none>
I20240503 08:15:09.784255 8672 fs_manager.cc:359] Metadata directory not provided
I20240503 08:15:09.784375 8672 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:15:09.789275 8672 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.002s
I20240503 08:15:09.791895 8686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:09.793118 8672 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20240503 08:15:09.793258 8672 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/wal
uuid: "02e1007970d643568e7b76a5a341364c"
format_stamp: "Formatted at 2024-05-03 08:15:04 on dist-test-slave-2jf9"
I20240503 08:15:09.794054 8672 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:15:09.815430 8672 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:15:09.816270 8672 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:15:09.816540 8672 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:15:09.817452 8672 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:15:09.818861 8672 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:15:09.818953 8672 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:09.819056 8672 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:15:09.819123 8672 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:09.847110 8672 rpc_server.cc:307] RPC server started. Bound to: 127.7.84.130:41355
I20240503 08:15:09.847154 8798 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.84.130:41355 every 8 connection(s)
I20240503 08:15:09.848498 8672 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data/info.pb
I20240503 08:15:09.853106 7506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqhmq97/build/asan/bin/kudu as pid 8672
I20240503 08:15:09.853399 7506 tablet_copy_client_session-itest.cc:139] Starting loop 1
I20240503 08:15:09.853485 7506 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqhmq97/build/asan/bin/kudu pid 8132
I20240503 08:15:09.860924 8415 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 08:15:09.861184 8799 heartbeater.cc:347] Connected to a master server at 127.7.84.190:42907
I20240503 08:15:09.861470 8799 heartbeater.cc:464] Registering TS with master...
I20240503 08:15:09.862411 8799 heartbeater.cc:511] Master 127.7.84.190:42907 requested a full tablet report, sending...
I20240503 08:15:09.863911 7897 ts_manager.cc:194] Re-registered known tserver with Master: 02e1007970d643568e7b76a5a341364c (127.7.84.130:41355)
I20240503 08:15:09.864742 7897 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.84.130:39943
I20240503 08:15:09.960685 7506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqhmq97/build/asan/bin/kudu with pid 8132
I20240503 08:15:09.978015 7506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqhmq97/build/asan/bin/kudu
/tmp/dist-test-taskqhmq97/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.84.129:43579
--local_ip_for_outbound_sockets=127.7.84.129
--tserver_master_addrs=127.7.84.190:42907
--webserver_port=45175
--webserver_interface=127.7.84.129
--builtin_ntp_servers=127.7.84.148:40539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240503 08:15:10.001292 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.008977 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.015069 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.016080 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.036747 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.037802 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.039539 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.041240 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.045550 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.046497 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.049985 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.051033 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.073434 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.074560 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.086447 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.087507 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.098546 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.100121 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.125785 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.126852 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.135886 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.136936 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.142572 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.143568 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.147544 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.148505 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.152577 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.153466 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.155618 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.156469 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.176415 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.177568 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.184056 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.188088 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.190083 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.191092 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.195708 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.196700 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.203140 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.208424 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.231081 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.232278 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.237052 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.242794 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.247426 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.248452 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.259367 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.266417 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.274950 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.275966 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.280818 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.283759 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.296415 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.297426 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.311583 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.312599 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
W20240503 08:15:10.315434 8811 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:15:10.315690 8811 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:15:10.315809 8811 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20240503 08:15:10.316849 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.317751 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
W20240503 08:15:10.323655 8811 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:15:10.323827 8811 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.84.129
I20240503 08:15:10.324204 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.325143 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.331029 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.334653 8811 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.84.148:40539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.84.129:43579
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.84.129
--webserver_port=45175
--tserver_master_addrs=127.7.84.190:42907
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.84.129
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 07:43:23 UTC on efd1337a2aa3
build id 103
ASAN enabled
I20240503 08:15:10.335117 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.336232 8811 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:15:10.338088 8811 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20240503 08:15:10.347229 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.349077 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
W20240503 08:15:10.349606 8947 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:10.349735 8945 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:10.350368 8944 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:15:10.351226 8811 server_base.cc:1034] running on GCE node
I20240503 08:15:10.351852 8811 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:15:10.352674 8811 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:15:10.353888 8811 hybrid_clock.cc:648] HybridClock initialized: now 1714724110353825 us; error 39 us; skew 500 ppm
I20240503 08:15:10.354192 8811 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:15:10.354686 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.355716 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.357048 8811 webserver.cc:460] Webserver started at http://127.7.84.129:45175/ using document root <none> and password file <none>
I20240503 08:15:10.358146 8811 fs_manager.cc:359] Metadata directory not provided
I20240503 08:15:10.358172 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.358292 8811 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:15:10.359064 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.363857 8811 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20240503 08:15:10.366475 8965 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:10.367691 8811 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240503 08:15:10.367826 8811 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/wal
uuid: "d996cd72cfab427d82c659abb0408095"
format_stamp: "Formatted at 2024-05-03 08:15:04 on dist-test-slave-2jf9"
I20240503 08:15:10.368595 8811 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:15:10.376968 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.377893 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.379599 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.380609 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.382834 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.383711 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.390309 8811 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:15:10.391047 8811 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:15:10.391289 8811 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:15:10.392153 8811 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:15:10.393936 8984 ts_tablet_manager.cc:522] Loading tablet metadata (0/1 complete)
I20240503 08:15:10.394436 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.395462 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.399466 8811 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240503 08:15:10.399572 8811 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20240503 08:15:10.399684 8811 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240503 08:15:10.400592 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.401468 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.403314 8811 ts_tablet_manager.cc:590] Registered 1 tablets
I20240503 08:15:10.403424 8811 ts_tablet_manager.cc:569] Time spent register tablets: real 0.004s user 0.000s sys 0.000s
I20240503 08:15:10.403757 8984 tablet_bootstrap.cc:492] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095: Bootstrap starting.
I20240503 08:15:10.420293 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.425267 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.428582 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.432128 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.434345 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.435412 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.442803 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.444495 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.460287 8811 rpc_server.cc:307] RPC server started. Bound to: 127.7.84.129:43579
I20240503 08:15:10.460340 9114 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.84.129:43579 every 8 connection(s)
I20240503 08:15:10.461796 8811 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/data/info.pb
I20240503 08:15:10.465771 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.466696 7506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqhmq97/build/asan/bin/kudu as pid 8811
I20240503 08:15:10.472285 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.481065 9115 heartbeater.cc:347] Connected to a master server at 127.7.84.190:42907
I20240503 08:15:10.481420 9115 heartbeater.cc:464] Registering TS with master...
I20240503 08:15:10.482584 9115 heartbeater.cc:511] Master 127.7.84.190:42907 requested a full tablet report, sending...
I20240503 08:15:10.483786 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.484114 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.485819 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.487895 7897 ts_manager.cc:194] Re-registered known tserver with Master: d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.489353 7897 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.84.129:34327
I20240503 08:15:10.498047 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.499162 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.499915 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.500133 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.500336 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.501063 8984 log.cc:824] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095: Log is configured to *not* fsync() on all Append() calls
I20240503 08:15:10.510015 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.511260 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.511952 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.512106 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.512308 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.518409 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.531991 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.532595 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.532794 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.532982 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.537307 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.545680 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.546253 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.546429 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.546628 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.561786 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.562733 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.563342 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.563545 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.563758 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.566256 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.567520 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.568281 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.568426 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.568622 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.574039 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.581247 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.581818 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.581987 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.582162 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.604430 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.605475 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.606105 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.606279 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.606463 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.609680 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.611829 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.612408 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.612573 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.612753 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.614490 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.619673 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.620371 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.620523 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.620728 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.622990 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.624013 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.624564 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.624738 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.624900 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.639605 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.640602 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.641240 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.641402 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.641587 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.660248 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.661252 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.661849 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.662017 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.662201 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.669139 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.670074 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.670661 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.670806 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.670997 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.681259 8813 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.682206 8813 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.682772 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.682935 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.683135 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.684262 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.693018 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.693596 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.693756 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.693941 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.701596 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.708473 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.709019 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.709194 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.709379 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.725124 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.726147 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.726774 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.726933 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.727167 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.731662 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.738667 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.739250 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.739436 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.739638 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.743036 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.751287 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.751900 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.752051 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.752238 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.764562 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.765592 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.766157 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.766336 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.766515 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.786626 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.789434 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.790047 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.790205 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.790395 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.799798 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.800832 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.801398 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.801591 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.801775 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.815163 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.816196 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.816928 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.817097 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.817284 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.831817 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.833572 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.834156 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.834326 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.834506 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.838116 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.839107 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.839668 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.839792 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.839943 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.848193 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.849850 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.850459 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.850615 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.850806 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.852823 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.853796 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.854418 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.854547 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.854717 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.861428 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.862357 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.862871 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.862995 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.863138 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.867322 8799 heartbeater.cc:503] Master 127.7.84.190:42907 was elected leader, sending a full tablet report...
I20240503 08:15:10.879279 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.880331 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.880911 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.881055 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.881228 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.896024 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.897051 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.897620 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.897773 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.897935 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.902091 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.909083 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.909622 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.909735 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.909902 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.919468 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.924080 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.924763 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.924949 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.925145 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.930403 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.932039 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.932732 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.932878 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.933058 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.937139 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.944903 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.945520 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.945677 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.945837 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.951567 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.952577 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.953266 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.953429 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.953625 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.962812 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.963902 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.964545 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.964722 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.964908 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.981019 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.982066 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.982797 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.982951 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.983134 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.988994 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.989992 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.990582 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.990763 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.990942 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:10.994258 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:10.997640 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:10.998235 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:10.998430 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:10.998639 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:11.002174 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:11.003157 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:11.003754 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:11.003921 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:11.004097 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:11.015229 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:11.016332 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:11.017007 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:11.017175 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:11.017365 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:11.030571 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:11.031679 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:11.032297 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:11.032485 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:11.032701 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:11.044549 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:11.048907 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:11.049577 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:11.049729 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:11.049942 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:11.053344 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:11.054317 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:11.054880 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:11.055016 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:11.055188 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:11.056826 8984 tablet_bootstrap.cc:492] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095: Bootstrap replayed 1/1 log segments. Stats: ops{read=216 overwritten=0 applied=216 ignored=0} inserts{seen=10700 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:15:11.057279 8984 tablet_bootstrap.cc:492] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095: Bootstrap complete.
I20240503 08:15:11.058288 8984 ts_tablet_manager.cc:1367] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095: Time spent bootstrapping tablet: real 0.655s user 0.588s sys 0.062s
I20240503 08:15:11.062036 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:11.062991 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:11.062860 8984 raft_consensus.cc:348] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d996cd72cfab427d82c659abb0408095" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 43579 } }
I20240503 08:15:11.063640 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:11.063781 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
I20240503 08:15:11.063802 8984 raft_consensus.cc:729] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d996cd72cfab427d82c659abb0408095, State: Initialized, Role: FOLLOWER
W20240503 08:15:11.063977 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:11.064497 8984 consensus_queue.cc:260] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 216, Last appended: 2.216, Last appended by leader: 216, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d996cd72cfab427d82c659abb0408095" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 43579 } }
I20240503 08:15:11.064734 8984 raft_consensus.cc:388] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:11.064859 8984 raft_consensus.cc:482] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:11.065050 8984 raft_consensus.cc:3037] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:15:11.067799 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:11.068707 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:11.069279 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:11.069222 8984 raft_consensus.cc:504] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d996cd72cfab427d82c659abb0408095" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 43579 } }
I20240503 08:15:11.069430 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:11.069631 9090 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:46429: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:11.069833 8984 leader_election.cc:302] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d996cd72cfab427d82c659abb0408095; no voters:
I20240503 08:15:11.070871 8984 leader_election.cc:288] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [CANDIDATE]: Term 3 election: Requested vote from peers
I20240503 08:15:11.071205 9313 raft_consensus.cc:2781] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [term 3 FOLLOWER]: Leader election won for term 3
I20240503 08:15:11.071882 9115 heartbeater.cc:503] Master 127.7.84.190:42907 was elected leader, sending a full tablet report...
I20240503 08:15:11.072163 9313 raft_consensus.cc:686] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [term 3 LEADER]: Becoming Leader. State: Replica: d996cd72cfab427d82c659abb0408095, State: Running, Role: LEADER
I20240503 08:15:11.072450 8984 ts_tablet_manager.cc:1398] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095: Time spent starting tablet: real 0.014s user 0.012s sys 0.004s
I20240503 08:15:11.072652 9313 consensus_queue.cc:237] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 216, Committed index: 216, Last appended: 2.216, Last appended by leader: 216, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d996cd72cfab427d82c659abb0408095" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 43579 } }
I20240503 08:15:11.075850 7897 catalog_manager.cc:5484] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 reported cstate change: term changed from 2 to 3. New cstate: current_term: 3 leader_uuid: "d996cd72cfab427d82c659abb0408095" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d996cd72cfab427d82c659abb0408095" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 43579 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:11.086524 8815 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:11.087525 8815 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:11.088198 9090 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:46429)
I20240503 08:15:11.088363 9090 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:46429: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
I20240503 08:15:11.090473 9090 tablet_copy_source_session.cc:205] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:15:11.094516 8815 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 929484f89c924e2f8dcf51e618a4e6a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:11.104523 8815 tablet_copy_client.cc:783] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Starting download of 0 data blocks...
I20240503 08:15:11.104801 8815 tablet_copy_client.cc:647] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Starting download of 1 WAL segments...
I20240503 08:15:11.108664 8815 tablet_copy_client.cc:523] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:15:11.112460 8815 tablet_bootstrap.cc:492] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Bootstrap starting.
I20240503 08:15:11.174804 8815 log.cc:824] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Log is configured to *not* fsync() on all Append() calls
I20240503 08:15:11.702841 8815 tablet_bootstrap.cc:492] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Bootstrap replayed 1/1 log segments. Stats: ops{read=217 overwritten=0 applied=217 ignored=0} inserts{seen=10700 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:15:11.703316 8815 tablet_bootstrap.cc:492] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Bootstrap complete.
I20240503 08:15:11.703820 8815 ts_tablet_manager.cc:1367] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Time spent bootstrapping tablet: real 0.592s user 0.507s sys 0.084s
I20240503 08:15:11.708056 8815 raft_consensus.cc:348] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c [term 3 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d996cd72cfab427d82c659abb0408095" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 43579 } }
I20240503 08:15:11.708410 8815 raft_consensus.cc:729] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c [term 3 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 02e1007970d643568e7b76a5a341364c, State: Initialized, Role: NON_PARTICIPANT
I20240503 08:15:11.708909 8815 consensus_queue.cc:260] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 217, Last appended: 3.217, Last appended by leader: 217, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d996cd72cfab427d82c659abb0408095" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 43579 } }
I20240503 08:15:11.710412 8815 ts_tablet_manager.cc:1398] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20240503 08:15:11.711370 9090 tablet_copy_service.cc:342] P d996cd72cfab427d82c659abb0408095: Request end of tablet copy session 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0 received from {username='slave'} at 127.7.84.130:46429
I20240503 08:15:11.711570 9090 tablet_copy_service.cc:433] P d996cd72cfab427d82c659abb0408095: ending tablet copy session 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0 on tablet 929484f89c924e2f8dcf51e618a4e6a0 with peer 02e1007970d643568e7b76a5a341364c
W20240503 08:15:11.718550 8815 ts_tablet_manager.cc:701] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Tablet Copy: Invalid argument: Leader has replica of tablet 929484f89c924e2f8dcf51e618a4e6a0 with term 0, which is lower than last-logged term 3 on local replica. Rejecting tablet copy request
W20240503 08:15:11.725930 8815 ts_tablet_manager.cc:701] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Tablet Copy: Invalid argument: Leader has replica of tablet 929484f89c924e2f8dcf51e618a4e6a0 with term 0, which is lower than last-logged term 3 on local replica. Rejecting tablet copy request
W20240503 08:15:11.727919 8815 ts_tablet_manager.cc:701] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Tablet Copy: Invalid argument: Leader has replica of tablet 929484f89c924e2f8dcf51e618a4e6a0 with term 0, which is lower than last-logged term 3 on local replica. Rejecting tablet copy request
I20240503 08:15:11.729964 8734 tablet_service.cc:1514] Processing DeleteTablet for tablet 929484f89c924e2f8dcf51e618a4e6a0 with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:44346
I20240503 08:15:11.730607 9329 tablet_replica.cc:330] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: stopping tablet replica
I20240503 08:15:11.731015 9329 raft_consensus.cc:2229] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c [term 3 NON_PARTICIPANT]: Raft consensus shutting down.
I20240503 08:15:11.731315 9329 raft_consensus.cc:2258] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c [term 3 NON_PARTICIPANT]: Raft consensus is shut down!
I20240503 08:15:11.732514 9329 ts_tablet_manager.cc:1875] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20240503 08:15:11.736780 9329 ts_tablet_manager.cc:1888] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 3.217
I20240503 08:15:11.736912 9329 log.cc:1196] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Deleting WAL directory at /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/wal/wals/929484f89c924e2f8dcf51e618a4e6a0
I20240503 08:15:11.737385 9329 ts_tablet_manager.cc:1909] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Deleting consensus metadata
I20240503 08:15:11.738986 7506 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqhmq97/build/asan/bin/kudu pid 8672
I20240503 08:15:11.739840 8794 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 08:15:11.841567 7506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqhmq97/build/asan/bin/kudu with pid 8672
I20240503 08:15:11.857290 7506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqhmq97/build/asan/bin/kudu
/tmp/dist-test-taskqhmq97/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.84.130:41355
--local_ip_for_outbound_sockets=127.7.84.130
--tserver_master_addrs=127.7.84.190:42907
--webserver_port=40021
--webserver_interface=127.7.84.130
--builtin_ntp_servers=127.7.84.148:40539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240503 08:15:12.174127 9331 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:15:12.174423 9331 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:15:12.174552 9331 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:15:12.182041 9331 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:15:12.182247 9331 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.84.130
I20240503 08:15:12.191675 9331 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.84.148:40539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.84.130:41355
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.84.130
--webserver_port=40021
--tserver_master_addrs=127.7.84.190:42907
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.84.130
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 07:43:23 UTC on efd1337a2aa3
build id 103
ASAN enabled
I20240503 08:15:12.193006 9331 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:15:12.194695 9331 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:15:12.205912 9336 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:12.206333 9339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:12.206995 9337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:15:12.207700 9331 server_base.cc:1034] running on GCE node
I20240503 08:15:12.208236 9331 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:15:12.209054 9331 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:15:12.210259 9331 hybrid_clock.cc:648] HybridClock initialized: now 1714724112210204 us; error 31 us; skew 500 ppm
I20240503 08:15:12.210551 9331 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:15:12.212579 9331 webserver.cc:460] Webserver started at http://127.7.84.130:40021/ using document root <none> and password file <none>
I20240503 08:15:12.213240 9331 fs_manager.cc:359] Metadata directory not provided
I20240503 08:15:12.213356 9331 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:15:12.218189 9331 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20240503 08:15:12.220697 9345 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:12.221875 9331 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240503 08:15:12.222011 9331 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/wal
uuid: "02e1007970d643568e7b76a5a341364c"
format_stamp: "Formatted at 2024-05-03 08:15:04 on dist-test-slave-2jf9"
I20240503 08:15:12.222772 9331 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:15:12.241480 9331 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:15:12.242288 9331 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:15:12.242537 9331 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:15:12.243422 9331 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:15:12.244829 9331 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:15:12.244920 9331 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:12.245025 9331 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:15:12.245090 9331 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:12.273093 9331 rpc_server.cc:307] RPC server started. Bound to: 127.7.84.130:41355
I20240503 08:15:12.273135 9457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.84.130:41355 every 8 connection(s)
I20240503 08:15:12.274499 9331 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data/info.pb
I20240503 08:15:12.282739 7506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqhmq97/build/asan/bin/kudu as pid 9331
I20240503 08:15:12.282938 7506 tablet_copy_client_session-itest.cc:139] Starting loop 2
I20240503 08:15:12.283030 7506 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqhmq97/build/asan/bin/kudu pid 8811
I20240503 08:15:12.286718 9458 heartbeater.cc:347] Connected to a master server at 127.7.84.190:42907
I20240503 08:15:12.287036 9458 heartbeater.cc:464] Registering TS with master...
I20240503 08:15:12.288002 9458 heartbeater.cc:511] Master 127.7.84.190:42907 requested a full tablet report, sending...
I20240503 08:15:12.289450 7897 ts_manager.cc:194] Re-registered known tserver with Master: 02e1007970d643568e7b76a5a341364c (127.7.84.130:41355)
I20240503 08:15:12.290386 7897 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.84.130:48557
I20240503 08:15:12.291765 9110 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 08:15:12.394919 7506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqhmq97/build/asan/bin/kudu with pid 8811
I20240503 08:15:12.411289 7506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqhmq97/build/asan/bin/kudu
/tmp/dist-test-taskqhmq97/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.84.129:43579
--local_ip_for_outbound_sockets=127.7.84.129
--tserver_master_addrs=127.7.84.190:42907
--webserver_port=45175
--webserver_interface=127.7.84.129
--builtin_ntp_servers=127.7.84.148:40539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240503 08:15:12.433126 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.444659 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.472200 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.473371 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.488287 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.489341 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.491209 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.492426 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.499303 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.500341 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.526276 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.527364 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.532122 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.536788 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.541034 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.542052 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.544235 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.545142 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.551040 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.552062 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.559777 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.560832 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.567708 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.568907 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.588023 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.589286 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.598783 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.599865 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.602180 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.603097 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.607599 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.611214 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.619920 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.620869 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.622829 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.623979 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.629474 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.631675 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.642594 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.643611 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.646040 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.653136 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.664045 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.665019 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.668252 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.675261 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.680297 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.686968 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.691457 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.692371 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.723578 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.724697 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.726569 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.727691 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.730902 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.731869 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.734850 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.735780 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.746526 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.747941 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
W20240503 08:15:12.754153 9470 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:15:12.754431 9470 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:15:12.754561 9470 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:15:12.761837 9470 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:15:12.762020 9470 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.84.129
I20240503 08:15:12.762948 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.763998 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.771530 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.771858 9470 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.84.148:40539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.84.129:43579
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.84.129
--webserver_port=45175
--tserver_master_addrs=127.7.84.190:42907
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.84.129
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 07:43:23 UTC on efd1337a2aa3
build id 103
ASAN enabled
I20240503 08:15:12.772639 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.773419 9470 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:15:12.775497 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.775492 9470 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20240503 08:15:12.776556 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.782187 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.784476 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
W20240503 08:15:12.788097 9611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:12.788571 9612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:12.788954 9618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:15:12.789348 9470 server_base.cc:1034] running on GCE node
I20240503 08:15:12.789888 9470 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:15:12.790685 9470 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:15:12.791883 9470 hybrid_clock.cc:648] HybridClock initialized: now 1714724112791824 us; error 37 us; skew 500 ppm
I20240503 08:15:12.792152 9470 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:15:12.798457 9470 webserver.cc:460] Webserver started at http://127.7.84.129:45175/ using document root <none> and password file <none>
I20240503 08:15:12.799121 9470 fs_manager.cc:359] Metadata directory not provided
I20240503 08:15:12.799242 9470 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:15:12.804210 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.804210 9470 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20240503 08:15:12.805233 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.807047 9628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:12.808346 9470 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20240503 08:15:12.808490 9470 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/wal
uuid: "d996cd72cfab427d82c659abb0408095"
format_stamp: "Formatted at 2024-05-03 08:15:04 on dist-test-slave-2jf9"
I20240503 08:15:12.809291 9470 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:15:12.812108 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.814955 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.817173 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.818121 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.827628 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.831350 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.837932 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.838836 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.840731 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.841557 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.854615 9470 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:15:12.855412 9470 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:15:12.855674 9470 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:15:12.856547 9470 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:15:12.857906 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.858673 9656 ts_tablet_manager.cc:522] Loading tablet metadata (0/1 complete)
I20240503 08:15:12.858834 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.861182 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.862406 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.863806 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.864862 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.865283 9470 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240503 08:15:12.865391 9470 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20240503 08:15:12.865504 9470 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240503 08:15:12.868250 9470 ts_tablet_manager.cc:590] Registered 1 tablets
I20240503 08:15:12.868319 9470 ts_tablet_manager.cc:569] Time spent register tablets: real 0.003s user 0.002s sys 0.000s
I20240503 08:15:12.868687 9656 tablet_bootstrap.cc:492] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095: Bootstrap starting.
I20240503 08:15:12.880280 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.896847 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.902686 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.903851 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.907482 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.915299 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.936234 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.936749 9470 rpc_server.cc:307] RPC server started. Bound to: 127.7.84.129:43579
I20240503 08:15:12.936793 9785 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.84.129:43579 every 8 connection(s)
I20240503 08:15:12.938162 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.938796 9470 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-0/data/info.pb
I20240503 08:15:12.939797 7506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqhmq97/build/asan/bin/kudu as pid 9470
I20240503 08:15:12.963440 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:12.963790 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
I20240503 08:15:12.964644 9790 heartbeater.cc:347] Connected to a master server at 127.7.84.190:42907
I20240503 08:15:12.964988 9790 heartbeater.cc:464] Registering TS with master...
W20240503 08:15:12.965708 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:12.966027 9790 heartbeater.cc:511] Master 127.7.84.190:42907 requested a full tablet report, sending...
I20240503 08:15:12.972014 7897 ts_manager.cc:194] Re-registered known tserver with Master: d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.973214 7897 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.84.129:53427
I20240503 08:15:12.979934 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.987583 9656 log.cc:824] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095: Log is configured to *not* fsync() on all Append() calls
I20240503 08:15:12.988584 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.989353 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:12.989557 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:12.989745 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:12.994005 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:12.995662 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:12.996373 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:12.996527 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:12.996723 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.001091 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.002257 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.002945 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.003101 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.003265 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.014720 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.015902 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.016683 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.016855 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.017030 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.020699 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.021734 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.022363 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.022518 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.022703 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.024577 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.025581 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.026221 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.026343 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.026523 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.037627 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.038646 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.039227 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.039371 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.039580 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.048115 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.051345 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.051965 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.052096 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.052266 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.056794 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.057698 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.058210 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.058339 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.058504 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.068171 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.069188 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.069790 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.069931 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.070152 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.079416 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.080439 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.081040 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.081174 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.081322 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.088593 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.089828 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.090515 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.090685 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.090873 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.099298 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.101104 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.101673 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.101845 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.101994 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.106333 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.111431 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.112030 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.112164 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.112357 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.120383 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.121366 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.121930 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.122076 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.122234 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.125566 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.131611 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.132174 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.132288 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.132447 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.134747 9474 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.135687 9474 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.136202 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.136322 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.136464 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.138411 9472 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.139437 9472 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.139993 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.140107 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.140264 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.151654 9472 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.152555 9472 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.153064 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.153182 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.153357 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.155417 9472 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.156327 9472 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.156852 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.156952 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.157096 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.158250 9472 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.159612 9472 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.160168 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.160318 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.160470 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.166366 9472 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.167302 9472 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.167903 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.168049 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.168224 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.170258 9472 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.176265 9472 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.176872 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.177034 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.177181 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.198364 9472 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.199455 9472 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.200193 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.200366 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.200589 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.211860 9472 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.212960 9472 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.213557 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.213724 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.213888 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.232225 9472 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.233253 9472 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.233819 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.233932 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.234092 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.243384 9472 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.244365 9472 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.244926 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.245054 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.245199 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.248188 9472 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.251828 9472 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.252384 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.252501 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.252671 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.264366 9472 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.265293 9472 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.265830 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.265969 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.266109 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.292771 9458 heartbeater.cc:503] Master 127.7.84.190:42907 was elected leader, sending a full tablet report...
I20240503 08:15:13.298251 9472 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.299995 9472 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.301103 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.301263 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.301446 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.314656 9472 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.315632 9472 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.316203 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.316341 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.316493 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.321132 9472 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.322090 9472 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.322705 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.322820 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.322984 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.331527 9472 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.334033 9472 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.334625 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.334798 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.334980 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.336838 9472 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.337837 9472 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.338374 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.338493 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.338662 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.341121 9472 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.342018 9472 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.342507 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.342629 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.342777 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.348084 9472 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.351214 9472 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.351956 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.352106 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.352275 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.361171 9937 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.362237 9937 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.362774 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.362902 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.363052 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.384301 9937 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.385306 9937 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.385932 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.386085 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.386273 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.388062 9937 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.388959 9937 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.389516 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.389680 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.389842 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.391992 9937 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.398128 9937 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.398761 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.398932 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.399127 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.401544 9937 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.402449 9937 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.402972 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.403131 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.403319 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.424705 9937 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.425753 9937 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.426365 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.426542 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.426754 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.429489 9937 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.430507 9937 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.431097 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.431253 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.431444 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.433327 9937 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.434222 9937 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.434784 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.434924 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.435094 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.441143 9937 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.442289 9937 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.442857 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.443015 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.443177 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.444836 9937 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.445783 9937 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.446342 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.446486 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.446676 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.470044 9937 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.471035 9937 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.471666 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.471843 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.472016 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.485333 9937 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.486420 9937 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.487172 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.487334 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.487555 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.489154 9937 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.490114 9937 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.490676 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.490825 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.490970 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.508028 9937 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.509076 9937 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.509713 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.509847 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.510047 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.512511 9937 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.513640 9937 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.514196 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.514333 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.514472 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.529527 9937 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.530516 9937 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.531153 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.531316 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.531528 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.535252 9937 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.535537 9656 tablet_bootstrap.cc:492] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095: Bootstrap replayed 1/1 log segments. Stats: ops{read=217 overwritten=0 applied=217 ignored=0} inserts{seen=10700 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:15:13.536198 9656 tablet_bootstrap.cc:492] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095: Bootstrap complete.
I20240503 08:15:13.536252 9937 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.536787 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.536936 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
W20240503 08:15:13.537084 9761 tablet_copy_service.cc:478] P d996cd72cfab427d82c659abb0408095: Error handling TabletCopyService RPC request from {username='slave'} at 127.7.84.130:52215: Error beginning tablet copy session for tablet 929484f89c924e2f8dcf51e618a4e6a0: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240503 08:15:13.537583 9656 ts_tablet_manager.cc:1367] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095: Time spent bootstrapping tablet: real 0.669s user 0.581s sys 0.071s
I20240503 08:15:13.542672 9656 raft_consensus.cc:348] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d996cd72cfab427d82c659abb0408095" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 43579 } }
I20240503 08:15:13.543421 9656 raft_consensus.cc:729] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: d996cd72cfab427d82c659abb0408095, State: Initialized, Role: FOLLOWER
I20240503 08:15:13.544041 9656 consensus_queue.cc:260] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 217, Last appended: 3.217, Last appended by leader: 217, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d996cd72cfab427d82c659abb0408095" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 43579 } }
I20240503 08:15:13.544236 9656 raft_consensus.cc:388] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [term 3 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:13.544344 9656 raft_consensus.cc:482] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [term 3 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:13.544512 9656 raft_consensus.cc:3037] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:15:13.547829 9656 raft_consensus.cc:504] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d996cd72cfab427d82c659abb0408095" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 43579 } }
I20240503 08:15:13.548281 9656 leader_election.cc:302] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d996cd72cfab427d82c659abb0408095; no voters:
I20240503 08:15:13.548759 9656 leader_election.cc:288] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [CANDIDATE]: Term 4 election: Requested vote from peers
I20240503 08:15:13.548892 10009 raft_consensus.cc:2781] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [term 4 FOLLOWER]: Leader election won for term 4
I20240503 08:15:13.549360 10009 raft_consensus.cc:686] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [term 4 LEADER]: Becoming Leader. State: Replica: d996cd72cfab427d82c659abb0408095, State: Running, Role: LEADER
I20240503 08:15:13.549854 9790 heartbeater.cc:503] Master 127.7.84.190:42907 was elected leader, sending a full tablet report...
I20240503 08:15:13.550333 9656 ts_tablet_manager.cc:1398] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095: Time spent starting tablet: real 0.013s user 0.010s sys 0.004s
I20240503 08:15:13.550457 10009 consensus_queue.cc:237] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 217, Committed index: 217, Last appended: 3.217, Last appended by leader: 217, Current term: 4, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d996cd72cfab427d82c659abb0408095" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 43579 } }
I20240503 08:15:13.553798 7897 catalog_manager.cc:5484] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095 reported cstate change: term changed from 3 to 4. New cstate: current_term: 4 leader_uuid: "d996cd72cfab427d82c659abb0408095" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d996cd72cfab427d82c659abb0408095" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 43579 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:13.554726 9937 ts_tablet_manager.cc:902] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Initiating tablet copy from peer d996cd72cfab427d82c659abb0408095 (127.7.84.129:43579)
I20240503 08:15:13.555800 9937 tablet_copy_client.cc:308] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:43579
I20240503 08:15:13.556427 9761 tablet_copy_service.cc:140] P d996cd72cfab427d82c659abb0408095: Received BeginTabletCopySession request for tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c ({username='slave'} at 127.7.84.130:52215)
I20240503 08:15:13.556579 9761 tablet_copy_service.cc:161] P d996cd72cfab427d82c659abb0408095: Beginning new tablet copy session on tablet 929484f89c924e2f8dcf51e618a4e6a0 from peer 02e1007970d643568e7b76a5a341364c at {username='slave'} at 127.7.84.130:52215: session id = 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0
I20240503 08:15:13.559074 9761 tablet_copy_source_session.cc:205] T 929484f89c924e2f8dcf51e618a4e6a0 P d996cd72cfab427d82c659abb0408095: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:15:13.563791 9937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 929484f89c924e2f8dcf51e618a4e6a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:13.573781 9937 tablet_copy_client.cc:783] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Starting download of 0 data blocks...
I20240503 08:15:13.574108 9937 tablet_copy_client.cc:647] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Starting download of 1 WAL segments...
I20240503 08:15:13.578327 9937 tablet_copy_client.cc:523] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:15:13.581487 9937 tablet_bootstrap.cc:492] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Bootstrap starting.
I20240503 08:15:13.645958 9937 log.cc:824] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Log is configured to *not* fsync() on all Append() calls
I20240503 08:15:14.162413 9937 tablet_bootstrap.cc:492] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Bootstrap replayed 1/1 log segments. Stats: ops{read=218 overwritten=0 applied=218 ignored=0} inserts{seen=10700 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:15:14.162899 9937 tablet_bootstrap.cc:492] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Bootstrap complete.
I20240503 08:15:14.163352 9937 ts_tablet_manager.cc:1367] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Time spent bootstrapping tablet: real 0.582s user 0.546s sys 0.034s
I20240503 08:15:14.167953 9937 raft_consensus.cc:348] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c [term 4 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d996cd72cfab427d82c659abb0408095" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 43579 } }
I20240503 08:15:14.168292 9937 raft_consensus.cc:729] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c [term 4 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 02e1007970d643568e7b76a5a341364c, State: Initialized, Role: NON_PARTICIPANT
I20240503 08:15:14.168782 9937 consensus_queue.cc:260] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 218, Last appended: 4.218, Last appended by leader: 218, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d996cd72cfab427d82c659abb0408095" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 43579 } }
I20240503 08:15:14.170042 9937 ts_tablet_manager.cc:1398] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20240503 08:15:14.170933 9761 tablet_copy_service.cc:342] P d996cd72cfab427d82c659abb0408095: Request end of tablet copy session 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0 received from {username='slave'} at 127.7.84.130:52215
I20240503 08:15:14.171097 9761 tablet_copy_service.cc:433] P d996cd72cfab427d82c659abb0408095: ending tablet copy session 02e1007970d643568e7b76a5a341364c-929484f89c924e2f8dcf51e618a4e6a0 on tablet 929484f89c924e2f8dcf51e618a4e6a0 with peer 02e1007970d643568e7b76a5a341364c
W20240503 08:15:14.171931 10023 ts_tablet_manager.cc:701] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Tablet Copy: Invalid argument: Leader has replica of tablet 929484f89c924e2f8dcf51e618a4e6a0 with term 0, which is lower than last-logged term 4 on local replica. Rejecting tablet copy request
W20240503 08:15:14.183367 9937 ts_tablet_manager.cc:701] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Tablet Copy: Invalid argument: Leader has replica of tablet 929484f89c924e2f8dcf51e618a4e6a0 with term 0, which is lower than last-logged term 4 on local replica. Rejecting tablet copy request
W20240503 08:15:14.197768 9937 ts_tablet_manager.cc:701] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Tablet Copy: Invalid argument: Leader has replica of tablet 929484f89c924e2f8dcf51e618a4e6a0 with term 0, which is lower than last-logged term 4 on local replica. Rejecting tablet copy request
I20240503 08:15:14.200206 9393 tablet_service.cc:1514] Processing DeleteTablet for tablet 929484f89c924e2f8dcf51e618a4e6a0 with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:44356
I20240503 08:15:14.200922 10025 tablet_replica.cc:330] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: stopping tablet replica
I20240503 08:15:14.201360 10025 raft_consensus.cc:2229] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c [term 4 NON_PARTICIPANT]: Raft consensus shutting down.
I20240503 08:15:14.201681 10025 raft_consensus.cc:2258] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c [term 4 NON_PARTICIPANT]: Raft consensus is shut down!
I20240503 08:15:14.202860 10025 ts_tablet_manager.cc:1875] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20240503 08:15:14.207271 10025 ts_tablet_manager.cc:1888] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 4.218
I20240503 08:15:14.207407 10025 log.cc:1196] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Deleting WAL directory at /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/wal/wals/929484f89c924e2f8dcf51e618a4e6a0
I20240503 08:15:14.207841 10025 ts_tablet_manager.cc:1909] T 929484f89c924e2f8dcf51e618a4e6a0 P 02e1007970d643568e7b76a5a341364c: Deleting consensus metadata
I20240503 08:15:14.209466 7506 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqhmq97/build/asan/bin/kudu pid 9331
I20240503 08:15:14.210403 9453 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 08:15:14.315954 7506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqhmq97/build/asan/bin/kudu with pid 9331
I20240503 08:15:14.338356 7506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqhmq97/build/asan/bin/kudu
/tmp/dist-test-taskqhmq97/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.84.130:41355
--local_ip_for_outbound_sockets=127.7.84.130
--tserver_master_addrs=127.7.84.190:42907
--webserver_port=40021
--webserver_interface=127.7.84.130
--builtin_ntp_servers=127.7.84.148:40539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240503 08:15:14.656198 10027 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:15:14.656467 10027 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:15:14.656589 10027 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:15:14.663764 10027 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:15:14.663957 10027 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.84.130
I20240503 08:15:14.672662 10027 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.84.148:40539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.84.130:41355
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.84.130
--webserver_port=40021
--tserver_master_addrs=127.7.84.190:42907
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.84.130
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 07:43:23 UTC on efd1337a2aa3
build id 103
ASAN enabled
I20240503 08:15:14.673920 10027 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:15:14.675675 10027 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:15:14.686746 10032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:14.687134 10033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:15:14.687917 10027 server_base.cc:1034] running on GCE node
W20240503 08:15:14.688383 10035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:15:14.688971 10027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:15:14.689774 10027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:15:14.690973 10027 hybrid_clock.cc:648] HybridClock initialized: now 1714724114690914 us; error 35 us; skew 500 ppm
I20240503 08:15:14.691224 10027 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:15:14.693244 10027 webserver.cc:460] Webserver started at http://127.7.84.130:40021/ using document root <none> and password file <none>
I20240503 08:15:14.693876 10027 fs_manager.cc:359] Metadata directory not provided
I20240503 08:15:14.693976 10027 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:15:14.698628 10027 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.002s
I20240503 08:15:14.702597 10041 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:14.703860 10027 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20240503 08:15:14.703984 10027 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/wal
uuid: "02e1007970d643568e7b76a5a341364c"
format_stamp: "Formatted at 2024-05-03 08:15:04 on dist-test-slave-2jf9"
I20240503 08:15:14.704746 10027 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:15:14.731917 10027 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:15:14.732726 10027 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:15:14.732959 10027 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:15:14.733855 10027 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:15:14.735320 10027 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:15:14.735436 10027 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:14.735529 10027 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:15:14.735584 10027 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:14.763099 10027 rpc_server.cc:307] RPC server started. Bound to: 127.7.84.130:41355
I20240503 08:15:14.763164 10153 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.84.130:41355 every 8 connection(s)
I20240503 08:15:14.764549 10027 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714724103239050-7506-0/minicluster-data/ts-1/data/info.pb
I20240503 08:15:14.766438 7506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqhmq97/build/asan/bin/kudu as pid 10027
I20240503 08:15:14.766916 7506 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqhmq97/build/asan/bin/kudu pid 9470
I20240503 08:15:14.774467 9781 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 08:15:14.779031 10154 heartbeater.cc:347] Connected to a master server at 127.7.84.190:42907
I20240503 08:15:14.779330 10154 heartbeater.cc:464] Registering TS with master...
I20240503 08:15:14.780159 10154 heartbeater.cc:511] Master 127.7.84.190:42907 requested a full tablet report, sending...
I20240503 08:15:14.781497 7897 ts_manager.cc:194] Re-registered known tserver with Master: 02e1007970d643568e7b76a5a341364c (127.7.84.130:41355)
I20240503 08:15:14.782235 7897 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.84.130:58187
I20240503 08:15:14.872642 7506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqhmq97/build/asan/bin/kudu with pid 9470
I20240503 08:15:14.887889 7506 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqhmq97/build/asan/bin/kudu pid 10027
I20240503 08:15:14.895763 10149 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 08:15:14.975973 7506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqhmq97/build/asan/bin/kudu with pid 10027
I20240503 08:15:14.989790 7506 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqhmq97/build/asan/bin/kudu pid 7874
I20240503 08:15:14.990984 7936 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 08:15:15.092626 7506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqhmq97/build/asan/bin/kudu with pid 7874
2024-05-03T08:15:15Z chronyd exiting
[ OK ] TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping (11824 ms)
[ RUN ] TabletCopyClientSessionITest.TestStartTabletCopy
2024-05-03T08:15:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-03T08:15:15Z Disabled control of system clock
I20240503 08:15:15.149665 7506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqhmq97/build/asan/bin/kudu
/tmp/dist-test-taskqhmq97/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.84.190:41777
--webserver_interface=127.7.84.190
--webserver_port=0
--builtin_ntp_servers=127.7.84.148:40629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.84.190:41777
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240503 08:15:15.450704 10167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:15:15.450979 10167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:15:15.451109 10167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:15:15.458393 10167 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240503 08:15:15.458503 10167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:15:15.458573 10167 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240503 08:15:15.458642 10167 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240503 08:15:15.467500 10167 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.84.148:40629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.7.84.190:41777
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.84.190:41777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.84.190
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 07:43:23 UTC on efd1337a2aa3
build id 103
ASAN enabled
I20240503 08:15:15.468802 10167 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:15:15.470496 10167 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:15:15.480906 10173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:15.480873 10172 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:15.481132 10175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:15:15.481958 10167 server_base.cc:1034] running on GCE node
I20240503 08:15:15.482657 10167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:15:15.483983 10167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:15:15.485188 10167 hybrid_clock.cc:648] HybridClock initialized: now 1714724115485127 us; error 39 us; skew 500 ppm
I20240503 08:15:15.485482 10167 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:15:15.487562 10167 webserver.cc:460] Webserver started at http://127.7.84.190:36449/ using document root <none> and password file <none>
I20240503 08:15:15.488225 10167 fs_manager.cc:359] Metadata directory not provided
I20240503 08:15:15.488344 10167 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:15:15.488639 10167 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:15:15.491109 10167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/master-0/data/instance:
uuid: "364baf3466664e9e8d697b00a28584d7"
format_stamp: "Formatted at 2024-05-03 08:15:15 on dist-test-slave-2jf9"
I20240503 08:15:15.491843 10167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/master-0/wal/instance:
uuid: "364baf3466664e9e8d697b00a28584d7"
format_stamp: "Formatted at 2024-05-03 08:15:15 on dist-test-slave-2jf9"
I20240503 08:15:15.496747 10167 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20240503 08:15:15.500069 10181 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:15.501257 10167 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.004s sys 0.000s
I20240503 08:15:15.501431 10167 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/master-0/data,/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/master-0/wal
uuid: "364baf3466664e9e8d697b00a28584d7"
format_stamp: "Formatted at 2024-05-03 08:15:15 on dist-test-slave-2jf9"
I20240503 08:15:15.501592 10167 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:15:15.522933 10167 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:15:15.523742 10167 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:15:15.524004 10167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:15:15.539958 10167 rpc_server.cc:307] RPC server started. Bound to: 127.7.84.190:41777
I20240503 08:15:15.539978 10232 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.84.190:41777 every 8 connection(s)
I20240503 08:15:15.541288 10167 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/master-0/data/info.pb
I20240503 08:15:15.543598 7506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqhmq97/build/asan/bin/kudu as pid 10167
I20240503 08:15:15.543833 7506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/master-0/wal/instance
I20240503 08:15:15.545301 10233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:15.556262 10233 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7: Bootstrap starting.
I20240503 08:15:15.559194 10233 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7: Neither blocks nor log segments found. Creating new log.
I20240503 08:15:15.560104 10233 log.cc:824] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7: Log is configured to *not* fsync() on all Append() calls
I20240503 08:15:15.562237 10233 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7: No bootstrap required, opened a new log
I20240503 08:15:15.568243 10233 raft_consensus.cc:348] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "364baf3466664e9e8d697b00a28584d7" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 41777 } }
I20240503 08:15:15.568532 10233 raft_consensus.cc:374] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:15:15.568625 10233 raft_consensus.cc:729] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 364baf3466664e9e8d697b00a28584d7, State: Initialized, Role: FOLLOWER
I20240503 08:15:15.569151 10233 consensus_queue.cc:260] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "364baf3466664e9e8d697b00a28584d7" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 41777 } }
I20240503 08:15:15.569324 10233 raft_consensus.cc:388] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:15.569437 10233 raft_consensus.cc:482] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:15.569550 10233 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:15:15.571599 10233 raft_consensus.cc:504] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "364baf3466664e9e8d697b00a28584d7" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 41777 } }
I20240503 08:15:15.572044 10233 leader_election.cc:302] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 364baf3466664e9e8d697b00a28584d7; no voters:
I20240503 08:15:15.572536 10233 leader_election.cc:288] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:15:15.572661 10238 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:15:15.573244 10238 raft_consensus.cc:686] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7 [term 1 LEADER]: Becoming Leader. State: Replica: 364baf3466664e9e8d697b00a28584d7, State: Running, Role: LEADER
I20240503 08:15:15.573710 10238 consensus_queue.cc:237] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "364baf3466664e9e8d697b00a28584d7" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 41777 } }
I20240503 08:15:15.574255 10233 sys_catalog.cc:564] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7 [sys.catalog]: configured and running, proceeding with master startup.
I20240503 08:15:15.576203 10239 sys_catalog.cc:455] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "364baf3466664e9e8d697b00a28584d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "364baf3466664e9e8d697b00a28584d7" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 41777 } } }
I20240503 08:15:15.576525 10239 sys_catalog.cc:458] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7 [sys.catalog]: This master's current role is: LEADER
I20240503 08:15:15.577118 10240 sys_catalog.cc:455] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 364baf3466664e9e8d697b00a28584d7. Latest consensus state: current_term: 1 leader_uuid: "364baf3466664e9e8d697b00a28584d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "364baf3466664e9e8d697b00a28584d7" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 41777 } } }
I20240503 08:15:15.577363 10240 sys_catalog.cc:458] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7 [sys.catalog]: This master's current role is: LEADER
I20240503 08:15:15.580881 10244 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240503 08:15:15.585160 10244 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240503 08:15:15.593171 10244 catalog_manager.cc:1347] Generated new cluster ID: 8d46e998edb1422ba62101ee54fa6b0f
I20240503 08:15:15.593266 10244 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240503 08:15:15.621860 10244 catalog_manager.cc:1370] Generated new certificate authority record
I20240503 08:15:15.623052 10244 catalog_manager.cc:1504] Loading token signing keys...
I20240503 08:15:15.629454 10244 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7: Generated new TSK 0
I20240503 08:15:15.630196 10244 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240503 08:15:15.634819 7506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqhmq97/build/asan/bin/kudu
/tmp/dist-test-taskqhmq97/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.84.129:0
--local_ip_for_outbound_sockets=127.7.84.129
--webserver_interface=127.7.84.129
--webserver_port=0
--tserver_master_addrs=127.7.84.190:41777
--builtin_ntp_servers=127.7.84.148:40629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240503 08:15:15.941200 10257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:15:15.941454 10257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:15:15.941535 10257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:15:15.949753 10257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:15:15.949920 10257 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.84.129
I20240503 08:15:15.958552 10257 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.84.148:40629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.84.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.84.129
--webserver_port=0
--tserver_master_addrs=127.7.84.190:41777
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.84.129
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 07:43:23 UTC on efd1337a2aa3
build id 103
ASAN enabled
I20240503 08:15:15.959770 10257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:15:15.961350 10257 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:15:15.971998 10262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:15.972534 10263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:15.973109 10265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:15:15.973368 10257 server_base.cc:1034] running on GCE node
I20240503 08:15:15.973927 10257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:15:15.975456 10257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:15:15.976660 10257 hybrid_clock.cc:648] HybridClock initialized: now 1714724115976593 us; error 40 us; skew 500 ppm
I20240503 08:15:15.976945 10257 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:15:15.979002 10257 webserver.cc:460] Webserver started at http://127.7.84.129:46227/ using document root <none> and password file <none>
I20240503 08:15:15.979740 10257 fs_manager.cc:359] Metadata directory not provided
I20240503 08:15:15.979861 10257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:15:15.980155 10257 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:15:15.982774 10257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-0/data/instance:
uuid: "92a6ee50d9604234a4bce3e2e978f487"
format_stamp: "Formatted at 2024-05-03 08:15:15 on dist-test-slave-2jf9"
I20240503 08:15:15.983536 10257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-0/wal/instance:
uuid: "92a6ee50d9604234a4bce3e2e978f487"
format_stamp: "Formatted at 2024-05-03 08:15:15 on dist-test-slave-2jf9"
I20240503 08:15:15.988389 10257 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20240503 08:15:15.991480 10271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:15.992695 10257 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20240503 08:15:15.992847 10257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-0/wal
uuid: "92a6ee50d9604234a4bce3e2e978f487"
format_stamp: "Formatted at 2024-05-03 08:15:15 on dist-test-slave-2jf9"
I20240503 08:15:15.993010 10257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:15:16.026221 10257 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:15:16.027175 10257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:15:16.027487 10257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:15:16.028429 10257 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:15:16.029917 10257 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:15:16.029994 10257 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:16.030115 10257 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:15:16.030166 10257 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:16.058398 10257 rpc_server.cc:307] RPC server started. Bound to: 127.7.84.129:35889
I20240503 08:15:16.058442 10383 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.84.129:35889 every 8 connection(s)
I20240503 08:15:16.059662 10257 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-0/data/info.pb
I20240503 08:15:16.061048 7506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqhmq97/build/asan/bin/kudu as pid 10257
I20240503 08:15:16.061226 7506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-0/wal/instance
I20240503 08:15:16.065052 7506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqhmq97/build/asan/bin/kudu
/tmp/dist-test-taskqhmq97/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.84.130:0
--local_ip_for_outbound_sockets=127.7.84.130
--webserver_interface=127.7.84.130
--webserver_port=0
--tserver_master_addrs=127.7.84.190:41777
--builtin_ntp_servers=127.7.84.148:40629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240503 08:15:16.074334 10384 heartbeater.cc:347] Connected to a master server at 127.7.84.190:41777
I20240503 08:15:16.074605 10384 heartbeater.cc:464] Registering TS with master...
I20240503 08:15:16.075434 10384 heartbeater.cc:511] Master 127.7.84.190:41777 requested a full tablet report, sending...
I20240503 08:15:16.077524 10198 ts_manager.cc:194] Registered new tserver with Master: 92a6ee50d9604234a4bce3e2e978f487 (127.7.84.129:35889)
I20240503 08:15:16.079005 10198 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.84.129:60081
W20240503 08:15:16.368073 10388 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:15:16.368362 10388 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:15:16.368489 10388 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:15:16.375747 10388 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:15:16.375934 10388 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.84.130
I20240503 08:15:16.384531 10388 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.84.148:40629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.84.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.84.130
--webserver_port=0
--tserver_master_addrs=127.7.84.190:41777
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.84.130
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 07:43:23 UTC on efd1337a2aa3
build id 103
ASAN enabled
I20240503 08:15:16.385752 10388 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:15:16.387384 10388 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:15:16.398425 10393 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:16.398955 10394 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:16.399456 10396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:15:16.399744 10388 server_base.cc:1034] running on GCE node
I20240503 08:15:16.400260 10388 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:15:16.401087 10388 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:15:16.402281 10388 hybrid_clock.cc:648] HybridClock initialized: now 1714724116402227 us; error 31 us; skew 500 ppm
I20240503 08:15:16.402541 10388 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:15:16.404569 10388 webserver.cc:460] Webserver started at http://127.7.84.130:39079/ using document root <none> and password file <none>
I20240503 08:15:16.405211 10388 fs_manager.cc:359] Metadata directory not provided
I20240503 08:15:16.405359 10388 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:15:16.405652 10388 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:15:16.408145 10388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-1/data/instance:
uuid: "45a212dc6b3240bfb7b92ddcca12d918"
format_stamp: "Formatted at 2024-05-03 08:15:16 on dist-test-slave-2jf9"
I20240503 08:15:16.408797 10388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-1/wal/instance:
uuid: "45a212dc6b3240bfb7b92ddcca12d918"
format_stamp: "Formatted at 2024-05-03 08:15:16 on dist-test-slave-2jf9"
I20240503 08:15:16.413511 10388 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20240503 08:15:16.416591 10402 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:16.417768 10388 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240503 08:15:16.417908 10388 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-1/wal
uuid: "45a212dc6b3240bfb7b92ddcca12d918"
format_stamp: "Formatted at 2024-05-03 08:15:16 on dist-test-slave-2jf9"
I20240503 08:15:16.418062 10388 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:15:16.435307 10388 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:15:16.436084 10388 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:15:16.436337 10388 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:15:16.437244 10388 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:15:16.438694 10388 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:15:16.438768 10388 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:16.438890 10388 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:15:16.438942 10388 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:16.468549 10388 rpc_server.cc:307] RPC server started. Bound to: 127.7.84.130:45721
I20240503 08:15:16.468582 10514 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.84.130:45721 every 8 connection(s)
I20240503 08:15:16.469770 10388 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-1/data/info.pb
I20240503 08:15:16.470901 7506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqhmq97/build/asan/bin/kudu as pid 10388
I20240503 08:15:16.471096 7506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-1/wal/instance
I20240503 08:15:16.482120 10515 heartbeater.cc:347] Connected to a master server at 127.7.84.190:41777
I20240503 08:15:16.482372 10515 heartbeater.cc:464] Registering TS with master...
I20240503 08:15:16.483120 10515 heartbeater.cc:511] Master 127.7.84.190:41777 requested a full tablet report, sending...
I20240503 08:15:16.484375 10198 ts_manager.cc:194] Registered new tserver with Master: 45a212dc6b3240bfb7b92ddcca12d918 (127.7.84.130:45721)
I20240503 08:15:16.485158 10198 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.84.130:60079
I20240503 08:15:16.486781 7506 external_mini_cluster.cc:930] 2 TS(s) registered with all masters
I20240503 08:15:16.499723 7506 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqhmq97/build/asan/bin/kudu pid 10388
I20240503 08:15:16.507525 10510 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 08:15:16.590257 7506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqhmq97/build/asan/bin/kudu with pid 10388
I20240503 08:15:16.602653 7506 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqhmq97/build/asan/bin/kudu pid 10167
I20240503 08:15:16.603813 10228 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 08:15:16.699411 7506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqhmq97/build/asan/bin/kudu with pid 10167
I20240503 08:15:16.715463 7506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqhmq97/build/asan/bin/kudu
/tmp/dist-test-taskqhmq97/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.84.190:41777
--webserver_interface=127.7.84.190
--webserver_port=36449
--builtin_ntp_servers=127.7.84.148:40629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.84.190:41777
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240503 08:15:17.022970 10527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:15:17.023277 10527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:15:17.023442 10527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:15:17.030859 10527 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240503 08:15:17.030970 10527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:15:17.031040 10527 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240503 08:15:17.031111 10527 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240503 08:15:17.040380 10527 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.84.148:40629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.7.84.190:41777
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.84.190:41777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.84.190
--webserver_port=36449
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 07:43:23 UTC on efd1337a2aa3
build id 103
ASAN enabled
I20240503 08:15:17.041697 10527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:15:17.043429 10527 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:15:17.053755 10532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:17.054234 10535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:17.054731 10533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:15:17.055570 10527 server_base.cc:1034] running on GCE node
I20240503 08:15:17.056361 10527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:15:17.057770 10527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:15:17.058991 10527 hybrid_clock.cc:648] HybridClock initialized: now 1714724117058922 us; error 51 us; skew 500 ppm
I20240503 08:15:17.059324 10527 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:15:17.061748 10527 webserver.cc:460] Webserver started at http://127.7.84.190:36449/ using document root <none> and password file <none>
I20240503 08:15:17.062446 10527 fs_manager.cc:359] Metadata directory not provided
I20240503 08:15:17.062597 10527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:15:17.067750 10527 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20240503 08:15:17.070511 10541 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:17.071873 10527 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240503 08:15:17.072039 10527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/master-0/data,/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/master-0/wal
uuid: "364baf3466664e9e8d697b00a28584d7"
format_stamp: "Formatted at 2024-05-03 08:15:15 on dist-test-slave-2jf9"
I20240503 08:15:17.072870 10527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:15:17.081571 10384 heartbeater.cc:503] Master 127.7.84.190:41777 was elected leader, sending a full tablet report...
W20240503 08:15:17.082980 10384 heartbeater.cc:644] Failed to heartbeat to 127.7.84.190:41777 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.7.84.190:41777: connect: Connection refused (error 111)
I20240503 08:15:17.114881 10527 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:15:17.115789 10527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:15:17.116052 10527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:15:17.132477 10527 rpc_server.cc:307] RPC server started. Bound to: 127.7.84.190:41777
I20240503 08:15:17.132494 10593 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.84.190:41777 every 8 connection(s)
I20240503 08:15:17.133879 10527 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/master-0/data/info.pb
I20240503 08:15:17.139889 10594 sys_catalog.cc:263] Verifying existing consensus state
I20240503 08:15:17.140010 7506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqhmq97/build/asan/bin/kudu as pid 10527
I20240503 08:15:17.143101 10594 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7: Bootstrap starting.
I20240503 08:15:17.159291 10594 log.cc:824] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7: Log is configured to *not* fsync() on all Append() calls
I20240503 08:15:17.167075 10594 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:15:17.167614 10594 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7: Bootstrap complete.
I20240503 08:15:17.174175 10594 raft_consensus.cc:348] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "364baf3466664e9e8d697b00a28584d7" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 41777 } }
I20240503 08:15:17.174875 10594 raft_consensus.cc:729] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 364baf3466664e9e8d697b00a28584d7, State: Initialized, Role: FOLLOWER
I20240503 08:15:17.175463 10594 consensus_queue.cc:260] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "364baf3466664e9e8d697b00a28584d7" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 41777 } }
I20240503 08:15:17.175670 10594 raft_consensus.cc:388] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:17.175777 10594 raft_consensus.cc:482] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:17.175935 10594 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:15:17.179719 10594 raft_consensus.cc:504] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "364baf3466664e9e8d697b00a28584d7" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 41777 } }
I20240503 08:15:17.180173 10594 leader_election.cc:302] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 364baf3466664e9e8d697b00a28584d7; no voters:
I20240503 08:15:17.180681 10594 leader_election.cc:288] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:15:17.180824 10599 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:15:17.181357 10599 raft_consensus.cc:686] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7 [term 2 LEADER]: Becoming Leader. State: Replica: 364baf3466664e9e8d697b00a28584d7, State: Running, Role: LEADER
I20240503 08:15:17.181838 10599 consensus_queue.cc:237] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "364baf3466664e9e8d697b00a28584d7" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 41777 } }
I20240503 08:15:17.182456 10594 sys_catalog.cc:564] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7 [sys.catalog]: configured and running, proceeding with master startup.
I20240503 08:15:17.184085 10601 sys_catalog.cc:455] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 364baf3466664e9e8d697b00a28584d7. Latest consensus state: current_term: 2 leader_uuid: "364baf3466664e9e8d697b00a28584d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "364baf3466664e9e8d697b00a28584d7" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 41777 } } }
I20240503 08:15:17.184514 10601 sys_catalog.cc:458] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7 [sys.catalog]: This master's current role is: LEADER
I20240503 08:15:17.184384 10600 sys_catalog.cc:455] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "364baf3466664e9e8d697b00a28584d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "364baf3466664e9e8d697b00a28584d7" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 41777 } } }
I20240503 08:15:17.184671 10600 sys_catalog.cc:458] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7 [sys.catalog]: This master's current role is: LEADER
I20240503 08:15:17.185657 10605 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240503 08:15:17.191062 10605 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240503 08:15:17.192620 10605 catalog_manager.cc:1259] Loaded cluster ID: 8d46e998edb1422ba62101ee54fa6b0f
I20240503 08:15:17.192739 10605 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240503 08:15:17.196705 10605 catalog_manager.cc:1504] Loading token signing keys...
I20240503 08:15:17.198098 10605 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 364baf3466664e9e8d697b00a28584d7: Loaded TSK: 0
I20240503 08:15:17.199688 10605 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240503 08:15:18.089713 10384 heartbeater.cc:347] Connected to a master server at 127.7.84.190:41777
I20240503 08:15:18.089922 10384 heartbeater.cc:503] Master 127.7.84.190:41777 was elected leader, sending a full tablet report...
I20240503 08:15:18.091785 10559 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "92a6ee50d9604234a4bce3e2e978f487" instance_seqno: 1714724116051412) as {username='slave'} at 127.7.84.129:60357; Asking this server to re-register.
I20240503 08:15:18.092422 10384 heartbeater.cc:464] Registering TS with master...
I20240503 08:15:18.092654 10384 heartbeater.cc:511] Master 127.7.84.190:41777 requested a full tablet report, sending...
I20240503 08:15:18.093787 10559 ts_manager.cc:194] Registered new tserver with Master: 92a6ee50d9604234a4bce3e2e978f487 (127.7.84.129:35889)
I20240503 08:15:18.098078 7506 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20240503 08:15:18.098223 7506 test_util.cc:268] Using random seed: 1374843169
I20240503 08:15:18.119704 10559 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34576:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20240503 08:15:18.143441 10319 tablet_service.cc:1467] Processing CreateTablet for tablet cade2545388a49ef985e82076b512f0b (DEFAULT_TABLE table=test-workload [id=a310d72cc9cd4f53a4e61252bb07de5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20240503 08:15:18.144841 10319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cade2545388a49ef985e82076b512f0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:18.157033 10629 tablet_bootstrap.cc:492] T cade2545388a49ef985e82076b512f0b P 92a6ee50d9604234a4bce3e2e978f487: Bootstrap starting.
I20240503 08:15:18.159693 10629 tablet_bootstrap.cc:654] T cade2545388a49ef985e82076b512f0b P 92a6ee50d9604234a4bce3e2e978f487: Neither blocks nor log segments found. Creating new log.
I20240503 08:15:18.160634 10629 log.cc:824] T cade2545388a49ef985e82076b512f0b P 92a6ee50d9604234a4bce3e2e978f487: Log is configured to *not* fsync() on all Append() calls
I20240503 08:15:18.163009 10629 tablet_bootstrap.cc:492] T cade2545388a49ef985e82076b512f0b P 92a6ee50d9604234a4bce3e2e978f487: No bootstrap required, opened a new log
I20240503 08:15:18.163234 10629 ts_tablet_manager.cc:1367] T cade2545388a49ef985e82076b512f0b P 92a6ee50d9604234a4bce3e2e978f487: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20240503 08:15:18.168762 10629 raft_consensus.cc:348] T cade2545388a49ef985e82076b512f0b P 92a6ee50d9604234a4bce3e2e978f487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92a6ee50d9604234a4bce3e2e978f487" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35889 } }
I20240503 08:15:18.169065 10629 raft_consensus.cc:374] T cade2545388a49ef985e82076b512f0b P 92a6ee50d9604234a4bce3e2e978f487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:15:18.169155 10629 raft_consensus.cc:729] T cade2545388a49ef985e82076b512f0b P 92a6ee50d9604234a4bce3e2e978f487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a6ee50d9604234a4bce3e2e978f487, State: Initialized, Role: FOLLOWER
I20240503 08:15:18.169737 10629 consensus_queue.cc:260] T cade2545388a49ef985e82076b512f0b P 92a6ee50d9604234a4bce3e2e978f487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92a6ee50d9604234a4bce3e2e978f487" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35889 } }
I20240503 08:15:18.169952 10629 raft_consensus.cc:388] T cade2545388a49ef985e82076b512f0b P 92a6ee50d9604234a4bce3e2e978f487 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:18.170087 10629 raft_consensus.cc:482] T cade2545388a49ef985e82076b512f0b P 92a6ee50d9604234a4bce3e2e978f487 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:18.170233 10629 raft_consensus.cc:3037] T cade2545388a49ef985e82076b512f0b P 92a6ee50d9604234a4bce3e2e978f487 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:15:18.172179 10629 raft_consensus.cc:504] T cade2545388a49ef985e82076b512f0b P 92a6ee50d9604234a4bce3e2e978f487 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92a6ee50d9604234a4bce3e2e978f487" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35889 } }
I20240503 08:15:18.172608 10629 leader_election.cc:302] T cade2545388a49ef985e82076b512f0b P 92a6ee50d9604234a4bce3e2e978f487 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 92a6ee50d9604234a4bce3e2e978f487; no voters:
I20240503 08:15:18.173128 10629 leader_election.cc:288] T cade2545388a49ef985e82076b512f0b P 92a6ee50d9604234a4bce3e2e978f487 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:15:18.173257 10631 raft_consensus.cc:2781] T cade2545388a49ef985e82076b512f0b P 92a6ee50d9604234a4bce3e2e978f487 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:15:18.173784 10631 raft_consensus.cc:686] T cade2545388a49ef985e82076b512f0b P 92a6ee50d9604234a4bce3e2e978f487 [term 1 LEADER]: Becoming Leader. State: Replica: 92a6ee50d9604234a4bce3e2e978f487, State: Running, Role: LEADER
I20240503 08:15:18.174324 10631 consensus_queue.cc:237] T cade2545388a49ef985e82076b512f0b P 92a6ee50d9604234a4bce3e2e978f487 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92a6ee50d9604234a4bce3e2e978f487" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35889 } }
I20240503 08:15:18.174744 10629 ts_tablet_manager.cc:1398] T cade2545388a49ef985e82076b512f0b P 92a6ee50d9604234a4bce3e2e978f487: Time spent starting tablet: real 0.011s user 0.008s sys 0.004s
I20240503 08:15:18.179293 10559 catalog_manager.cc:5484] T cade2545388a49ef985e82076b512f0b P 92a6ee50d9604234a4bce3e2e978f487 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92a6ee50d9604234a4bce3e2e978f487 (127.7.84.129). New cstate: current_term: 1 leader_uuid: "92a6ee50d9604234a4bce3e2e978f487" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92a6ee50d9604234a4bce3e2e978f487" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35889 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:18.774142 7506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqhmq97/build/asan/bin/kudu
/tmp/dist-test-taskqhmq97/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.84.130:45721
--local_ip_for_outbound_sockets=127.7.84.130
--tserver_master_addrs=127.7.84.190:41777
--webserver_port=39079
--webserver_interface=127.7.84.130
--builtin_ntp_servers=127.7.84.148:40629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240503 08:15:19.088375 10647 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:15:19.088651 10647 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:15:19.088752 10647 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:15:19.096128 10647 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:15:19.096289 10647 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.84.130
I20240503 08:15:19.104979 10647 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.84.148:40629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.84.130:45721
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.84.130
--webserver_port=39079
--tserver_master_addrs=127.7.84.190:41777
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.84.130
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 07:43:23 UTC on efd1337a2aa3
build id 103
ASAN enabled
I20240503 08:15:19.106159 10647 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:15:19.107758 10647 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:15:19.118649 10652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:19.119124 10655 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:19.119633 10653 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:15:19.120290 10647 server_base.cc:1034] running on GCE node
I20240503 08:15:19.120877 10647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:15:19.121798 10647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:15:19.122992 10647 hybrid_clock.cc:648] HybridClock initialized: now 1714724119122923 us; error 44 us; skew 500 ppm
I20240503 08:15:19.123275 10647 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:15:19.125430 10647 webserver.cc:460] Webserver started at http://127.7.84.130:39079/ using document root <none> and password file <none>
I20240503 08:15:19.126120 10647 fs_manager.cc:359] Metadata directory not provided
I20240503 08:15:19.126251 10647 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:15:19.131243 10647 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20240503 08:15:19.134048 10661 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:19.135337 10647 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20240503 08:15:19.135496 10647 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-1/wal
uuid: "45a212dc6b3240bfb7b92ddcca12d918"
format_stamp: "Formatted at 2024-05-03 08:15:16 on dist-test-slave-2jf9"
I20240503 08:15:19.136286 10647 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:15:19.149897 10647 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:15:19.150669 10647 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:15:19.150921 10647 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:15:19.151870 10647 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:15:19.153450 10647 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:15:19.153538 10647 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:19.153643 10647 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:15:19.153713 10647 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:19.182750 10647 rpc_server.cc:307] RPC server started. Bound to: 127.7.84.130:45721
I20240503 08:15:19.182821 10773 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.84.130:45721 every 8 connection(s)
I20240503 08:15:19.184188 10647 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-1/data/info.pb
I20240503 08:15:19.192551 7506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqhmq97/build/asan/bin/kudu as pid 10647
I20240503 08:15:19.196684 10774 heartbeater.cc:347] Connected to a master server at 127.7.84.190:41777
I20240503 08:15:19.197033 10774 heartbeater.cc:464] Registering TS with master...
I20240503 08:15:19.198081 10774 heartbeater.cc:511] Master 127.7.84.190:41777 requested a full tablet report, sending...
I20240503 08:15:19.199606 10550 ts_manager.cc:194] Registered new tserver with Master: 45a212dc6b3240bfb7b92ddcca12d918 (127.7.84.130:45721)
I20240503 08:15:19.201193 10550 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.84.130:41271
I20240503 08:15:19.204955 10779 ts_tablet_manager.cc:902] T cade2545388a49ef985e82076b512f0b P 45a212dc6b3240bfb7b92ddcca12d918: Initiating tablet copy from peer 92a6ee50d9604234a4bce3e2e978f487 (127.7.84.129:35889)
I20240503 08:15:19.206519 10779 tablet_copy_client.cc:308] T cade2545388a49ef985e82076b512f0b P 45a212dc6b3240bfb7b92ddcca12d918: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:35889
I20240503 08:15:19.211591 10359 tablet_copy_service.cc:140] P 92a6ee50d9604234a4bce3e2e978f487: Received BeginTabletCopySession request for tablet cade2545388a49ef985e82076b512f0b from peer 45a212dc6b3240bfb7b92ddcca12d918 ({username='slave'} at 127.7.84.130:53723)
I20240503 08:15:19.211796 10359 tablet_copy_service.cc:161] P 92a6ee50d9604234a4bce3e2e978f487: Beginning new tablet copy session on tablet cade2545388a49ef985e82076b512f0b from peer 45a212dc6b3240bfb7b92ddcca12d918 at {username='slave'} at 127.7.84.130:53723: session id = 45a212dc6b3240bfb7b92ddcca12d918-cade2545388a49ef985e82076b512f0b
I20240503 08:15:19.214154 10359 tablet_copy_source_session.cc:205] T cade2545388a49ef985e82076b512f0b P 92a6ee50d9604234a4bce3e2e978f487: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:15:19.218024 10779 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cade2545388a49ef985e82076b512f0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:19.227809 10779 tablet_copy_client.cc:783] T cade2545388a49ef985e82076b512f0b P 45a212dc6b3240bfb7b92ddcca12d918: tablet copy: Starting download of 0 data blocks...
I20240503 08:15:19.228036 10779 tablet_copy_client.cc:647] T cade2545388a49ef985e82076b512f0b P 45a212dc6b3240bfb7b92ddcca12d918: tablet copy: Starting download of 1 WAL segments...
I20240503 08:15:19.232296 10779 tablet_copy_client.cc:523] T cade2545388a49ef985e82076b512f0b P 45a212dc6b3240bfb7b92ddcca12d918: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:15:19.235148 10779 tablet_bootstrap.cc:492] T cade2545388a49ef985e82076b512f0b P 45a212dc6b3240bfb7b92ddcca12d918: Bootstrap starting.
I20240503 08:15:19.293432 10779 log.cc:824] T cade2545388a49ef985e82076b512f0b P 45a212dc6b3240bfb7b92ddcca12d918: Log is configured to *not* fsync() on all Append() calls
I20240503 08:15:19.776156 10779 tablet_bootstrap.cc:492] T cade2545388a49ef985e82076b512f0b P 45a212dc6b3240bfb7b92ddcca12d918: Bootstrap replayed 1/1 log segments. Stats: ops{read=208 overwritten=0 applied=208 ignored=0} inserts{seen=10350 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:15:19.776602 10779 tablet_bootstrap.cc:492] T cade2545388a49ef985e82076b512f0b P 45a212dc6b3240bfb7b92ddcca12d918: Bootstrap complete.
I20240503 08:15:19.777091 10779 ts_tablet_manager.cc:1367] T cade2545388a49ef985e82076b512f0b P 45a212dc6b3240bfb7b92ddcca12d918: Time spent bootstrapping tablet: real 0.542s user 0.506s sys 0.036s
I20240503 08:15:19.781435 10779 raft_consensus.cc:348] T cade2545388a49ef985e82076b512f0b P 45a212dc6b3240bfb7b92ddcca12d918 [term 1 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92a6ee50d9604234a4bce3e2e978f487" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35889 } }
I20240503 08:15:19.781780 10779 raft_consensus.cc:729] T cade2545388a49ef985e82076b512f0b P 45a212dc6b3240bfb7b92ddcca12d918 [term 1 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 45a212dc6b3240bfb7b92ddcca12d918, State: Initialized, Role: NON_PARTICIPANT
I20240503 08:15:19.782212 10779 consensus_queue.cc:260] T cade2545388a49ef985e82076b512f0b P 45a212dc6b3240bfb7b92ddcca12d918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 208, Last appended: 1.208, Last appended by leader: 208, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92a6ee50d9604234a4bce3e2e978f487" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35889 } }
I20240503 08:15:19.783174 10774 heartbeater.cc:503] Master 127.7.84.190:41777 was elected leader, sending a full tablet report...
I20240503 08:15:19.783820 10779 ts_tablet_manager.cc:1398] T cade2545388a49ef985e82076b512f0b P 45a212dc6b3240bfb7b92ddcca12d918: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20240503 08:15:19.784909 10359 tablet_copy_service.cc:342] P 92a6ee50d9604234a4bce3e2e978f487: Request end of tablet copy session 45a212dc6b3240bfb7b92ddcca12d918-cade2545388a49ef985e82076b512f0b received from {username='slave'} at 127.7.84.130:53723
I20240503 08:15:19.785059 10359 tablet_copy_service.cc:433] P 92a6ee50d9604234a4bce3e2e978f487: ending tablet copy session 45a212dc6b3240bfb7b92ddcca12d918-cade2545388a49ef985e82076b512f0b on tablet cade2545388a49ef985e82076b512f0b with peer 45a212dc6b3240bfb7b92ddcca12d918
I20240503 08:15:19.785636 10709 tablet_service.cc:1514] Processing DeleteTablet for tablet cade2545388a49ef985e82076b512f0b with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:56820
I20240503 08:15:19.787173 10786 tablet_replica.cc:330] T cade2545388a49ef985e82076b512f0b P 45a212dc6b3240bfb7b92ddcca12d918: stopping tablet replica
I20240503 08:15:19.787629 10786 raft_consensus.cc:2229] T cade2545388a49ef985e82076b512f0b P 45a212dc6b3240bfb7b92ddcca12d918 [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20240503 08:15:19.787926 10786 raft_consensus.cc:2258] T cade2545388a49ef985e82076b512f0b P 45a212dc6b3240bfb7b92ddcca12d918 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20240503 08:15:19.789273 10786 ts_tablet_manager.cc:1875] T cade2545388a49ef985e82076b512f0b P 45a212dc6b3240bfb7b92ddcca12d918: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 08:15:19.793673 10786 ts_tablet_manager.cc:1888] T cade2545388a49ef985e82076b512f0b P 45a212dc6b3240bfb7b92ddcca12d918: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.208
I20240503 08:15:19.793799 10786 log.cc:1196] T cade2545388a49ef985e82076b512f0b P 45a212dc6b3240bfb7b92ddcca12d918: Deleting WAL directory at /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714724103239050-7506-0/minicluster-data/ts-1/wal/wals/cade2545388a49ef985e82076b512f0b
I20240503 08:15:19.795473 10779 ts_tablet_manager.cc:902] T cade2545388a49ef985e82076b512f0b P 45a212dc6b3240bfb7b92ddcca12d918: Initiating tablet copy from peer 92a6ee50d9604234a4bce3e2e978f487 (127.7.84.129:35889)
I20240503 08:15:19.796418 10779 tablet_copy_client.cc:308] T cade2545388a49ef985e82076b512f0b P 45a212dc6b3240bfb7b92ddcca12d918: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:35889
I20240503 08:15:19.796993 10359 tablet_copy_service.cc:140] P 92a6ee50d9604234a4bce3e2e978f487: Received BeginTabletCopySession request for tablet cade2545388a49ef985e82076b512f0b from peer 45a212dc6b3240bfb7b92ddcca12d918 ({username='slave'} at 127.7.84.130:53723)
I20240503 08:15:19.797151 10359 tablet_copy_service.cc:161] P 92a6ee50d9604234a4bce3e2e978f487: Beginning new tablet copy session on tablet cade2545388a49ef985e82076b512f0b from peer 45a212dc6b3240bfb7b92ddcca12d918 at {username='slave'} at 127.7.84.130:53723: session id = 45a212dc6b3240bfb7b92ddcca12d918-cade2545388a49ef985e82076b512f0b
I20240503 08:15:19.799005 10359 tablet_copy_source_session.cc:205] T cade2545388a49ef985e82076b512f0b P 92a6ee50d9604234a4bce3e2e978f487: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:15:19.799751 10779 ts_tablet_manager.cc:1875] T cade2545388a49ef985e82076b512f0b P 45a212dc6b3240bfb7b92ddcca12d918: Deleting tablet data with delete state TABLET_DATA_COPYING
I20240503 08:15:19.803648 10779 ts_tablet_manager.cc:1888] T cade2545388a49ef985e82076b512f0b P 45a212dc6b3240bfb7b92ddcca12d918: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.208
I20240503 08:15:19.803880 10779 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cade2545388a49ef985e82076b512f0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:19.805827 10779 tablet_copy_client.cc:783] T cade2545388a49ef985e82076b512f0b P 45a212dc6b3240bfb7b92ddcca12d918: tablet copy: Starting download of 0 data blocks...
I20240503 08:15:19.806000 10779 tablet_copy_client.cc:647] T cade2545388a49ef985e82076b512f0b P 45a212dc6b3240bfb7b92ddcca12d918: tablet copy: Starting download of 1 WAL segments...
I20240503 08:15:19.809346 10779 tablet_copy_client.cc:523] T cade2545388a49ef985e82076b512f0b P 45a212dc6b3240bfb7b92ddcca12d918: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:15:19.811513 10779 tablet_bootstrap.cc:492] T cade2545388a49ef985e82076b512f0b P 45a212dc6b3240bfb7b92ddcca12d918: Bootstrap starting.
I20240503 08:15:20.334093 10779 tablet_bootstrap.cc:492] T cade2545388a49ef985e82076b512f0b P 45a212dc6b3240bfb7b92ddcca12d918: Bootstrap replayed 1/1 log segments. Stats: ops{read=208 overwritten=0 applied=208 ignored=0} inserts{seen=10350 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:15:20.334447 10779 tablet_bootstrap.cc:492] T cade2545388a49ef985e82076b512f0b P 45a212dc6b3240bfb7b92ddcca12d918: Bootstrap complete.
I20240503 08:15:20.334738 10779 ts_tablet_manager.cc:1367] T cade2545388a49ef985e82076b512f0b P 45a212dc6b3240bfb7b92ddcca12d918: Time spent bootstrapping tablet: real 0.523s user 0.480s sys 0.040s
I20240503 08:15:20.335554 10779 raft_consensus.cc:348] T cade2545388a49ef985e82076b512f0b P 45a212dc6b3240bfb7b92ddcca12d918 [term 1 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92a6ee50d9604234a4bce3e2e978f487" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35889 } }
I20240503 08:15:20.335731 10779 raft_consensus.cc:729] T cade2545388a49ef985e82076b512f0b P 45a212dc6b3240bfb7b92ddcca12d918 [term 1 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 45a212dc6b3240bfb7b92ddcca12d918, State: Initialized, Role: NON_PARTICIPANT
I20240503 08:15:20.335913 10779 consensus_queue.cc:260] T cade2545388a49ef985e82076b512f0b P 45a212dc6b3240bfb7b92ddcca12d918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 208, Last appended: 1.208, Last appended by leader: 208, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92a6ee50d9604234a4bce3e2e978f487" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35889 } }
I20240503 08:15:20.336548 10779 ts_tablet_manager.cc:1398] T cade2545388a49ef985e82076b512f0b P 45a212dc6b3240bfb7b92ddcca12d918: Time spent starting tablet: real 0.002s user 0.005s sys 0.000s
I20240503 08:15:20.337287 10359 tablet_copy_service.cc:342] P 92a6ee50d9604234a4bce3e2e978f487: Request end of tablet copy session 45a212dc6b3240bfb7b92ddcca12d918-cade2545388a49ef985e82076b512f0b received from {username='slave'} at 127.7.84.130:53723
I20240503 08:15:20.337404 10359 tablet_copy_service.cc:433] P 92a6ee50d9604234a4bce3e2e978f487: ending tablet copy session 45a212dc6b3240bfb7b92ddcca12d918-cade2545388a49ef985e82076b512f0b on tablet cade2545388a49ef985e82076b512f0b with peer 45a212dc6b3240bfb7b92ddcca12d918
I20240503 08:15:20.344228 7506 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqhmq97/build/asan/bin/kudu pid 10257
I20240503 08:15:20.345189 10379 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 08:15:20.440181 7506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqhmq97/build/asan/bin/kudu with pid 10257
I20240503 08:15:20.456219 7506 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqhmq97/build/asan/bin/kudu pid 10647
I20240503 08:15:20.457304 10769 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 08:15:20.571074 7506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqhmq97/build/asan/bin/kudu with pid 10647
I20240503 08:15:20.586752 7506 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqhmq97/build/asan/bin/kudu pid 10527
I20240503 08:15:20.587819 10589 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 08:15:20.688225 7506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqhmq97/build/asan/bin/kudu with pid 10527
2024-05-03T08:15:20Z chronyd exiting
[ OK ] TabletCopyClientSessionITest.TestStartTabletCopy (5596 ms)
[ RUN ] TabletCopyClientSessionITest.TestCopyFromCrashedSource
2024-05-03T08:15:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-03T08:15:20Z Disabled control of system clock
I20240503 08:15:20.747746 7506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqhmq97/build/asan/bin/kudu
/tmp/dist-test-taskqhmq97/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.84.190:40393
--webserver_interface=127.7.84.190
--webserver_port=0
--builtin_ntp_servers=127.7.84.148:34969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.84.190:40393
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240503 08:15:21.059587 10799 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:15:21.059867 10799 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:15:21.059994 10799 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:15:21.067165 10799 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240503 08:15:21.067271 10799 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:15:21.067345 10799 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240503 08:15:21.067446 10799 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240503 08:15:21.076263 10799 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.84.148:34969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.7.84.190:40393
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.84.190:40393
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.84.190
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 07:43:23 UTC on efd1337a2aa3
build id 103
ASAN enabled
I20240503 08:15:21.077545 10799 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:15:21.079213 10799 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:15:21.089397 10805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:21.089787 10807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:21.089942 10804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:15:21.090694 10799 server_base.cc:1034] running on GCE node
I20240503 08:15:21.091377 10799 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:15:21.092695 10799 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:15:21.093919 10799 hybrid_clock.cc:648] HybridClock initialized: now 1714724121093850 us; error 45 us; skew 500 ppm
I20240503 08:15:21.094218 10799 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:15:21.096267 10799 webserver.cc:460] Webserver started at http://127.7.84.190:35835/ using document root <none> and password file <none>
I20240503 08:15:21.096908 10799 fs_manager.cc:359] Metadata directory not provided
I20240503 08:15:21.097020 10799 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:15:21.097288 10799 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:15:21.099720 10799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/master-0/data/instance:
uuid: "8535705eb42d46bd8c82234794dff2d8"
format_stamp: "Formatted at 2024-05-03 08:15:21 on dist-test-slave-2jf9"
I20240503 08:15:21.100410 10799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/master-0/wal/instance:
uuid: "8535705eb42d46bd8c82234794dff2d8"
format_stamp: "Formatted at 2024-05-03 08:15:21 on dist-test-slave-2jf9"
I20240503 08:15:21.105080 10799 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20240503 08:15:21.108071 10813 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:21.109252 10799 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240503 08:15:21.109398 10799 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/master-0/data,/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/master-0/wal
uuid: "8535705eb42d46bd8c82234794dff2d8"
format_stamp: "Formatted at 2024-05-03 08:15:21 on dist-test-slave-2jf9"
I20240503 08:15:21.109560 10799 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:15:21.146497 10799 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:15:21.147293 10799 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:15:21.147598 10799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:15:21.163139 10799 rpc_server.cc:307] RPC server started. Bound to: 127.7.84.190:40393
I20240503 08:15:21.163168 10864 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.84.190:40393 every 8 connection(s)
I20240503 08:15:21.164466 10799 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/master-0/data/info.pb
I20240503 08:15:21.167914 10865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:21.174218 7506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqhmq97/build/asan/bin/kudu as pid 10799
I20240503 08:15:21.174414 7506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/master-0/wal/instance
I20240503 08:15:21.176679 10865 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8: Bootstrap starting.
I20240503 08:15:21.179558 10865 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8: Neither blocks nor log segments found. Creating new log.
I20240503 08:15:21.180788 10865 log.cc:824] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8: Log is configured to *not* fsync() on all Append() calls
I20240503 08:15:21.183324 10865 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8: No bootstrap required, opened a new log
I20240503 08:15:21.189755 10865 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8535705eb42d46bd8c82234794dff2d8" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 40393 } }
I20240503 08:15:21.190037 10865 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:15:21.190109 10865 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8535705eb42d46bd8c82234794dff2d8, State: Initialized, Role: FOLLOWER
I20240503 08:15:21.190573 10865 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8535705eb42d46bd8c82234794dff2d8" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 40393 } }
I20240503 08:15:21.190758 10865 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:21.190853 10865 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:21.190963 10865 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:15:21.192909 10865 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8535705eb42d46bd8c82234794dff2d8" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 40393 } }
I20240503 08:15:21.193301 10865 leader_election.cc:302] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8535705eb42d46bd8c82234794dff2d8; no voters:
I20240503 08:15:21.193840 10865 leader_election.cc:288] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:15:21.193964 10870 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:15:21.194813 10870 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8 [term 1 LEADER]: Becoming Leader. State: Replica: 8535705eb42d46bd8c82234794dff2d8, State: Running, Role: LEADER
I20240503 08:15:21.195283 10870 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8535705eb42d46bd8c82234794dff2d8" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 40393 } }
I20240503 08:15:21.195684 10865 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8 [sys.catalog]: configured and running, proceeding with master startup.
I20240503 08:15:21.197651 10871 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8535705eb42d46bd8c82234794dff2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8535705eb42d46bd8c82234794dff2d8" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 40393 } } }
I20240503 08:15:21.197993 10871 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8 [sys.catalog]: This master's current role is: LEADER
I20240503 08:15:21.199378 10876 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240503 08:15:21.199296 10872 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8535705eb42d46bd8c82234794dff2d8. Latest consensus state: current_term: 1 leader_uuid: "8535705eb42d46bd8c82234794dff2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8535705eb42d46bd8c82234794dff2d8" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 40393 } } }
I20240503 08:15:21.199642 10872 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8 [sys.catalog]: This master's current role is: LEADER
I20240503 08:15:21.203307 10876 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240503 08:15:21.210242 10876 catalog_manager.cc:1347] Generated new cluster ID: dad3b2c2c59f4b40a94b54abfb42bb68
I20240503 08:15:21.210403 10876 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240503 08:15:21.221616 10876 catalog_manager.cc:1370] Generated new certificate authority record
I20240503 08:15:21.222669 10876 catalog_manager.cc:1504] Loading token signing keys...
I20240503 08:15:21.234061 10876 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8: Generated new TSK 0
I20240503 08:15:21.234722 10876 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240503 08:15:21.241832 7506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqhmq97/build/asan/bin/kudu
/tmp/dist-test-taskqhmq97/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.84.129:0
--local_ip_for_outbound_sockets=127.7.84.129
--webserver_interface=127.7.84.129
--webserver_port=0
--tserver_master_addrs=127.7.84.190:40393
--builtin_ntp_servers=127.7.84.148:34969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240503 08:15:21.547981 10889 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:15:21.548236 10889 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:15:21.548319 10889 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:15:21.555541 10889 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:15:21.555703 10889 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.84.129
I20240503 08:15:21.564412 10889 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.84.148:34969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.84.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.84.129
--webserver_port=0
--tserver_master_addrs=127.7.84.190:40393
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.84.129
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 07:43:23 UTC on efd1337a2aa3
build id 103
ASAN enabled
I20240503 08:15:21.565685 10889 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:15:21.567301 10889 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:15:21.578279 10894 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:21.578842 10895 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:21.579246 10897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:15:21.579576 10889 server_base.cc:1034] running on GCE node
I20240503 08:15:21.580109 10889 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:15:21.580966 10889 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:15:21.582177 10889 hybrid_clock.cc:648] HybridClock initialized: now 1714724121582107 us; error 42 us; skew 500 ppm
I20240503 08:15:21.582459 10889 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:15:21.584534 10889 webserver.cc:460] Webserver started at http://127.7.84.129:38903/ using document root <none> and password file <none>
I20240503 08:15:21.585208 10889 fs_manager.cc:359] Metadata directory not provided
I20240503 08:15:21.585330 10889 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:15:21.585623 10889 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:15:21.588157 10889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-0/data/instance:
uuid: "7bfa58ff2c284ed285921d7107164c06"
format_stamp: "Formatted at 2024-05-03 08:15:21 on dist-test-slave-2jf9"
I20240503 08:15:21.588860 10889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-0/wal/instance:
uuid: "7bfa58ff2c284ed285921d7107164c06"
format_stamp: "Formatted at 2024-05-03 08:15:21 on dist-test-slave-2jf9"
I20240503 08:15:21.593720 10889 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20240503 08:15:21.596974 10903 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:21.598203 10889 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240503 08:15:21.598351 10889 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-0/wal
uuid: "7bfa58ff2c284ed285921d7107164c06"
format_stamp: "Formatted at 2024-05-03 08:15:21 on dist-test-slave-2jf9"
I20240503 08:15:21.598526 10889 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:15:21.612323 10889 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:15:21.613081 10889 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:15:21.613343 10889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:15:21.614230 10889 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:15:21.615675 10889 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:15:21.615749 10889 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:21.615864 10889 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:15:21.615912 10889 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:21.643446 10889 rpc_server.cc:307] RPC server started. Bound to: 127.7.84.129:36187
I20240503 08:15:21.643481 11015 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.84.129:36187 every 8 connection(s)
I20240503 08:15:21.644721 10889 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-0/data/info.pb
I20240503 08:15:21.648790 7506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqhmq97/build/asan/bin/kudu as pid 10889
I20240503 08:15:21.648983 7506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-0/wal/instance
I20240503 08:15:21.652531 7506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqhmq97/build/asan/bin/kudu
/tmp/dist-test-taskqhmq97/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.84.130:0
--local_ip_for_outbound_sockets=127.7.84.130
--webserver_interface=127.7.84.130
--webserver_port=0
--tserver_master_addrs=127.7.84.190:40393
--builtin_ntp_servers=127.7.84.148:34969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240503 08:15:21.657512 11016 heartbeater.cc:347] Connected to a master server at 127.7.84.190:40393
I20240503 08:15:21.657807 11016 heartbeater.cc:464] Registering TS with master...
I20240503 08:15:21.658536 11016 heartbeater.cc:511] Master 127.7.84.190:40393 requested a full tablet report, sending...
I20240503 08:15:21.660436 10830 ts_manager.cc:194] Registered new tserver with Master: 7bfa58ff2c284ed285921d7107164c06 (127.7.84.129:36187)
I20240503 08:15:21.661876 10830 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.84.129:37411
W20240503 08:15:21.959936 11019 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:15:21.960234 11019 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:15:21.960356 11019 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:15:21.968860 11019 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:15:21.969064 11019 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.84.130
I20240503 08:15:21.977999 11019 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.84.148:34969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.84.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.84.130
--webserver_port=0
--tserver_master_addrs=127.7.84.190:40393
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.84.130
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 07:43:23 UTC on efd1337a2aa3
build id 103
ASAN enabled
I20240503 08:15:21.979331 11019 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:15:21.981112 11019 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:15:21.992520 11024 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:21.992980 11027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:21.993454 11025 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:15:21.994004 11019 server_base.cc:1034] running on GCE node
I20240503 08:15:21.994550 11019 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:15:21.995424 11019 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:15:21.996624 11019 hybrid_clock.cc:648] HybridClock initialized: now 1714724121996552 us; error 53 us; skew 500 ppm
I20240503 08:15:21.996912 11019 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:15:21.998955 11019 webserver.cc:460] Webserver started at http://127.7.84.130:38265/ using document root <none> and password file <none>
I20240503 08:15:21.999635 11019 fs_manager.cc:359] Metadata directory not provided
I20240503 08:15:21.999758 11019 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:15:22.000036 11019 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:15:22.002506 11019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-1/data/instance:
uuid: "c63b10c2e2ad45c9b382fd995b31391d"
format_stamp: "Formatted at 2024-05-03 08:15:21 on dist-test-slave-2jf9"
I20240503 08:15:22.003248 11019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-1/wal/instance:
uuid: "c63b10c2e2ad45c9b382fd995b31391d"
format_stamp: "Formatted at 2024-05-03 08:15:21 on dist-test-slave-2jf9"
I20240503 08:15:22.008028 11019 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20240503 08:15:22.011037 11033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:22.012202 11019 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20240503 08:15:22.012337 11019 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-1/wal
uuid: "c63b10c2e2ad45c9b382fd995b31391d"
format_stamp: "Formatted at 2024-05-03 08:15:21 on dist-test-slave-2jf9"
I20240503 08:15:22.012486 11019 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:15:22.037504 11019 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:15:22.038259 11019 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:15:22.038512 11019 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:15:22.039438 11019 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:15:22.040804 11019 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:15:22.040870 11019 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:22.040979 11019 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:15:22.041025 11019 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:22.067917 11019 rpc_server.cc:307] RPC server started. Bound to: 127.7.84.130:39505
I20240503 08:15:22.067956 11145 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.84.130:39505 every 8 connection(s)
I20240503 08:15:22.069123 11019 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-1/data/info.pb
I20240503 08:15:22.069504 7506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqhmq97/build/asan/bin/kudu as pid 11019
I20240503 08:15:22.069702 7506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-1/wal/instance
I20240503 08:15:22.081095 11146 heartbeater.cc:347] Connected to a master server at 127.7.84.190:40393
I20240503 08:15:22.081379 11146 heartbeater.cc:464] Registering TS with master...
I20240503 08:15:22.082152 11146 heartbeater.cc:511] Master 127.7.84.190:40393 requested a full tablet report, sending...
I20240503 08:15:22.083416 10830 ts_manager.cc:194] Registered new tserver with Master: c63b10c2e2ad45c9b382fd995b31391d (127.7.84.130:39505)
I20240503 08:15:22.084339 10830 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.84.130:45143
I20240503 08:15:22.085191 7506 external_mini_cluster.cc:930] 2 TS(s) registered with all masters
I20240503 08:15:22.097151 7506 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqhmq97/build/asan/bin/kudu pid 11019
I20240503 08:15:22.104661 11141 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 08:15:22.182755 7506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqhmq97/build/asan/bin/kudu with pid 11019
I20240503 08:15:22.194914 7506 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqhmq97/build/asan/bin/kudu pid 10799
I20240503 08:15:22.195977 10860 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 08:15:22.290787 7506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqhmq97/build/asan/bin/kudu with pid 10799
I20240503 08:15:22.306562 7506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqhmq97/build/asan/bin/kudu
/tmp/dist-test-taskqhmq97/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.84.190:40393
--webserver_interface=127.7.84.190
--webserver_port=35835
--builtin_ntp_servers=127.7.84.148:34969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.84.190:40393
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240503 08:15:22.612152 11158 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:15:22.612417 11158 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:15:22.612509 11158 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:15:22.619604 11158 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240503 08:15:22.619701 11158 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:15:22.619751 11158 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240503 08:15:22.619804 11158 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240503 08:15:22.628429 11158 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.84.148:34969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.7.84.190:40393
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.84.190:40393
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.84.190
--webserver_port=35835
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 07:43:23 UTC on efd1337a2aa3
build id 103
ASAN enabled
I20240503 08:15:22.629639 11158 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:15:22.631284 11158 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:15:22.641120 11163 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:22.641500 11164 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:22.642146 11166 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:15:22.642349 11158 server_base.cc:1034] running on GCE node
I20240503 08:15:22.643100 11158 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:15:22.644439 11158 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:15:22.645654 11158 hybrid_clock.cc:648] HybridClock initialized: now 1714724122645579 us; error 55 us; skew 500 ppm
I20240503 08:15:22.645961 11158 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:15:22.648798 11158 webserver.cc:460] Webserver started at http://127.7.84.190:35835/ using document root <none> and password file <none>
I20240503 08:15:22.649442 11158 fs_manager.cc:359] Metadata directory not provided
I20240503 08:15:22.649588 11158 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:15:22.654348 11158 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.002s
I20240503 08:15:22.656996 11172 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:22.658161 11158 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240503 08:15:22.658303 11158 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/master-0/data,/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/master-0/wal
uuid: "8535705eb42d46bd8c82234794dff2d8"
format_stamp: "Formatted at 2024-05-03 08:15:21 on dist-test-slave-2jf9"
I20240503 08:15:22.659066 11158 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:15:22.664438 11016 heartbeater.cc:503] Master 127.7.84.190:40393 was elected leader, sending a full tablet report...
W20240503 08:15:22.665905 11016 heartbeater.cc:644] Failed to heartbeat to 127.7.84.190:40393 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.7.84.190:40393: connect: Connection refused (error 111)
I20240503 08:15:22.691200 11158 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:15:22.692021 11158 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:15:22.692265 11158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:15:22.707800 11158 rpc_server.cc:307] RPC server started. Bound to: 127.7.84.190:40393
I20240503 08:15:22.707839 11224 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.84.190:40393 every 8 connection(s)
I20240503 08:15:22.709139 11158 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/master-0/data/info.pb
I20240503 08:15:22.711833 7506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqhmq97/build/asan/bin/kudu as pid 11158
I20240503 08:15:22.716217 11225 sys_catalog.cc:263] Verifying existing consensus state
I20240503 08:15:22.719013 11225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8: Bootstrap starting.
I20240503 08:15:22.733404 11225 log.cc:824] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8: Log is configured to *not* fsync() on all Append() calls
I20240503 08:15:22.740906 11225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:15:22.741338 11225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8: Bootstrap complete.
I20240503 08:15:22.747731 11225 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8535705eb42d46bd8c82234794dff2d8" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 40393 } }
I20240503 08:15:22.748631 11225 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8535705eb42d46bd8c82234794dff2d8, State: Initialized, Role: FOLLOWER
I20240503 08:15:22.749222 11225 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8535705eb42d46bd8c82234794dff2d8" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 40393 } }
I20240503 08:15:22.749419 11225 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:22.749519 11225 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:22.749666 11225 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:15:22.752931 11225 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8535705eb42d46bd8c82234794dff2d8" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 40393 } }
I20240503 08:15:22.753341 11225 leader_election.cc:302] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8535705eb42d46bd8c82234794dff2d8; no voters:
I20240503 08:15:22.753824 11225 leader_election.cc:288] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:15:22.753953 11230 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:15:22.754513 11230 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8 [term 2 LEADER]: Becoming Leader. State: Replica: 8535705eb42d46bd8c82234794dff2d8, State: Running, Role: LEADER
I20240503 08:15:22.755096 11230 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8535705eb42d46bd8c82234794dff2d8" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 40393 } }
I20240503 08:15:22.755718 11225 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8 [sys.catalog]: configured and running, proceeding with master startup.
I20240503 08:15:22.757480 11231 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "8535705eb42d46bd8c82234794dff2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8535705eb42d46bd8c82234794dff2d8" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 40393 } } }
I20240503 08:15:22.757614 11232 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8535705eb42d46bd8c82234794dff2d8. Latest consensus state: current_term: 2 leader_uuid: "8535705eb42d46bd8c82234794dff2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8535705eb42d46bd8c82234794dff2d8" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 40393 } } }
I20240503 08:15:22.757946 11232 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8 [sys.catalog]: This master's current role is: LEADER
I20240503 08:15:22.758152 11231 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8 [sys.catalog]: This master's current role is: LEADER
I20240503 08:15:22.767872 11239 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240503 08:15:22.772153 11239 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240503 08:15:22.773336 11239 catalog_manager.cc:1259] Loaded cluster ID: dad3b2c2c59f4b40a94b54abfb42bb68
I20240503 08:15:22.773422 11239 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240503 08:15:22.776178 11239 catalog_manager.cc:1504] Loading token signing keys...
I20240503 08:15:22.777202 11239 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8535705eb42d46bd8c82234794dff2d8: Loaded TSK: 0
I20240503 08:15:22.778348 11239 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240503 08:15:23.672165 11016 heartbeater.cc:347] Connected to a master server at 127.7.84.190:40393
I20240503 08:15:23.672353 11016 heartbeater.cc:503] Master 127.7.84.190:40393 was elected leader, sending a full tablet report...
I20240503 08:15:23.674017 11190 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "7bfa58ff2c284ed285921d7107164c06" instance_seqno: 1714724121636693) as {username='slave'} at 127.7.84.129:42567; Asking this server to re-register.
I20240503 08:15:23.674641 11016 heartbeater.cc:464] Registering TS with master...
I20240503 08:15:23.674841 11016 heartbeater.cc:511] Master 127.7.84.190:40393 requested a full tablet report, sending...
I20240503 08:15:23.675935 11190 ts_manager.cc:194] Registered new tserver with Master: 7bfa58ff2c284ed285921d7107164c06 (127.7.84.129:36187)
I20240503 08:15:23.679620 7506 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20240503 08:15:23.679759 7506 test_util.cc:268] Using random seed: 1380424705
I20240503 08:15:23.702625 11190 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43046:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20240503 08:15:23.726948 10951 tablet_service.cc:1467] Processing CreateTablet for tablet 0db53c14c7404848825062a63199943d (DEFAULT_TABLE table=test-workload [id=7430734973f745ceac82d132fb18069f]), partition=RANGE (key) PARTITION UNBOUNDED
I20240503 08:15:23.728267 10951 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0db53c14c7404848825062a63199943d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:23.737591 11260 tablet_bootstrap.cc:492] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06: Bootstrap starting.
I20240503 08:15:23.740286 11260 tablet_bootstrap.cc:654] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06: Neither blocks nor log segments found. Creating new log.
I20240503 08:15:23.741196 11260 log.cc:824] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06: Log is configured to *not* fsync() on all Append() calls
I20240503 08:15:23.743218 11260 tablet_bootstrap.cc:492] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06: No bootstrap required, opened a new log
I20240503 08:15:23.743458 11260 ts_tablet_manager.cc:1367] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20240503 08:15:23.749083 11260 raft_consensus.cc:348] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bfa58ff2c284ed285921d7107164c06" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 36187 } }
I20240503 08:15:23.749372 11260 raft_consensus.cc:374] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:15:23.749464 11260 raft_consensus.cc:729] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bfa58ff2c284ed285921d7107164c06, State: Initialized, Role: FOLLOWER
I20240503 08:15:23.749986 11260 consensus_queue.cc:260] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bfa58ff2c284ed285921d7107164c06" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 36187 } }
I20240503 08:15:23.750160 11260 raft_consensus.cc:388] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:23.750268 11260 raft_consensus.cc:482] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:23.750401 11260 raft_consensus.cc:3037] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:15:23.752177 11260 raft_consensus.cc:504] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bfa58ff2c284ed285921d7107164c06" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 36187 } }
I20240503 08:15:23.752616 11260 leader_election.cc:302] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7bfa58ff2c284ed285921d7107164c06; no voters:
I20240503 08:15:23.753202 11260 leader_election.cc:288] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:15:23.753334 11262 raft_consensus.cc:2781] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:15:23.753988 11262 raft_consensus.cc:686] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06 [term 1 LEADER]: Becoming Leader. State: Replica: 7bfa58ff2c284ed285921d7107164c06, State: Running, Role: LEADER
I20240503 08:15:23.754536 11262 consensus_queue.cc:237] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bfa58ff2c284ed285921d7107164c06" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 36187 } }
I20240503 08:15:23.754841 11260 ts_tablet_manager.cc:1398] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20240503 08:15:23.759089 11190 catalog_manager.cc:5484] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7bfa58ff2c284ed285921d7107164c06 (127.7.84.129). New cstate: current_term: 1 leader_uuid: "7bfa58ff2c284ed285921d7107164c06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bfa58ff2c284ed285921d7107164c06" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 36187 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:24.321816 7506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqhmq97/build/asan/bin/kudu
/tmp/dist-test-taskqhmq97/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.84.130:39505
--local_ip_for_outbound_sockets=127.7.84.130
--tserver_master_addrs=127.7.84.190:40393
--webserver_port=38265
--webserver_interface=127.7.84.130
--builtin_ntp_servers=127.7.84.148:34969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240503 08:15:24.632958 11278 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:15:24.633219 11278 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:15:24.633311 11278 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:15:24.640360 11278 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:15:24.640522 11278 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.84.130
I20240503 08:15:24.649256 11278 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.84.148:34969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.84.130:39505
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.84.130
--webserver_port=38265
--tserver_master_addrs=127.7.84.190:40393
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.84.130
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 07:43:23 UTC on efd1337a2aa3
build id 103
ASAN enabled
I20240503 08:15:24.650480 11278 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:15:24.652256 11278 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:15:24.663276 11283 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:24.663812 11286 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:24.664294 11284 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:15:24.664736 11278 server_base.cc:1034] running on GCE node
I20240503 08:15:24.665256 11278 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:15:24.666043 11278 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:15:24.667251 11278 hybrid_clock.cc:648] HybridClock initialized: now 1714724124667190 us; error 36 us; skew 500 ppm
I20240503 08:15:24.667567 11278 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:15:24.669548 11278 webserver.cc:460] Webserver started at http://127.7.84.130:38265/ using document root <none> and password file <none>
I20240503 08:15:24.670179 11278 fs_manager.cc:359] Metadata directory not provided
I20240503 08:15:24.670305 11278 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:15:24.674955 11278 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20240503 08:15:24.677412 11292 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:24.678544 11278 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20240503 08:15:24.678685 11278 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-1/wal
uuid: "c63b10c2e2ad45c9b382fd995b31391d"
format_stamp: "Formatted at 2024-05-03 08:15:21 on dist-test-slave-2jf9"
I20240503 08:15:24.679445 11278 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:15:24.691829 11278 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:15:24.692482 11278 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:15:24.692723 11278 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:15:24.693512 11278 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:15:24.694828 11278 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:15:24.694909 11278 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:24.695003 11278 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:15:24.695072 11278 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:24.721686 11278 rpc_server.cc:307] RPC server started. Bound to: 127.7.84.130:39505
I20240503 08:15:24.721719 11404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.84.130:39505 every 8 connection(s)
I20240503 08:15:24.723385 11278 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-1/data/info.pb
I20240503 08:15:24.727762 7506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqhmq97/build/asan/bin/kudu as pid 11278
W20240503 08:15:24.731757 11011 generic_service.cc:139] {username='slave'} at 127.0.0.1:43326 forcing change of non-runtime-safe flag fault_crash_on_handle_tc_fetch_data
I20240503 08:15:24.731984 11011 generic_service.cc:175] {username='slave'} at 127.0.0.1:43326 changed flags via RPC: fault_crash_on_handle_tc_fetch_data from '0' to '1.0'
I20240503 08:15:24.737756 11405 heartbeater.cc:347] Connected to a master server at 127.7.84.190:40393
I20240503 08:15:24.738052 11405 heartbeater.cc:464] Registering TS with master...
I20240503 08:15:24.739082 11405 heartbeater.cc:511] Master 127.7.84.190:40393 requested a full tablet report, sending...
I20240503 08:15:24.740607 11186 ts_manager.cc:194] Registered new tserver with Master: c63b10c2e2ad45c9b382fd995b31391d (127.7.84.130:39505)
I20240503 08:15:24.741858 11410 ts_tablet_manager.cc:902] T 0db53c14c7404848825062a63199943d P c63b10c2e2ad45c9b382fd995b31391d: Initiating tablet copy from peer 7bfa58ff2c284ed285921d7107164c06 (127.7.84.129:36187)
I20240503 08:15:24.741976 11186 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.84.130:41863
I20240503 08:15:24.743703 11410 tablet_copy_client.cc:308] T 0db53c14c7404848825062a63199943d P c63b10c2e2ad45c9b382fd995b31391d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:36187
I20240503 08:15:24.748948 10991 tablet_copy_service.cc:140] P 7bfa58ff2c284ed285921d7107164c06: Received BeginTabletCopySession request for tablet 0db53c14c7404848825062a63199943d from peer c63b10c2e2ad45c9b382fd995b31391d ({username='slave'} at 127.7.84.130:37357)
I20240503 08:15:24.749140 10991 tablet_copy_service.cc:161] P 7bfa58ff2c284ed285921d7107164c06: Beginning new tablet copy session on tablet 0db53c14c7404848825062a63199943d from peer c63b10c2e2ad45c9b382fd995b31391d at {username='slave'} at 127.7.84.130:37357: session id = c63b10c2e2ad45c9b382fd995b31391d-0db53c14c7404848825062a63199943d
I20240503 08:15:24.751610 10991 tablet_copy_source_session.cc:205] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:15:24.755216 11410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0db53c14c7404848825062a63199943d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:24.765074 11410 tablet_copy_client.cc:783] T 0db53c14c7404848825062a63199943d P c63b10c2e2ad45c9b382fd995b31391d: tablet copy: Starting download of 0 data blocks...
I20240503 08:15:24.765393 11410 tablet_copy_client.cc:647] T 0db53c14c7404848825062a63199943d P c63b10c2e2ad45c9b382fd995b31391d: tablet copy: Starting download of 1 WAL segments...
W20240503 08:15:24.766697 10991 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20240503 08:15:24.766785 10991 fault_injection.cc:44] THIS SERVER MAY CRASH!
E20240503 08:15:24.766844 10991 fault_injection.cc:59] injecting fault for kudu (pid 10889): FLAGS_fault_crash_on_handle_tc_fetch_data (process will exit)
W20240503 08:15:24.783211 11410 ts_tablet_manager.cc:980] T 0db53c14c7404848825062a63199943d P c63b10c2e2ad45c9b382fd995b31391d: Tablet Copy: Unable to fetch data from remote peer 7bfa58ff2c284ed285921d7107164c06 (127.7.84.129:36187): Network error: Unable to download WAL segment with seq. number 1: unable to fetch data from remote: recv got EOF from 127.7.84.129:36187 (error 108)
I20240503 08:15:24.783409 11410 tablet_replica.cc:330] T 0db53c14c7404848825062a63199943d P c63b10c2e2ad45c9b382fd995b31391d: stopping tablet replica
I20240503 08:15:24.783676 11410 raft_consensus.cc:2229] T 0db53c14c7404848825062a63199943d P c63b10c2e2ad45c9b382fd995b31391d [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20240503 08:15:24.783885 11410 raft_consensus.cc:2258] T 0db53c14c7404848825062a63199943d P c63b10c2e2ad45c9b382fd995b31391d [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
W20240503 08:15:24.784942 11410 tablet_copy_client.cc:1108] T 0db53c14c7404848825062a63199943d P c63b10c2e2ad45c9b382fd995b31391d: tablet copy: Unable to close tablet copy session: Network error: failure ending tablet copy session: Client connection negotiation failed: client connection to 127.7.84.129:36187: connect: Connection refused (error 111)
W20240503 08:15:24.785614 11410 tablet_metadata.cc:476] failed to load DataDirGroup from superblock: Already present: tried to load directory group for tablet 0db53c14c7404848825062a63199943d but one is already registered
I20240503 08:15:24.785825 11410 ts_tablet_manager.cc:1875] T 0db53c14c7404848825062a63199943d P c63b10c2e2ad45c9b382fd995b31391d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 08:15:24.790217 11410 ts_tablet_manager.cc:1888] T 0db53c14c7404848825062a63199943d P c63b10c2e2ad45c9b382fd995b31391d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.0
I20240503 08:15:24.790354 11410 log.cc:1196] T 0db53c14c7404848825062a63199943d P c63b10c2e2ad45c9b382fd995b31391d: Deleting WAL directory at /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-1/wal/wals/0db53c14c7404848825062a63199943d
I20240503 08:15:24.791663 7506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqhmq97/build/asan/bin/kudu
/tmp/dist-test-taskqhmq97/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.84.129:36187
--local_ip_for_outbound_sockets=127.7.84.129
--tserver_master_addrs=127.7.84.190:40393
--webserver_port=38903
--webserver_interface=127.7.84.129
--builtin_ntp_servers=127.7.84.148:34969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240503 08:15:25.101897 11415 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:15:25.102187 11415 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:15:25.102322 11415 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:15:25.109683 11415 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:15:25.109896 11415 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.84.129
I20240503 08:15:25.118912 11415 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.84.148:34969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.84.129:36187
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.84.129
--webserver_port=38903
--tserver_master_addrs=127.7.84.190:40393
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.84.129
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 07:43:23 UTC on efd1337a2aa3
build id 103
ASAN enabled
I20240503 08:15:25.120254 11415 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:15:25.121978 11415 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:15:25.133618 11420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:25.134074 11421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:25.134541 11423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:15:25.135064 11415 server_base.cc:1034] running on GCE node
I20240503 08:15:25.135648 11415 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:15:25.136531 11415 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:15:25.137744 11415 hybrid_clock.cc:648] HybridClock initialized: now 1714724125137684 us; error 36 us; skew 500 ppm
I20240503 08:15:25.138011 11415 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:15:25.140064 11415 webserver.cc:460] Webserver started at http://127.7.84.129:38903/ using document root <none> and password file <none>
I20240503 08:15:25.140709 11415 fs_manager.cc:359] Metadata directory not provided
I20240503 08:15:25.140846 11415 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:15:25.145639 11415 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20240503 08:15:25.148288 11429 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:25.149513 11415 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20240503 08:15:25.149762 11415 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-0/wal
uuid: "7bfa58ff2c284ed285921d7107164c06"
format_stamp: "Formatted at 2024-05-03 08:15:21 on dist-test-slave-2jf9"
I20240503 08:15:25.150604 11415 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:15:25.171031 11415 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:15:25.171895 11415 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:15:25.172156 11415 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:15:25.173060 11415 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:15:25.174858 11436 ts_tablet_manager.cc:522] Loading tablet metadata (0/1 complete)
I20240503 08:15:25.179680 11415 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240503 08:15:25.179787 11415 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20240503 08:15:25.179893 11415 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240503 08:15:25.182569 11415 ts_tablet_manager.cc:590] Registered 1 tablets
I20240503 08:15:25.182659 11415 ts_tablet_manager.cc:569] Time spent register tablets: real 0.003s user 0.000s sys 0.000s
I20240503 08:15:25.182945 11436 tablet_bootstrap.cc:492] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06: Bootstrap starting.
I20240503 08:15:25.217471 11415 rpc_server.cc:307] RPC server started. Bound to: 127.7.84.129:36187
I20240503 08:15:25.217516 11542 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.84.129:36187 every 8 connection(s)
I20240503 08:15:25.218957 11415 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714724103239050-7506-0/minicluster-data/ts-0/data/info.pb
I20240503 08:15:25.228969 7506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqhmq97/build/asan/bin/kudu as pid 11415
I20240503 08:15:25.233430 11543 heartbeater.cc:347] Connected to a master server at 127.7.84.190:40393
I20240503 08:15:25.233765 11543 heartbeater.cc:464] Registering TS with master...
I20240503 08:15:25.234851 11543 heartbeater.cc:511] Master 127.7.84.190:40393 requested a full tablet report, sending...
I20240503 08:15:25.238148 11186 ts_manager.cc:194] Re-registered known tserver with Master: 7bfa58ff2c284ed285921d7107164c06 (127.7.84.129:36187)
I20240503 08:15:25.239639 11186 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.84.129:35509
I20240503 08:15:25.268271 11436 log.cc:824] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06: Log is configured to *not* fsync() on all Append() calls
I20240503 08:15:25.744901 11405 heartbeater.cc:503] Master 127.7.84.190:40393 was elected leader, sending a full tablet report...
W20240503 08:15:25.746495 11186 catalog_manager.cc:5397] Tablet 0db53c14c7404848825062a63199943d (table test-workload [id=7430734973f745ceac82d132fb18069f]) has failed on TS c63b10c2e2ad45c9b382fd995b31391d (127.7.84.130:39505): Network error: Unable to download WAL segment with seq. number 1: unable to fetch data from remote: recv got EOF from 127.7.84.129:36187 (error 108)
I20240503 08:15:25.755865 11436 tablet_bootstrap.cc:492] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06: Bootstrap replayed 1/1 log segments. Stats: ops{read=209 overwritten=0 applied=209 ignored=0} inserts{seen=10400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:15:25.756357 11436 tablet_bootstrap.cc:492] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06: Bootstrap complete.
I20240503 08:15:25.757406 11436 ts_tablet_manager.cc:1367] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06: Time spent bootstrapping tablet: real 0.575s user 0.513s sys 0.059s
I20240503 08:15:25.762104 11436 raft_consensus.cc:348] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bfa58ff2c284ed285921d7107164c06" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 36187 } }
I20240503 08:15:25.762833 11436 raft_consensus.cc:729] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bfa58ff2c284ed285921d7107164c06, State: Initialized, Role: FOLLOWER
I20240503 08:15:25.763463 11436 consensus_queue.cc:260] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 209, Last appended: 1.209, Last appended by leader: 209, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bfa58ff2c284ed285921d7107164c06" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 36187 } }
I20240503 08:15:25.763667 11436 raft_consensus.cc:388] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:25.763765 11436 raft_consensus.cc:482] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:25.763916 11436 raft_consensus.cc:3037] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:15:25.767287 11436 raft_consensus.cc:504] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bfa58ff2c284ed285921d7107164c06" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 36187 } }
I20240503 08:15:25.767750 11436 leader_election.cc:302] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7bfa58ff2c284ed285921d7107164c06; no voters:
I20240503 08:15:25.768239 11436 leader_election.cc:288] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:15:25.768373 11548 raft_consensus.cc:2781] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:15:25.769232 11543 heartbeater.cc:503] Master 127.7.84.190:40393 was elected leader, sending a full tablet report...
I20240503 08:15:25.769481 11548 raft_consensus.cc:686] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06 [term 2 LEADER]: Becoming Leader. State: Replica: 7bfa58ff2c284ed285921d7107164c06, State: Running, Role: LEADER
I20240503 08:15:25.769644 11436 ts_tablet_manager.cc:1398] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06: Time spent starting tablet: real 0.012s user 0.009s sys 0.004s
I20240503 08:15:25.769937 11548 consensus_queue.cc:237] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 209, Committed index: 209, Last appended: 1.209, Last appended by leader: 209, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bfa58ff2c284ed285921d7107164c06" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 36187 } }
I20240503 08:15:25.773229 11553 ts_tablet_manager.cc:902] T 0db53c14c7404848825062a63199943d P c63b10c2e2ad45c9b382fd995b31391d: Initiating tablet copy from peer 7bfa58ff2c284ed285921d7107164c06 (127.7.84.129:36187)
I20240503 08:15:25.773483 11186 catalog_manager.cc:5484] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "7bfa58ff2c284ed285921d7107164c06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bfa58ff2c284ed285921d7107164c06" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 36187 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:25.774515 11553 tablet_copy_client.cc:308] T 0db53c14c7404848825062a63199943d P c63b10c2e2ad45c9b382fd995b31391d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:36187
I20240503 08:15:25.780967 11518 tablet_copy_service.cc:140] P 7bfa58ff2c284ed285921d7107164c06: Received BeginTabletCopySession request for tablet 0db53c14c7404848825062a63199943d from peer c63b10c2e2ad45c9b382fd995b31391d ({username='slave'} at 127.7.84.130:46189)
I20240503 08:15:25.781181 11518 tablet_copy_service.cc:161] P 7bfa58ff2c284ed285921d7107164c06: Beginning new tablet copy session on tablet 0db53c14c7404848825062a63199943d from peer c63b10c2e2ad45c9b382fd995b31391d at {username='slave'} at 127.7.84.130:46189: session id = c63b10c2e2ad45c9b382fd995b31391d-0db53c14c7404848825062a63199943d
I20240503 08:15:25.783530 11518 tablet_copy_source_session.cc:205] T 0db53c14c7404848825062a63199943d P 7bfa58ff2c284ed285921d7107164c06: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:15:25.784842 11553 ts_tablet_manager.cc:1875] T 0db53c14c7404848825062a63199943d P c63b10c2e2ad45c9b382fd995b31391d: Deleting tablet data with delete state TABLET_DATA_COPYING
I20240503 08:15:25.789106 11553 ts_tablet_manager.cc:1888] T 0db53c14c7404848825062a63199943d P c63b10c2e2ad45c9b382fd995b31391d: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.0
I20240503 08:15:25.789345 11553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0db53c14c7404848825062a63199943d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:25.791438 11553 tablet_copy_client.cc:783] T 0db53c14c7404848825062a63199943d P c63b10c2e2ad45c9b382fd995b31391d: tablet copy: Starting download of 0 data blocks...
I20240503 08:15:25.791656 11553 tablet_copy_client.cc:647] T 0db53c14c7404848825062a63199943d P c63b10c2e2ad45c9b382fd995b31391d: tablet copy: Starting download of 1 WAL segments...
I20240503 08:15:25.795284 11553 tablet_copy_client.cc:523] T 0db53c14c7404848825062a63199943d P c63b10c2e2ad45c9b382fd995b31391d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:15:25.797705 11553 tablet_bootstrap.cc:492] T 0db53c14c7404848825062a63199943d P c63b10c2e2ad45c9b382fd995b31391d: Bootstrap starting.
I20240503 08:15:25.855528 11553 log.cc:824] T 0db53c14c7404848825062a63199943d P c63b10c2e2ad45c9b382fd995b31391d: Log is configured to *not* fsync() on all Append() calls
I20240503 08:15:26.327840 11553 tablet_bootstrap.cc:492] T 0db53c14c7404848825062a63199943d P c63b10c2e2ad45c9b382fd995b31391d: Bootstrap replayed 1/1 log segments. Stats: ops{read=210 overwritten=0 applied=210 ignored=0} inserts{seen=10400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:15:26.328256 11553 tablet_bootstrap.cc:492] T 0db53c14c7404848825062a63199943d P c63b10c2e2ad45c9b382fd995b31391d: Bootstrap complete.
I20240503 08:15:26.328711 11553 ts_tablet_manager.cc:1367] T 0db53c14c7404848825062a63199943d P c63b10c2e2ad45c9b382fd995b31391d: Time spent bootstrapping tablet: real 0.531s user 0.504s sys 0.028s
I20240503 08:15:26.332973 11553 raft_consensus.cc:348] T 0db53c14c7404848825062a63199943d P c63b10c2e2ad45c9b382fd995b31391d [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bfa58ff2c284ed285921d7107164c06" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 36187 } }
I20240503 08:15:26.333252 11553 raft_consensus.cc:729] T 0db53c14c7404848825062a63199943d P c63b10c2e2ad45c9b382fd995b31391d [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: c63b10c2e2ad45c9b382fd995b31391d, State: Initialized, Role: NON_PARTICIPANT
I20240503 08:15:26.333746 11553 consensus_queue.cc:260] T 0db53c14c7404848825062a63199943d P c63b10c2e2ad45c9b382fd995b31391d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 210, Last appended: 2.210, Last appended by leader: 210, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bfa58ff2c284ed285921d7107164c06" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 36187 } }
I20240503 08:15:26.334956 11553 ts_tablet_manager.cc:1398] T 0db53c14c7404848825062a63199943d P c63b10c2e2ad45c9b382fd995b31391d: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20240503 08:15:26.335790 11518 tablet_copy_service.cc:342] P 7bfa58ff2c284ed285921d7107164c06: Request end of tablet copy session c63b10c2e2ad45c9b382fd995b31391d-0db53c14c7404848825062a63199943d received from {username='slave'} at 127.7.84.130:46189
I20240503 08:15:26.335927 11518 tablet_copy_service.cc:433] P 7bfa58ff2c284ed285921d7107164c06: ending tablet copy session c63b10c2e2ad45c9b382fd995b31391d-0db53c14c7404848825062a63199943d on tablet 0db53c14c7404848825062a63199943d with peer c63b10c2e2ad45c9b382fd995b31391d
I20240503 08:15:26.338081 7506 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqhmq97/build/asan/bin/kudu pid 11415
I20240503 08:15:26.339103 11538 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 08:15:26.436365 7506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqhmq97/build/asan/bin/kudu with pid 11415
I20240503 08:15:26.452145 7506 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqhmq97/build/asan/bin/kudu pid 11278
I20240503 08:15:26.453202 11400 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 08:15:26.551028 7506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqhmq97/build/asan/bin/kudu with pid 11278
I20240503 08:15:26.565224 7506 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqhmq97/build/asan/bin/kudu pid 11158
I20240503 08:15:26.566241 11220 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 08:15:26.667703 7506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqhmq97/build/asan/bin/kudu with pid 11158
2024-05-03T08:15:26Z chronyd exiting
[ OK ] TabletCopyClientSessionITest.TestCopyFromCrashedSource (5978 ms)
[ RUN ] TabletCopyClientSessionITest.TestTabletCopyWithBusySource
2024-05-03T08:15:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-03T08:15:26Z Disabled control of system clock
I20240503 08:15:26.727128 7506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqhmq97/build/asan/bin/kudu
/tmp/dist-test-taskqhmq97/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.84.190:36175
--webserver_interface=127.7.84.190
--webserver_port=0
--builtin_ntp_servers=127.7.84.148:42069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.84.190:36175
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240503 08:15:27.033556 11572 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:15:27.033855 11572 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:15:27.033994 11572 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:15:27.041535 11572 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240503 08:15:27.041656 11572 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:15:27.041733 11572 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240503 08:15:27.041803 11572 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240503 08:15:27.050830 11572 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.84.148:42069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.7.84.190:36175
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.84.190:36175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.84.190
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 07:43:23 UTC on efd1337a2aa3
build id 103
ASAN enabled
I20240503 08:15:27.052202 11572 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:15:27.053949 11572 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:15:27.064047 11577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:27.064554 11578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:27.065013 11580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:15:27.065515 11572 server_base.cc:1034] running on GCE node
I20240503 08:15:27.066277 11572 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:15:27.067718 11572 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:15:27.068929 11572 hybrid_clock.cc:648] HybridClock initialized: now 1714724127068869 us; error 34 us; skew 500 ppm
I20240503 08:15:27.069253 11572 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:15:27.071509 11572 webserver.cc:460] Webserver started at http://127.7.84.190:41097/ using document root <none> and password file <none>
I20240503 08:15:27.072232 11572 fs_manager.cc:359] Metadata directory not provided
I20240503 08:15:27.072342 11572 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:15:27.072605 11572 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:15:27.075104 11572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/master-0/data/instance:
uuid: "dece1b20628f4eac8414f470ce8be538"
format_stamp: "Formatted at 2024-05-03 08:15:27 on dist-test-slave-2jf9"
I20240503 08:15:27.075831 11572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/master-0/wal/instance:
uuid: "dece1b20628f4eac8414f470ce8be538"
format_stamp: "Formatted at 2024-05-03 08:15:27 on dist-test-slave-2jf9"
I20240503 08:15:27.080672 11572 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20240503 08:15:27.083847 11586 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:27.085134 11572 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20240503 08:15:27.085292 11572 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/master-0/data,/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/master-0/wal
uuid: "dece1b20628f4eac8414f470ce8be538"
format_stamp: "Formatted at 2024-05-03 08:15:27 on dist-test-slave-2jf9"
I20240503 08:15:27.085458 11572 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:15:27.115331 11572 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:15:27.116178 11572 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:15:27.116418 11572 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:15:27.132526 11637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.84.190:36175 every 8 connection(s)
I20240503 08:15:27.132526 11572 rpc_server.cc:307] RPC server started. Bound to: 127.7.84.190:36175
I20240503 08:15:27.133924 11572 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/master-0/data/info.pb
I20240503 08:15:27.137502 11638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:27.143026 7506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqhmq97/build/asan/bin/kudu as pid 11572
I20240503 08:15:27.143227 7506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/master-0/wal/instance
I20240503 08:15:27.146711 11638 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538: Bootstrap starting.
I20240503 08:15:27.149921 11638 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538: Neither blocks nor log segments found. Creating new log.
I20240503 08:15:27.150925 11638 log.cc:824] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538: Log is configured to *not* fsync() on all Append() calls
I20240503 08:15:27.153671 11638 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538: No bootstrap required, opened a new log
I20240503 08:15:27.160323 11638 raft_consensus.cc:348] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dece1b20628f4eac8414f470ce8be538" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 36175 } }
I20240503 08:15:27.160638 11638 raft_consensus.cc:374] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:15:27.160730 11638 raft_consensus.cc:729] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dece1b20628f4eac8414f470ce8be538, State: Initialized, Role: FOLLOWER
I20240503 08:15:27.161410 11638 consensus_queue.cc:260] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dece1b20628f4eac8414f470ce8be538" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 36175 } }
I20240503 08:15:27.161667 11638 raft_consensus.cc:388] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:27.161806 11638 raft_consensus.cc:482] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:27.161947 11638 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:15:27.163993 11638 raft_consensus.cc:504] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dece1b20628f4eac8414f470ce8be538" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 36175 } }
I20240503 08:15:27.164427 11638 leader_election.cc:302] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dece1b20628f4eac8414f470ce8be538; no voters:
I20240503 08:15:27.164968 11638 leader_election.cc:288] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:15:27.165117 11643 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:15:27.166203 11643 raft_consensus.cc:686] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538 [term 1 LEADER]: Becoming Leader. State: Replica: dece1b20628f4eac8414f470ce8be538, State: Running, Role: LEADER
I20240503 08:15:27.166687 11643 consensus_queue.cc:237] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dece1b20628f4eac8414f470ce8be538" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 36175 } }
I20240503 08:15:27.166929 11638 sys_catalog.cc:564] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538 [sys.catalog]: configured and running, proceeding with master startup.
I20240503 08:15:27.169440 11644 sys_catalog.cc:455] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dece1b20628f4eac8414f470ce8be538" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dece1b20628f4eac8414f470ce8be538" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 36175 } } }
I20240503 08:15:27.169807 11644 sys_catalog.cc:458] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538 [sys.catalog]: This master's current role is: LEADER
I20240503 08:15:27.170477 11645 sys_catalog.cc:455] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dece1b20628f4eac8414f470ce8be538. Latest consensus state: current_term: 1 leader_uuid: "dece1b20628f4eac8414f470ce8be538" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dece1b20628f4eac8414f470ce8be538" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 36175 } } }
I20240503 08:15:27.170722 11645 sys_catalog.cc:458] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538 [sys.catalog]: This master's current role is: LEADER
I20240503 08:15:27.172333 11652 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240503 08:15:27.176388 11652 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240503 08:15:27.184444 11652 catalog_manager.cc:1347] Generated new cluster ID: 89a7c6692b464d85bfe8f36da30cbc96
I20240503 08:15:27.184566 11652 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240503 08:15:27.208889 11652 catalog_manager.cc:1370] Generated new certificate authority record
I20240503 08:15:27.210074 11652 catalog_manager.cc:1504] Loading token signing keys...
I20240503 08:15:27.218619 11652 catalog_manager.cc:5857] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538: Generated new TSK 0
I20240503 08:15:27.219378 11652 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240503 08:15:27.228713 7506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqhmq97/build/asan/bin/kudu
/tmp/dist-test-taskqhmq97/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.84.129:0
--local_ip_for_outbound_sockets=127.7.84.129
--webserver_interface=127.7.84.129
--webserver_port=0
--tserver_master_addrs=127.7.84.190:36175
--builtin_ntp_servers=127.7.84.148:42069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=20 with env {}
W20240503 08:15:27.534416 11662 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:15:27.534680 11662 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:15:27.534804 11662 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:15:27.542306 11662 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:15:27.542510 11662 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.84.129
I20240503 08:15:27.551190 11662 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.84.148:42069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.84.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.84.129
--webserver_port=0
--tserver_master_addrs=127.7.84.190:36175
--num_tablets_to_copy_simultaneously=20
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.84.129
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 07:43:23 UTC on efd1337a2aa3
build id 103
ASAN enabled
I20240503 08:15:27.552536 11662 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:15:27.554241 11662 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:15:27.565660 11670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:27.565685 11667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:27.566327 11668 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:15:27.566960 11662 server_base.cc:1034] running on GCE node
I20240503 08:15:27.567574 11662 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:15:27.568507 11662 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:15:27.569716 11662 hybrid_clock.cc:648] HybridClock initialized: now 1714724127569654 us; error 36 us; skew 500 ppm
I20240503 08:15:27.570029 11662 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:15:27.572216 11662 webserver.cc:460] Webserver started at http://127.7.84.129:46219/ using document root <none> and password file <none>
I20240503 08:15:27.572979 11662 fs_manager.cc:359] Metadata directory not provided
I20240503 08:15:27.573105 11662 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:15:27.573405 11662 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:15:27.576037 11662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-0/data/instance:
uuid: "66effc59fb9c44b19404f557486cef51"
format_stamp: "Formatted at 2024-05-03 08:15:27 on dist-test-slave-2jf9"
I20240503 08:15:27.576779 11662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-0/wal/instance:
uuid: "66effc59fb9c44b19404f557486cef51"
format_stamp: "Formatted at 2024-05-03 08:15:27 on dist-test-slave-2jf9"
I20240503 08:15:27.581729 11662 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20240503 08:15:27.584949 11676 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:27.586230 11662 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20240503 08:15:27.586377 11662 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-0/wal
uuid: "66effc59fb9c44b19404f557486cef51"
format_stamp: "Formatted at 2024-05-03 08:15:27 on dist-test-slave-2jf9"
I20240503 08:15:27.586557 11662 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:15:27.609349 11662 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:15:27.610138 11662 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:15:27.610405 11662 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:15:27.611299 11662 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:15:27.612715 11662 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:15:27.612788 11662 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:27.612907 11662 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:15:27.612957 11662 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:27.640489 11662 rpc_server.cc:307] RPC server started. Bound to: 127.7.84.129:35923
I20240503 08:15:27.640522 11788 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.84.129:35923 every 8 connection(s)
I20240503 08:15:27.641703 11662 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-0/data/info.pb
I20240503 08:15:27.646394 7506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqhmq97/build/asan/bin/kudu as pid 11662
I20240503 08:15:27.646591 7506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-0/wal/instance
I20240503 08:15:27.649855 7506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqhmq97/build/asan/bin/kudu
/tmp/dist-test-taskqhmq97/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.84.130:0
--local_ip_for_outbound_sockets=127.7.84.130
--webserver_interface=127.7.84.130
--webserver_port=0
--tserver_master_addrs=127.7.84.190:36175
--builtin_ntp_servers=127.7.84.148:42069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=20 with env {}
I20240503 08:15:27.654336 11789 heartbeater.cc:347] Connected to a master server at 127.7.84.190:36175
I20240503 08:15:27.654640 11789 heartbeater.cc:464] Registering TS with master...
I20240503 08:15:27.655573 11789 heartbeater.cc:511] Master 127.7.84.190:36175 requested a full tablet report, sending...
I20240503 08:15:27.657579 11603 ts_manager.cc:194] Registered new tserver with Master: 66effc59fb9c44b19404f557486cef51 (127.7.84.129:35923)
I20240503 08:15:27.659014 11603 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.84.129:44705
W20240503 08:15:27.956921 11792 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:15:27.957198 11792 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:15:27.957334 11792 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:15:27.964577 11792 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:15:27.964761 11792 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.84.130
I20240503 08:15:27.973333 11792 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.84.148:42069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.84.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.84.130
--webserver_port=0
--tserver_master_addrs=127.7.84.190:36175
--num_tablets_to_copy_simultaneously=20
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.84.130
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 07:43:23 UTC on efd1337a2aa3
build id 103
ASAN enabled
I20240503 08:15:27.974565 11792 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:15:27.976263 11792 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:15:27.989235 11797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:27.989643 11798 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:15:27.990983 11792 server_base.cc:1034] running on GCE node
W20240503 08:15:27.991641 11800 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:15:27.992247 11792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:15:27.993173 11792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:15:27.994396 11792 hybrid_clock.cc:648] HybridClock initialized: now 1714724127994315 us; error 40 us; skew 500 ppm
I20240503 08:15:27.994690 11792 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:15:27.996807 11792 webserver.cc:460] Webserver started at http://127.7.84.130:39385/ using document root <none> and password file <none>
I20240503 08:15:27.997478 11792 fs_manager.cc:359] Metadata directory not provided
I20240503 08:15:27.997596 11792 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:15:27.997876 11792 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:15:28.000367 11792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-1/data/instance:
uuid: "a07199bd73484340962d1be07a60fdf7"
format_stamp: "Formatted at 2024-05-03 08:15:27 on dist-test-slave-2jf9"
I20240503 08:15:28.001080 11792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-1/wal/instance:
uuid: "a07199bd73484340962d1be07a60fdf7"
format_stamp: "Formatted at 2024-05-03 08:15:27 on dist-test-slave-2jf9"
I20240503 08:15:28.005892 11792 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20240503 08:15:28.008965 11806 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:28.010160 11792 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240503 08:15:28.010303 11792 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-1/wal
uuid: "a07199bd73484340962d1be07a60fdf7"
format_stamp: "Formatted at 2024-05-03 08:15:27 on dist-test-slave-2jf9"
I20240503 08:15:28.010484 11792 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:15:28.043488 11792 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:15:28.044293 11792 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:15:28.044574 11792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:15:28.045497 11792 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:15:28.046916 11792 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:15:28.046990 11792 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:28.047109 11792 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:15:28.047160 11792 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:28.075183 11792 rpc_server.cc:307] RPC server started. Bound to: 127.7.84.130:38849
I20240503 08:15:28.075228 11918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.84.130:38849 every 8 connection(s)
I20240503 08:15:28.076490 11792 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-1/data/info.pb
I20240503 08:15:28.078251 7506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqhmq97/build/asan/bin/kudu as pid 11792
I20240503 08:15:28.078430 7506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-1/wal/instance
I20240503 08:15:28.088563 11919 heartbeater.cc:347] Connected to a master server at 127.7.84.190:36175
I20240503 08:15:28.088830 11919 heartbeater.cc:464] Registering TS with master...
I20240503 08:15:28.089587 11919 heartbeater.cc:511] Master 127.7.84.190:36175 requested a full tablet report, sending...
I20240503 08:15:28.090847 11603 ts_manager.cc:194] Registered new tserver with Master: a07199bd73484340962d1be07a60fdf7 (127.7.84.130:38849)
I20240503 08:15:28.091683 11603 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.84.130:51761
I20240503 08:15:28.093667 7506 external_mini_cluster.cc:930] 2 TS(s) registered with all masters
I20240503 08:15:28.105806 7506 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqhmq97/build/asan/bin/kudu pid 11792
I20240503 08:15:28.113174 11914 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 08:15:28.191051 7506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqhmq97/build/asan/bin/kudu with pid 11792
I20240503 08:15:28.203181 7506 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqhmq97/build/asan/bin/kudu pid 11572
I20240503 08:15:28.204264 11633 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 08:15:28.300597 7506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqhmq97/build/asan/bin/kudu with pid 11572
I20240503 08:15:28.316578 7506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqhmq97/build/asan/bin/kudu
/tmp/dist-test-taskqhmq97/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.84.190:36175
--webserver_interface=127.7.84.190
--webserver_port=41097
--builtin_ntp_servers=127.7.84.148:42069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.84.190:36175
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240503 08:15:28.630554 11931 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:15:28.630846 11931 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:15:28.630944 11931 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:15:28.638202 11931 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240503 08:15:28.638304 11931 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:15:28.638345 11931 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240503 08:15:28.638398 11931 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240503 08:15:28.647495 11931 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.84.148:42069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.7.84.190:36175
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.84.190:36175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.84.190
--webserver_port=41097
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 07:43:23 UTC on efd1337a2aa3
build id 103
ASAN enabled
I20240503 08:15:28.648829 11931 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:15:28.650527 11931 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:15:28.661314 11936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:15:28.661631 11789 heartbeater.cc:503] Master 127.7.84.190:36175 was elected leader, sending a full tablet report...
W20240503 08:15:28.661295 11939 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:28.661731 11937 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:15:28.662618 11931 server_base.cc:1034] running on GCE node
W20240503 08:15:28.663107 11789 heartbeater.cc:644] Failed to heartbeat to 127.7.84.190:36175 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.7.84.190:36175: connect: Connection refused (error 111)
I20240503 08:15:28.663550 11931 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:15:28.664881 11931 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:15:28.666083 11931 hybrid_clock.cc:648] HybridClock initialized: now 1714724128666025 us; error 32 us; skew 500 ppm
I20240503 08:15:28.666407 11931 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:15:28.668556 11931 webserver.cc:460] Webserver started at http://127.7.84.190:41097/ using document root <none> and password file <none>
I20240503 08:15:28.669256 11931 fs_manager.cc:359] Metadata directory not provided
I20240503 08:15:28.669396 11931 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:15:28.674371 11931 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.002s
I20240503 08:15:28.677270 11946 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:28.678521 11931 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20240503 08:15:28.678694 11931 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/master-0/data,/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/master-0/wal
uuid: "dece1b20628f4eac8414f470ce8be538"
format_stamp: "Formatted at 2024-05-03 08:15:27 on dist-test-slave-2jf9"
I20240503 08:15:28.679548 11931 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:15:28.691277 11931 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:15:28.692086 11931 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:15:28.692330 11931 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:15:28.707967 11931 rpc_server.cc:307] RPC server started. Bound to: 127.7.84.190:36175
I20240503 08:15:28.707974 11997 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.84.190:36175 every 8 connection(s)
I20240503 08:15:28.709408 11931 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/master-0/data/info.pb
I20240503 08:15:28.715384 11998 sys_catalog.cc:263] Verifying existing consensus state
I20240503 08:15:28.718171 11998 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538: Bootstrap starting.
I20240503 08:15:28.719760 7506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqhmq97/build/asan/bin/kudu as pid 11931
I20240503 08:15:28.733978 11998 log.cc:824] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538: Log is configured to *not* fsync() on all Append() calls
I20240503 08:15:28.742691 11998 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:15:28.743189 11998 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538: Bootstrap complete.
I20240503 08:15:28.749821 11998 raft_consensus.cc:348] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dece1b20628f4eac8414f470ce8be538" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 36175 } }
I20240503 08:15:28.750525 11998 raft_consensus.cc:729] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dece1b20628f4eac8414f470ce8be538, State: Initialized, Role: FOLLOWER
I20240503 08:15:28.751139 11998 consensus_queue.cc:260] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dece1b20628f4eac8414f470ce8be538" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 36175 } }
I20240503 08:15:28.751343 11998 raft_consensus.cc:388] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:28.751520 11998 raft_consensus.cc:482] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:28.751679 11998 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:15:28.755455 11998 raft_consensus.cc:504] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dece1b20628f4eac8414f470ce8be538" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 36175 } }
I20240503 08:15:28.755928 11998 leader_election.cc:302] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dece1b20628f4eac8414f470ce8be538; no voters:
I20240503 08:15:28.756484 11998 leader_election.cc:288] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:15:28.756618 12003 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:15:28.757215 12003 raft_consensus.cc:686] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538 [term 2 LEADER]: Becoming Leader. State: Replica: dece1b20628f4eac8414f470ce8be538, State: Running, Role: LEADER
I20240503 08:15:28.757733 12003 consensus_queue.cc:237] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dece1b20628f4eac8414f470ce8be538" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 36175 } }
I20240503 08:15:28.758338 11998 sys_catalog.cc:564] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538 [sys.catalog]: configured and running, proceeding with master startup.
I20240503 08:15:28.760212 12005 sys_catalog.cc:455] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dece1b20628f4eac8414f470ce8be538. Latest consensus state: current_term: 2 leader_uuid: "dece1b20628f4eac8414f470ce8be538" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dece1b20628f4eac8414f470ce8be538" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 36175 } } }
I20240503 08:15:28.760161 12004 sys_catalog.cc:455] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "dece1b20628f4eac8414f470ce8be538" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dece1b20628f4eac8414f470ce8be538" member_type: VOTER last_known_addr { host: "127.7.84.190" port: 36175 } } }
I20240503 08:15:28.764112 12004 sys_catalog.cc:458] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538 [sys.catalog]: This master's current role is: LEADER
I20240503 08:15:28.764779 12005 sys_catalog.cc:458] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538 [sys.catalog]: This master's current role is: LEADER
I20240503 08:15:28.768464 12009 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240503 08:15:28.774704 12009 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240503 08:15:28.776185 12009 catalog_manager.cc:1259] Loaded cluster ID: 89a7c6692b464d85bfe8f36da30cbc96
I20240503 08:15:28.776438 12009 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240503 08:15:28.779870 12009 catalog_manager.cc:1504] Loading token signing keys...
I20240503 08:15:28.780875 12009 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dece1b20628f4eac8414f470ce8be538: Loaded TSK: 0
I20240503 08:15:28.782033 12009 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240503 08:15:29.669199 11789 heartbeater.cc:347] Connected to a master server at 127.7.84.190:36175
I20240503 08:15:29.669400 11789 heartbeater.cc:503] Master 127.7.84.190:36175 was elected leader, sending a full tablet report...
I20240503 08:15:29.671097 11963 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "66effc59fb9c44b19404f557486cef51" instance_seqno: 1714724127633678) as {username='slave'} at 127.7.84.129:46337; Asking this server to re-register.
I20240503 08:15:29.671734 11789 heartbeater.cc:464] Registering TS with master...
I20240503 08:15:29.671955 11789 heartbeater.cc:511] Master 127.7.84.190:36175 requested a full tablet report, sending...
I20240503 08:15:29.673101 11963 ts_manager.cc:194] Registered new tserver with Master: 66effc59fb9c44b19404f557486cef51 (127.7.84.129:35923)
I20240503 08:15:29.675093 7506 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20240503 08:15:29.675252 7506 test_util.cc:268] Using random seed: 1386420197
I20240503 08:15:29.692696 11963 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48066:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "<redacted>""\004\001\000fff\006\004\001\000\314\314\314\014\004\001\000233\023\004\001\000\230\231\231\031\004\001\000\376\377\377\037\004\001\000dff&\004\001\000\312\314\314,\004\001\0000333\004\001\000\226\231\2319\004\001\000\374\377\377?\004\001\000bffF\004\001\000\310\314\314L\004\001\000.33S\004\001\000\224\231\231Y\004\001\000\372\377\377_\004\001\000`fff\004\001\000\306\314\314l\004\001\000,33s\004\001\000\222\231\231y"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20240503 08:15:29.727836 11706 tablet_service.cc:1467] Processing CreateTablet for tablet 566e0891d2b6410a97f16552e6f26200 (DEFAULT_TABLE table=test-workload [id=833b82cacc9449a5879f7f39784433e2]), partition=RANGE (key) PARTITION 1932735276 <= VALUES < 2040109458
I20240503 08:15:29.728870 11707 tablet_service.cc:1467] Processing CreateTablet for tablet d7b8fb82aab144b3bb85c84d4a9e99a5 (DEFAULT_TABLE table=test-workload [id=833b82cacc9449a5879f7f39784433e2]), partition=RANGE (key) PARTITION 1825361094 <= VALUES < 1932735276
I20240503 08:15:29.729020 11712 tablet_service.cc:1467] Processing CreateTablet for tablet d9923bef86d64d169d9d872203a5ed32 (DEFAULT_TABLE table=test-workload [id=833b82cacc9449a5879f7f39784433e2]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1395864366
I20240503 08:15:29.729105 11718 tablet_service.cc:1467] Processing CreateTablet for tablet 4adc74175f5c413b8cfaef8c65fcf75a (DEFAULT_TABLE table=test-workload [id=833b82cacc9449a5879f7f39784433e2]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 751619274
I20240503 08:15:29.729420 11709 tablet_service.cc:1467] Processing CreateTablet for tablet ea52b951a87f4438a88cfa95d9c98909 (DEFAULT_TABLE table=test-workload [id=833b82cacc9449a5879f7f39784433e2]), partition=RANGE (key) PARTITION 1610612730 <= VALUES < 1717986912
I20240503 08:15:29.729490 11720 tablet_service.cc:1467] Processing CreateTablet for tablet b850787712a842b0b953840254c4f427 (DEFAULT_TABLE table=test-workload [id=833b82cacc9449a5879f7f39784433e2]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 536870910
I20240503 08:15:29.729609 11705 tablet_service.cc:1467] Processing CreateTablet for tablet 4eef8f99866f4d479a83a5403000a519 (DEFAULT_TABLE table=test-workload [id=833b82cacc9449a5879f7f39784433e2]), partition=RANGE (key) PARTITION 2040109458 <= VALUES
I20240503 08:15:29.729781 11724 tablet_service.cc:1467] Processing CreateTablet for tablet 3be99879a9d5456da5fa6f0f2c6bab19 (DEFAULT_TABLE table=test-workload [id=833b82cacc9449a5879f7f39784433e2]), partition=RANGE (key) PARTITION VALUES < 107374182
I20240503 08:15:29.728654 11716 tablet_service.cc:1467] Processing CreateTablet for tablet 7068b2d26c594f10afee195baf075d31 (DEFAULT_TABLE table=test-workload [id=833b82cacc9449a5879f7f39784433e2]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 966367638
I20240503 08:15:29.727909 11710 tablet_service.cc:1467] Processing CreateTablet for tablet 0159f995b6cb48598464969bc8993199 (DEFAULT_TABLE table=test-workload [id=833b82cacc9449a5879f7f39784433e2]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1610612730
I20240503 08:15:29.729988 11722 tablet_service.cc:1467] Processing CreateTablet for tablet 11ca588428804add9a829ef0fdc24056 (DEFAULT_TABLE table=test-workload [id=833b82cacc9449a5879f7f39784433e2]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 322122546
I20240503 08:15:29.728217 11711 tablet_service.cc:1467] Processing CreateTablet for tablet 94e61f0486e040fb810ce305b925b5af (DEFAULT_TABLE table=test-workload [id=833b82cacc9449a5879f7f39784433e2]), partition=RANGE (key) PARTITION 1395864366 <= VALUES < 1503238548
I20240503 08:15:29.730158 11715 tablet_service.cc:1467] Processing CreateTablet for tablet 898e17c25d4c4c2d8ad8d81d56436be9 (DEFAULT_TABLE table=test-workload [id=833b82cacc9449a5879f7f39784433e2]), partition=RANGE (key) PARTITION 966367638 <= VALUES < 1073741820
I20240503 08:15:29.730382 11708 tablet_service.cc:1467] Processing CreateTablet for tablet 8108e738b39d4299884da3c35259cea1 (DEFAULT_TABLE table=test-workload [id=833b82cacc9449a5879f7f39784433e2]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1825361094
I20240503 08:15:29.730607 11717 tablet_service.cc:1467] Processing CreateTablet for tablet 7126547fbe1e4f8394e4083af0ab61de (DEFAULT_TABLE table=test-workload [id=833b82cacc9449a5879f7f39784433e2]), partition=RANGE (key) PARTITION 751619274 <= VALUES < 858993456
I20240503 08:15:29.730633 11713 tablet_service.cc:1467] Processing CreateTablet for tablet 8f2201d7e2014776baa5b130bcd0fa6b (DEFAULT_TABLE table=test-workload [id=833b82cacc9449a5879f7f39784433e2]), partition=RANGE (key) PARTITION 1181116002 <= VALUES < 1288490184
I20240503 08:15:29.730793 11707 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7b8fb82aab144b3bb85c84d4a9e99a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:29.731047 11719 tablet_service.cc:1467] Processing CreateTablet for tablet 63da2aa91161466595ed8f191427a9c7 (DEFAULT_TABLE table=test-workload [id=833b82cacc9449a5879f7f39784433e2]), partition=RANGE (key) PARTITION 536870910 <= VALUES < 644245092
I20240503 08:15:29.731128 11723 tablet_service.cc:1467] Processing CreateTablet for tablet 5702520a1d1042d9b535edbd656ee0b3 (DEFAULT_TABLE table=test-workload [id=833b82cacc9449a5879f7f39784433e2]), partition=RANGE (key) PARTITION 107374182 <= VALUES < 214748364
I20240503 08:15:29.728102 11714 tablet_service.cc:1467] Processing CreateTablet for tablet 5374069fd60d43319b14cd44331e39cb (DEFAULT_TABLE table=test-workload [id=833b82cacc9449a5879f7f39784433e2]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1181116002
I20240503 08:15:29.731742 11711 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94e61f0486e040fb810ce305b925b5af. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:29.731968 11712 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9923bef86d64d169d9d872203a5ed32. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:29.732218 11708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8108e738b39d4299884da3c35259cea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:29.727805 11721 tablet_service.cc:1467] Processing CreateTablet for tablet e407576b763a4d3db8efa96817b0e536 (DEFAULT_TABLE table=test-workload [id=833b82cacc9449a5879f7f39784433e2]), partition=RANGE (key) PARTITION 322122546 <= VALUES < 429496728
I20240503 08:15:29.732570 11721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e407576b763a4d3db8efa96817b0e536. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:29.732959 11718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4adc74175f5c413b8cfaef8c65fcf75a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:29.733407 11720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b850787712a842b0b953840254c4f427. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:29.733970 11715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 898e17c25d4c4c2d8ad8d81d56436be9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:29.734892 11724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3be99879a9d5456da5fa6f0f2c6bab19. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:29.735738 11706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 566e0891d2b6410a97f16552e6f26200. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:29.735977 11714 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5374069fd60d43319b14cd44331e39cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:29.740315 11717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7126547fbe1e4f8394e4083af0ab61de. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:29.740918 11716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7068b2d26c594f10afee195baf075d31. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:29.741555 11722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11ca588428804add9a829ef0fdc24056. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:29.742136 11723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5702520a1d1042d9b535edbd656ee0b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:29.743063 11705 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4eef8f99866f4d479a83a5403000a519. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:29.743631 11710 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0159f995b6cb48598464969bc8993199. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:29.744158 11713 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f2201d7e2014776baa5b130bcd0fa6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:29.744619 11709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea52b951a87f4438a88cfa95d9c98909. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:29.745124 11719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63da2aa91161466595ed8f191427a9c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:29.764081 12033 tablet_bootstrap.cc:492] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:29.776995 12033 tablet_bootstrap.cc:654] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51: Neither blocks nor log segments found. Creating new log.
I20240503 08:15:29.779035 12033 log.cc:824] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51: Log is configured to *not* fsync() on all Append() calls
I20240503 08:15:29.782356 12033 tablet_bootstrap.cc:492] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51: No bootstrap required, opened a new log
I20240503 08:15:29.782739 12033 ts_tablet_manager.cc:1367] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.005s
I20240503 08:15:29.789573 12033 raft_consensus.cc:348] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.789918 12033 raft_consensus.cc:374] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:15:29.790015 12033 raft_consensus.cc:729] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:29.790578 12033 consensus_queue.cc:260] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.790799 12033 raft_consensus.cc:388] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:29.790904 12033 raft_consensus.cc:482] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:29.791021 12033 raft_consensus.cc:3037] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:15:29.792868 12033 raft_consensus.cc:504] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.793287 12033 leader_election.cc:302] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:29.793783 12033 leader_election.cc:288] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:15:29.793926 12035 raft_consensus.cc:2781] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:15:29.795233 12035 raft_consensus.cc:686] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51 [term 1 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:29.795441 12033 ts_tablet_manager.cc:1398] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20240503 08:15:29.795825 12033 tablet_bootstrap.cc:492] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:29.795750 12035 consensus_queue.cc:237] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.797078 12033 tablet_bootstrap.cc:654] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51: Neither blocks nor log segments found. Creating new log.
I20240503 08:15:29.799072 12033 tablet_bootstrap.cc:492] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51: No bootstrap required, opened a new log
I20240503 08:15:29.799276 12033 ts_tablet_manager.cc:1367] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240503 08:15:29.800175 12033 raft_consensus.cc:348] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.800315 12033 raft_consensus.cc:374] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:15:29.800390 12033 raft_consensus.cc:729] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:29.800570 12033 consensus_queue.cc:260] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.800712 12033 raft_consensus.cc:388] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:29.800781 12033 raft_consensus.cc:482] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:29.800875 12033 raft_consensus.cc:3037] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:15:29.801504 11963 catalog_manager.cc:5484] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66effc59fb9c44b19404f557486cef51 (127.7.84.129). New cstate: current_term: 1 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:29.802564 12033 raft_consensus.cc:504] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.802762 12033 leader_election.cc:302] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:29.802915 12033 leader_election.cc:288] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:15:29.802980 12035 raft_consensus.cc:2781] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:15:29.803145 12035 raft_consensus.cc:686] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51 [term 1 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:29.803382 12035 consensus_queue.cc:237] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.803800 12033 ts_tablet_manager.cc:1398] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 08:15:29.804327 12033 tablet_bootstrap.cc:492] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:29.805757 12033 tablet_bootstrap.cc:654] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51: Neither blocks nor log segments found. Creating new log.
I20240503 08:15:29.806989 11963 catalog_manager.cc:5484] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66effc59fb9c44b19404f557486cef51 (127.7.84.129). New cstate: current_term: 1 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:29.807304 12033 tablet_bootstrap.cc:492] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51: No bootstrap required, opened a new log
I20240503 08:15:29.807453 12033 ts_tablet_manager.cc:1367] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20240503 08:15:29.808051 12033 raft_consensus.cc:348] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.808235 12033 raft_consensus.cc:374] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:15:29.808317 12033 raft_consensus.cc:729] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:29.808532 12033 consensus_queue.cc:260] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.808676 12033 raft_consensus.cc:388] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:29.808770 12033 raft_consensus.cc:482] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:29.808864 12033 raft_consensus.cc:3037] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:15:29.810864 12033 raft_consensus.cc:504] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.811049 12033 leader_election.cc:302] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:29.811218 12033 leader_election.cc:288] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:15:29.811266 12037 raft_consensus.cc:2781] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:15:29.811385 12037 raft_consensus.cc:686] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51 [term 1 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:29.811676 12033 ts_tablet_manager.cc:1398] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 08:15:29.811702 12037 consensus_queue.cc:237] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.811941 12033 tablet_bootstrap.cc:492] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:29.813423 12033 tablet_bootstrap.cc:654] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51: Neither blocks nor log segments found. Creating new log.
I20240503 08:15:29.813999 11963 catalog_manager.cc:5484] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66effc59fb9c44b19404f557486cef51 (127.7.84.129). New cstate: current_term: 1 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:29.820327 12033 tablet_bootstrap.cc:492] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51: No bootstrap required, opened a new log
I20240503 08:15:29.820451 12033 ts_tablet_manager.cc:1367] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20240503 08:15:29.821022 12033 raft_consensus.cc:348] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.821147 12033 raft_consensus.cc:374] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:15:29.821228 12033 raft_consensus.cc:729] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:29.821420 12033 consensus_queue.cc:260] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.821563 12033 raft_consensus.cc:388] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:29.821628 12033 raft_consensus.cc:482] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:29.821720 12033 raft_consensus.cc:3037] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:15:29.823423 12033 raft_consensus.cc:504] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.823637 12033 leader_election.cc:302] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:29.823787 12033 leader_election.cc:288] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:15:29.823858 12037 raft_consensus.cc:2781] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:15:29.824033 12037 raft_consensus.cc:686] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51 [term 1 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:29.824147 12033 ts_tablet_manager.cc:1398] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20240503 08:15:29.824255 12037 consensus_queue.cc:237] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.824375 12033 tablet_bootstrap.cc:492] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:29.825938 12033 tablet_bootstrap.cc:654] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51: Neither blocks nor log segments found. Creating new log.
I20240503 08:15:29.826144 11963 catalog_manager.cc:5484] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66effc59fb9c44b19404f557486cef51 (127.7.84.129). New cstate: current_term: 1 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:29.827577 12033 tablet_bootstrap.cc:492] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51: No bootstrap required, opened a new log
I20240503 08:15:29.827704 12033 ts_tablet_manager.cc:1367] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20240503 08:15:29.828286 12033 raft_consensus.cc:348] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.828464 12033 raft_consensus.cc:374] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:15:29.828548 12033 raft_consensus.cc:729] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:29.828763 12033 consensus_queue.cc:260] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.828909 12033 raft_consensus.cc:388] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:29.828999 12033 raft_consensus.cc:482] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:29.829082 12033 raft_consensus.cc:3037] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:15:29.831156 12033 raft_consensus.cc:504] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.831331 12033 leader_election.cc:302] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:29.831523 12033 leader_election.cc:288] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:15:29.831583 12037 raft_consensus.cc:2781] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:15:29.831854 12033 ts_tablet_manager.cc:1398] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 08:15:29.831924 12037 raft_consensus.cc:686] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51 [term 1 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:29.832079 12033 tablet_bootstrap.cc:492] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:29.832160 12037 consensus_queue.cc:237] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.833400 12033 tablet_bootstrap.cc:654] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51: Neither blocks nor log segments found. Creating new log.
I20240503 08:15:29.834295 11963 catalog_manager.cc:5484] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66effc59fb9c44b19404f557486cef51 (127.7.84.129). New cstate: current_term: 1 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:29.835093 12033 tablet_bootstrap.cc:492] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51: No bootstrap required, opened a new log
I20240503 08:15:29.835194 12033 ts_tablet_manager.cc:1367] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240503 08:15:29.835737 12033 raft_consensus.cc:348] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.835870 12033 raft_consensus.cc:374] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:15:29.835959 12033 raft_consensus.cc:729] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:29.836140 12033 consensus_queue.cc:260] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.836278 12033 raft_consensus.cc:388] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:29.836388 12033 raft_consensus.cc:482] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:29.836513 12033 raft_consensus.cc:3037] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:15:29.838775 12033 raft_consensus.cc:504] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.838999 12033 leader_election.cc:302] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:29.839130 12033 leader_election.cc:288] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:15:29.839206 12037 raft_consensus.cc:2781] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:15:29.839354 12037 raft_consensus.cc:686] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51 [term 1 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:29.839615 12033 ts_tablet_manager.cc:1398] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.002s sys 0.003s
I20240503 08:15:29.839598 12037 consensus_queue.cc:237] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.839849 12033 tablet_bootstrap.cc:492] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:29.841208 12033 tablet_bootstrap.cc:654] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51: Neither blocks nor log segments found. Creating new log.
I20240503 08:15:29.841560 11962 catalog_manager.cc:5484] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66effc59fb9c44b19404f557486cef51 (127.7.84.129). New cstate: current_term: 1 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:29.842690 12033 tablet_bootstrap.cc:492] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51: No bootstrap required, opened a new log
I20240503 08:15:29.842814 12033 ts_tablet_manager.cc:1367] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20240503 08:15:29.843411 12033 raft_consensus.cc:348] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.843569 12033 raft_consensus.cc:374] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:15:29.843634 12033 raft_consensus.cc:729] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:29.843833 12033 consensus_queue.cc:260] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.843955 12033 raft_consensus.cc:388] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:29.844039 12033 raft_consensus.cc:482] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:29.844118 12033 raft_consensus.cc:3037] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:15:29.845840 12033 raft_consensus.cc:504] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.846027 12033 leader_election.cc:302] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:29.846199 12033 leader_election.cc:288] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:15:29.846256 12037 raft_consensus.cc:2781] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:15:29.846379 12037 raft_consensus.cc:686] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51 [term 1 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:29.846603 12033 ts_tablet_manager.cc:1398] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20240503 08:15:29.846596 12037 consensus_queue.cc:237] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.846896 12033 tablet_bootstrap.cc:492] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:29.848353 12033 tablet_bootstrap.cc:654] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51: Neither blocks nor log segments found. Creating new log.
I20240503 08:15:29.848510 11962 catalog_manager.cc:5484] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66effc59fb9c44b19404f557486cef51 (127.7.84.129). New cstate: current_term: 1 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:29.849828 12033 tablet_bootstrap.cc:492] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51: No bootstrap required, opened a new log
I20240503 08:15:29.849939 12033 ts_tablet_manager.cc:1367] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240503 08:15:29.850518 12033 raft_consensus.cc:348] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.850642 12033 raft_consensus.cc:374] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:15:29.850725 12033 raft_consensus.cc:729] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:29.850951 12033 consensus_queue.cc:260] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.851096 12033 raft_consensus.cc:388] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:29.851171 12033 raft_consensus.cc:482] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:29.851271 12033 raft_consensus.cc:3037] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:15:29.852972 12033 raft_consensus.cc:504] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.853155 12033 leader_election.cc:302] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:29.853317 12033 leader_election.cc:288] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:15:29.853382 12037 raft_consensus.cc:2781] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:15:29.853529 12037 raft_consensus.cc:686] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51 [term 1 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:29.853757 12033 ts_tablet_manager.cc:1398] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240503 08:15:29.853765 12037 consensus_queue.cc:237] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.853993 12033 tablet_bootstrap.cc:492] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:29.855453 12033 tablet_bootstrap.cc:654] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51: Neither blocks nor log segments found. Creating new log.
I20240503 08:15:29.855711 11962 catalog_manager.cc:5484] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66effc59fb9c44b19404f557486cef51 (127.7.84.129). New cstate: current_term: 1 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:29.856912 12033 tablet_bootstrap.cc:492] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51: No bootstrap required, opened a new log
I20240503 08:15:29.857041 12033 ts_tablet_manager.cc:1367] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240503 08:15:29.857563 12033 raft_consensus.cc:348] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.857738 12033 raft_consensus.cc:374] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:15:29.857801 12033 raft_consensus.cc:729] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:29.858042 12033 consensus_queue.cc:260] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.858194 12033 raft_consensus.cc:388] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:29.858289 12033 raft_consensus.cc:482] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:29.858376 12033 raft_consensus.cc:3037] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:15:29.860302 12033 raft_consensus.cc:504] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.860487 12033 leader_election.cc:302] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:29.860648 12033 leader_election.cc:288] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:15:29.860709 12037 raft_consensus.cc:2781] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:15:29.860864 12037 raft_consensus.cc:686] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51 [term 1 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:29.861078 12033 ts_tablet_manager.cc:1398] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20240503 08:15:29.861124 12037 consensus_queue.cc:237] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.861342 12033 tablet_bootstrap.cc:492] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:29.862778 12033 tablet_bootstrap.cc:654] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51: Neither blocks nor log segments found. Creating new log.
I20240503 08:15:29.863085 11962 catalog_manager.cc:5484] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66effc59fb9c44b19404f557486cef51 (127.7.84.129). New cstate: current_term: 1 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:29.864393 12033 tablet_bootstrap.cc:492] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51: No bootstrap required, opened a new log
I20240503 08:15:29.864526 12033 ts_tablet_manager.cc:1367] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240503 08:15:29.865048 12033 raft_consensus.cc:348] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.865195 12033 raft_consensus.cc:374] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:15:29.865288 12033 raft_consensus.cc:729] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:29.865509 12033 consensus_queue.cc:260] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.865696 12033 raft_consensus.cc:388] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:29.865782 12033 raft_consensus.cc:482] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:29.865886 12033 raft_consensus.cc:3037] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:15:29.867878 12033 raft_consensus.cc:504] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.868072 12033 leader_election.cc:302] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:29.868239 12033 leader_election.cc:288] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:15:29.868345 12037 raft_consensus.cc:2781] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:15:29.868697 12033 ts_tablet_manager.cc:1398] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20240503 08:15:29.868698 12037 raft_consensus.cc:686] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51 [term 1 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:29.868956 12033 tablet_bootstrap.cc:492] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:29.868958 12037 consensus_queue.cc:237] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.870507 12033 tablet_bootstrap.cc:654] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51: Neither blocks nor log segments found. Creating new log.
I20240503 08:15:29.871160 11962 catalog_manager.cc:5484] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66effc59fb9c44b19404f557486cef51 (127.7.84.129). New cstate: current_term: 1 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:29.872174 12033 tablet_bootstrap.cc:492] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51: No bootstrap required, opened a new log
I20240503 08:15:29.872332 12033 ts_tablet_manager.cc:1367] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20240503 08:15:29.872932 12033 raft_consensus.cc:348] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.873068 12033 raft_consensus.cc:374] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:15:29.873135 12033 raft_consensus.cc:729] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:29.873332 12033 consensus_queue.cc:260] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.873502 12033 raft_consensus.cc:388] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:29.873590 12033 raft_consensus.cc:482] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:29.873677 12033 raft_consensus.cc:3037] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:15:29.875599 12033 raft_consensus.cc:504] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.875810 12033 leader_election.cc:302] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:29.875984 12033 leader_election.cc:288] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:15:29.876025 12037 raft_consensus.cc:2781] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:15:29.876164 12037 raft_consensus.cc:686] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51 [term 1 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:29.876370 12037 consensus_queue.cc:237] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.876430 12033 ts_tablet_manager.cc:1398] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20240503 08:15:29.876669 12033 tablet_bootstrap.cc:492] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:29.878083 12033 tablet_bootstrap.cc:654] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51: Neither blocks nor log segments found. Creating new log.
I20240503 08:15:29.878348 11962 catalog_manager.cc:5484] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66effc59fb9c44b19404f557486cef51 (127.7.84.129). New cstate: current_term: 1 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:29.879714 12033 tablet_bootstrap.cc:492] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51: No bootstrap required, opened a new log
I20240503 08:15:29.879822 12033 ts_tablet_manager.cc:1367] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20240503 08:15:29.880350 12033 raft_consensus.cc:348] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.880530 12033 raft_consensus.cc:374] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:15:29.880620 12033 raft_consensus.cc:729] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:29.880813 12033 consensus_queue.cc:260] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.880975 12033 raft_consensus.cc:388] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:29.881053 12033 raft_consensus.cc:482] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:29.881160 12033 raft_consensus.cc:3037] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:15:29.883435 12033 raft_consensus.cc:504] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.883635 12033 leader_election.cc:302] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:29.883795 12033 leader_election.cc:288] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:15:29.883862 12037 raft_consensus.cc:2781] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:15:29.884088 12037 raft_consensus.cc:686] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51 [term 1 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:29.884202 12033 ts_tablet_manager.cc:1398] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 08:15:29.884290 12037 consensus_queue.cc:237] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.884421 12033 tablet_bootstrap.cc:492] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:29.885869 12033 tablet_bootstrap.cc:654] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51: Neither blocks nor log segments found. Creating new log.
I20240503 08:15:29.886236 11962 catalog_manager.cc:5484] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66effc59fb9c44b19404f557486cef51 (127.7.84.129). New cstate: current_term: 1 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:29.887521 12033 tablet_bootstrap.cc:492] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51: No bootstrap required, opened a new log
I20240503 08:15:29.887692 12033 ts_tablet_manager.cc:1367] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20240503 08:15:29.888294 12033 raft_consensus.cc:348] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.888437 12033 raft_consensus.cc:374] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:15:29.888507 12033 raft_consensus.cc:729] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:29.888737 12033 consensus_queue.cc:260] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.888872 12033 raft_consensus.cc:388] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:29.888964 12033 raft_consensus.cc:482] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:29.889050 12033 raft_consensus.cc:3037] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:15:29.890977 12033 raft_consensus.cc:504] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.891180 12033 leader_election.cc:302] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:29.891373 12033 leader_election.cc:288] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:15:29.891459 12037 raft_consensus.cc:2781] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:15:29.891611 12037 raft_consensus.cc:686] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51 [term 1 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:29.891826 12037 consensus_queue.cc:237] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.892002 12033 ts_tablet_manager.cc:1398] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.001s sys 0.003s
I20240503 08:15:29.892230 12033 tablet_bootstrap.cc:492] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:29.893743 12033 tablet_bootstrap.cc:654] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51: Neither blocks nor log segments found. Creating new log.
I20240503 08:15:29.894050 11962 catalog_manager.cc:5484] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66effc59fb9c44b19404f557486cef51 (127.7.84.129). New cstate: current_term: 1 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:29.895284 12033 tablet_bootstrap.cc:492] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51: No bootstrap required, opened a new log
I20240503 08:15:29.895428 12033 ts_tablet_manager.cc:1367] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20240503 08:15:29.895958 12033 raft_consensus.cc:348] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.896080 12033 raft_consensus.cc:374] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:15:29.896162 12033 raft_consensus.cc:729] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:29.896373 12033 consensus_queue.cc:260] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.896546 12033 raft_consensus.cc:388] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:29.896624 12033 raft_consensus.cc:482] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:29.896723 12033 raft_consensus.cc:3037] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:15:29.898553 12033 raft_consensus.cc:504] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.898732 12033 leader_election.cc:302] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:29.898893 12033 leader_election.cc:288] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:15:29.898957 12037 raft_consensus.cc:2781] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:15:29.899096 12037 raft_consensus.cc:686] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51 [term 1 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:29.899312 12033 ts_tablet_manager.cc:1398] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.000s sys 0.000s
I20240503 08:15:29.899313 12037 consensus_queue.cc:237] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.899627 12033 tablet_bootstrap.cc:492] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:29.901054 12033 tablet_bootstrap.cc:654] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51: Neither blocks nor log segments found. Creating new log.
I20240503 08:15:29.901477 11962 catalog_manager.cc:5484] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66effc59fb9c44b19404f557486cef51 (127.7.84.129). New cstate: current_term: 1 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:29.902824 12033 tablet_bootstrap.cc:492] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51: No bootstrap required, opened a new log
I20240503 08:15:29.902964 12033 ts_tablet_manager.cc:1367] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20240503 08:15:29.903554 12033 raft_consensus.cc:348] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.903726 12033 raft_consensus.cc:374] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:15:29.903816 12033 raft_consensus.cc:729] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:29.904009 12033 consensus_queue.cc:260] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.904134 12033 raft_consensus.cc:388] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:29.904476 12033 raft_consensus.cc:482] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:29.904595 12033 raft_consensus.cc:3037] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:15:29.906363 12033 raft_consensus.cc:504] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.906540 12033 leader_election.cc:302] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:29.906715 12033 leader_election.cc:288] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:15:29.906778 12037 raft_consensus.cc:2781] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:15:29.906937 12037 raft_consensus.cc:686] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51 [term 1 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:29.907114 12033 ts_tablet_manager.cc:1398] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240503 08:15:29.907159 12037 consensus_queue.cc:237] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.907367 12033 tablet_bootstrap.cc:492] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:29.908810 12033 tablet_bootstrap.cc:654] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51: Neither blocks nor log segments found. Creating new log.
I20240503 08:15:29.909296 11962 catalog_manager.cc:5484] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66effc59fb9c44b19404f557486cef51 (127.7.84.129). New cstate: current_term: 1 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:29.910367 12033 tablet_bootstrap.cc:492] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51: No bootstrap required, opened a new log
I20240503 08:15:29.910497 12033 ts_tablet_manager.cc:1367] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240503 08:15:29.911065 12033 raft_consensus.cc:348] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.911211 12033 raft_consensus.cc:374] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:15:29.911300 12033 raft_consensus.cc:729] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:29.911515 12033 consensus_queue.cc:260] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.911679 12033 raft_consensus.cc:388] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:29.911758 12033 raft_consensus.cc:482] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:29.911855 12033 raft_consensus.cc:3037] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:15:29.913986 12033 raft_consensus.cc:504] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.914180 12033 leader_election.cc:302] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:29.914330 12033 leader_election.cc:288] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:15:29.914382 12037 raft_consensus.cc:2781] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:15:29.914562 12037 raft_consensus.cc:686] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51 [term 1 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:29.914695 12033 ts_tablet_manager.cc:1398] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240503 08:15:29.914762 12037 consensus_queue.cc:237] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.914908 12033 tablet_bootstrap.cc:492] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:29.916889 11962 catalog_manager.cc:5484] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66effc59fb9c44b19404f557486cef51 (127.7.84.129). New cstate: current_term: 1 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:29.943627 12033 tablet_bootstrap.cc:654] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51: Neither blocks nor log segments found. Creating new log.
I20240503 08:15:29.945421 12033 tablet_bootstrap.cc:492] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51: No bootstrap required, opened a new log
I20240503 08:15:29.945570 12033 ts_tablet_manager.cc:1367] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.031s user 0.000s sys 0.003s
I20240503 08:15:29.946267 12033 raft_consensus.cc:348] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.946424 12033 raft_consensus.cc:374] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:15:29.946476 12033 raft_consensus.cc:729] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:29.946683 12033 consensus_queue.cc:260] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.946801 12033 raft_consensus.cc:388] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:29.946863 12033 raft_consensus.cc:482] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:29.946925 12033 raft_consensus.cc:3037] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:15:29.948658 12033 raft_consensus.cc:504] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.948848 12033 leader_election.cc:302] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:29.949008 12033 leader_election.cc:288] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:15:29.949101 12037 raft_consensus.cc:2781] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:15:29.949249 12037 raft_consensus.cc:686] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51 [term 1 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:29.949432 12033 ts_tablet_manager.cc:1398] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240503 08:15:29.949506 12037 consensus_queue.cc:237] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.949710 12033 tablet_bootstrap.cc:492] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:29.952085 11962 catalog_manager.cc:5484] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66effc59fb9c44b19404f557486cef51 (127.7.84.129). New cstate: current_term: 1 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:29.952421 12033 tablet_bootstrap.cc:654] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51: Neither blocks nor log segments found. Creating new log.
I20240503 08:15:29.954067 12033 tablet_bootstrap.cc:492] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51: No bootstrap required, opened a new log
I20240503 08:15:29.954207 12033 ts_tablet_manager.cc:1367] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.001s
I20240503 08:15:29.954871 12033 raft_consensus.cc:348] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.955034 12033 raft_consensus.cc:374] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:15:29.955132 12033 raft_consensus.cc:729] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:29.955335 12033 consensus_queue.cc:260] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.955525 12033 raft_consensus.cc:388] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:29.955612 12033 raft_consensus.cc:482] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:29.955714 12033 raft_consensus.cc:3037] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:15:29.957664 12033 raft_consensus.cc:504] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.957870 12033 leader_election.cc:302] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:29.958017 12033 leader_election.cc:288] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:15:29.958099 12037 raft_consensus.cc:2781] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:15:29.958262 12037 raft_consensus.cc:686] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51 [term 1 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:29.958464 12033 ts_tablet_manager.cc:1398] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240503 08:15:29.958504 12037 consensus_queue.cc:237] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.958688 12033 tablet_bootstrap.cc:492] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:29.960239 12033 tablet_bootstrap.cc:654] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51: Neither blocks nor log segments found. Creating new log.
I20240503 08:15:29.960759 11962 catalog_manager.cc:5484] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66effc59fb9c44b19404f557486cef51 (127.7.84.129). New cstate: current_term: 1 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:29.961822 12033 tablet_bootstrap.cc:492] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51: No bootstrap required, opened a new log
I20240503 08:15:29.961970 12033 ts_tablet_manager.cc:1367] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240503 08:15:29.962558 12033 raft_consensus.cc:348] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.962735 12033 raft_consensus.cc:374] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:15:29.962813 12033 raft_consensus.cc:729] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:29.963039 12033 consensus_queue.cc:260] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.963213 12033 raft_consensus.cc:388] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:29.963305 12033 raft_consensus.cc:482] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:29.963421 12033 raft_consensus.cc:3037] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:15:29.965658 12033 raft_consensus.cc:504] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.965898 12033 leader_election.cc:302] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:29.966063 12033 leader_election.cc:288] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:15:29.966117 12037 raft_consensus.cc:2781] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:15:29.966259 12037 raft_consensus.cc:686] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51 [term 1 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:29.966459 12033 ts_tablet_manager.cc:1398] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20240503 08:15:29.966503 12037 consensus_queue.cc:237] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.966698 12033 tablet_bootstrap.cc:492] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:29.968217 12033 tablet_bootstrap.cc:654] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51: Neither blocks nor log segments found. Creating new log.
I20240503 08:15:29.968799 11962 catalog_manager.cc:5484] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66effc59fb9c44b19404f557486cef51 (127.7.84.129). New cstate: current_term: 1 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:29.969843 12033 tablet_bootstrap.cc:492] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51: No bootstrap required, opened a new log
I20240503 08:15:29.969946 12033 ts_tablet_manager.cc:1367] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.003s
I20240503 08:15:29.970530 12033 raft_consensus.cc:348] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.970649 12033 raft_consensus.cc:374] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:15:29.970741 12033 raft_consensus.cc:729] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:29.970911 12033 consensus_queue.cc:260] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.971046 12033 raft_consensus.cc:388] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:29.971119 12033 raft_consensus.cc:482] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:29.971227 12033 raft_consensus.cc:3037] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:15:29.973285 12033 raft_consensus.cc:504] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.973516 12033 leader_election.cc:302] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:29.973671 12033 leader_election.cc:288] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:15:29.973740 12037 raft_consensus.cc:2781] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:15:29.973910 12037 raft_consensus.cc:686] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51 [term 1 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:29.974133 12033 ts_tablet_manager.cc:1398] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240503 08:15:29.974135 12037 consensus_queue.cc:237] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:29.976187 11962 catalog_manager.cc:5484] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66effc59fb9c44b19404f557486cef51 (127.7.84.129). New cstate: current_term: 1 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:33.312014 7506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqhmq97/build/asan/bin/kudu
/tmp/dist-test-taskqhmq97/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.84.130:38849
--local_ip_for_outbound_sockets=127.7.84.130
--tserver_master_addrs=127.7.84.190:36175
--webserver_port=39385
--webserver_interface=127.7.84.130
--builtin_ntp_servers=127.7.84.148:42069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=20 with env {}
W20240503 08:15:33.622557 12134 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:15:33.622854 12134 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:15:33.623092 12134 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:15:33.630429 12134 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:15:33.630626 12134 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.84.130
I20240503 08:15:33.639281 12134 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.84.148:42069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.84.130:38849
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.84.130
--webserver_port=39385
--tserver_master_addrs=127.7.84.190:36175
--num_tablets_to_copy_simultaneously=20
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.84.130
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 07:43:23 UTC on efd1337a2aa3
build id 103
ASAN enabled
I20240503 08:15:33.640585 12134 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:15:33.642307 12134 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:15:33.653303 12139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:33.653810 12140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:33.654206 12142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:15:33.654498 12134 server_base.cc:1034] running on GCE node
I20240503 08:15:33.655051 12134 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:15:33.656083 12134 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:15:33.657338 12134 hybrid_clock.cc:648] HybridClock initialized: now 1714724133657260 us; error 57 us; skew 500 ppm
I20240503 08:15:33.657639 12134 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:15:33.660240 12134 webserver.cc:460] Webserver started at http://127.7.84.130:39385/ using document root <none> and password file <none>
I20240503 08:15:33.660940 12134 fs_manager.cc:359] Metadata directory not provided
I20240503 08:15:33.661073 12134 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:15:33.666287 12134 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20240503 08:15:33.669221 12148 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:33.670614 12134 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20240503 08:15:33.670758 12134 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-1/wal
uuid: "a07199bd73484340962d1be07a60fdf7"
format_stamp: "Formatted at 2024-05-03 08:15:27 on dist-test-slave-2jf9"
I20240503 08:15:33.671736 12134 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:15:33.688019 12134 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:15:33.688760 12134 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:15:33.689010 12134 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:15:33.689946 12134 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:15:33.691365 12134 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:15:33.691483 12134 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:33.691586 12134 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:15:33.691669 12134 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:33.738212 12134 rpc_server.cc:307] RPC server started. Bound to: 127.7.84.130:38849
I20240503 08:15:33.738253 12260 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.84.130:38849 every 8 connection(s)
I20240503 08:15:33.739706 12134 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-1/data/info.pb
I20240503 08:15:33.740613 7506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqhmq97/build/asan/bin/kudu as pid 12134
I20240503 08:15:33.742439 7506 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskqhmq97/build/asan/bin/kudu pid 11662
I20240503 08:15:33.745491 11784 generic_service.cc:196] Checking for leaks (request via RPC)
I20240503 08:15:33.761876 12261 heartbeater.cc:347] Connected to a master server at 127.7.84.190:36175
I20240503 08:15:33.762174 12261 heartbeater.cc:464] Registering TS with master...
I20240503 08:15:33.762977 12261 heartbeater.cc:511] Master 127.7.84.190:36175 requested a full tablet report, sending...
I20240503 08:15:33.764346 11963 ts_manager.cc:194] Registered new tserver with Master: a07199bd73484340962d1be07a60fdf7 (127.7.84.130:38849)
I20240503 08:15:33.765426 11963 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.84.130:37617
I20240503 08:15:33.955700 7506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskqhmq97/build/asan/bin/kudu with pid 11662
I20240503 08:15:33.983532 7506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskqhmq97/build/asan/bin/kudu
/tmp/dist-test-taskqhmq97/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.84.129:35923
--local_ip_for_outbound_sockets=127.7.84.129
--tserver_master_addrs=127.7.84.190:36175
--webserver_port=46219
--webserver_interface=127.7.84.129
--builtin_ntp_servers=127.7.84.148:42069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=20
--rpc_service_queue_length=1
--rpc_num_service_threads=1 with env {}
W20240503 08:15:34.297581 12266 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240503 08:15:34.297892 12266 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240503 08:15:34.298035 12266 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240503 08:15:34.305478 12266 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240503 08:15:34.305702 12266 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.84.129
I20240503 08:15:34.314563 12266 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.84.148:42069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.84.129:35923
--rpc_num_service_threads=1
--rpc_server_allow_ephemeral_ports=true
--rpc_service_queue_length=1
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.84.129
--webserver_port=46219
--tserver_master_addrs=127.7.84.190:36175
--num_tablets_to_copy_simultaneously=20
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.84.129
--log_dir=/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c39e72a98e124e5a12080bac42105b996594d806
build type FASTDEBUG
built by None at 03 May 2024 07:43:23 UTC on efd1337a2aa3
build id 103
ASAN enabled
I20240503 08:15:34.315980 12266 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:15:34.317648 12266 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:15:34.328622 12271 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:34.329089 12274 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:15:34.329402 12272 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:15:34.329860 12266 server_base.cc:1034] running on GCE node
I20240503 08:15:34.330391 12266 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240503 08:15:34.331248 12266 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240503 08:15:34.332442 12266 hybrid_clock.cc:648] HybridClock initialized: now 1714724134332378 us; error 70 us; skew 500 ppm
I20240503 08:15:34.332731 12266 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:15:34.338039 12266 webserver.cc:460] Webserver started at http://127.7.84.129:46219/ using document root <none> and password file <none>
I20240503 08:15:34.338742 12266 fs_manager.cc:359] Metadata directory not provided
I20240503 08:15:34.338881 12266 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:15:34.344283 12266 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20240503 08:15:34.348587 12280 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:15:34.349821 12266 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20240503 08:15:34.349968 12266 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-0/wal
uuid: "66effc59fb9c44b19404f557486cef51"
format_stamp: "Formatted at 2024-05-03 08:15:27 on dist-test-slave-2jf9"
I20240503 08:15:34.350821 12266 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:15:34.364308 12266 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:15:34.365108 12266 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:15:34.365362 12266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:15:34.366282 12266 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:15:34.368366 12287 ts_tablet_manager.cc:522] Loading tablet metadata (0/20 complete)
I20240503 08:15:34.409713 12266 ts_tablet_manager.cc:559] Loaded tablet metadata (20 total tablets, 20 live tablets)
I20240503 08:15:34.409899 12266 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.042s user 0.000s sys 0.002s
I20240503 08:15:34.410048 12266 ts_tablet_manager.cc:574] Registering tablets (0/20 complete)
I20240503 08:15:34.414265 12287 tablet_bootstrap.cc:492] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:34.455307 12266 ts_tablet_manager.cc:590] Registered 20 tablets
I20240503 08:15:34.455430 12266 ts_tablet_manager.cc:569] Time spent register tablets: real 0.045s user 0.025s sys 0.016s
I20240503 08:15:34.461419 12287 log.cc:824] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51: Log is configured to *not* fsync() on all Append() calls
I20240503 08:15:34.463940 12266 rpc_server.cc:307] RPC server started. Bound to: 127.7.84.129:35923
I20240503 08:15:34.463980 12299 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.84.129:35923 every 8 connection(s)
I20240503 08:15:34.465193 12266 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskqhmq97/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714724103239050-7506-0/minicluster-data/ts-0/data/info.pb
I20240503 08:15:34.465863 7506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskqhmq97/build/asan/bin/kudu as pid 12266
I20240503 08:15:34.484115 12300 heartbeater.cc:347] Connected to a master server at 127.7.84.190:36175
I20240503 08:15:34.484428 12300 heartbeater.cc:464] Registering TS with master...
I20240503 08:15:34.485431 12300 heartbeater.cc:511] Master 127.7.84.190:36175 requested a full tablet report, sending...
I20240503 08:15:34.489048 11963 ts_manager.cc:194] Re-registered known tserver with Master: 66effc59fb9c44b19404f557486cef51 (127.7.84.129:35923)
I20240503 08:15:34.493325 11963 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.84.129:40521
I20240503 08:15:34.627012 12287 tablet_bootstrap.cc:492] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51: Bootstrap replayed 1/1 log segments. Stats: ops{read=190 overwritten=0 applied=190 ignored=0} inserts{seen=507 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:15:34.627574 12287 tablet_bootstrap.cc:492] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51: Bootstrap complete.
I20240503 08:15:34.628590 12287 ts_tablet_manager.cc:1367] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.215s user 0.180s sys 0.031s
I20240503 08:15:34.632973 12287 raft_consensus.cc:348] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:34.633713 12287 raft_consensus.cc:729] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:34.634295 12287 consensus_queue.cc:260] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 190, Last appended: 1.190, Last appended by leader: 190, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:34.634496 12287 raft_consensus.cc:388] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:34.634606 12287 raft_consensus.cc:482] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:34.634764 12287 raft_consensus.cc:3037] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:15:34.638373 12287 raft_consensus.cc:504] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:34.638867 12287 leader_election.cc:302] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:34.639467 12287 leader_election.cc:288] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:15:34.639660 12306 raft_consensus.cc:2781] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:15:34.640607 12300 heartbeater.cc:503] Master 127.7.84.190:36175 was elected leader, sending a full tablet report...
I20240503 08:15:34.640718 12306 raft_consensus.cc:686] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51 [term 2 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:34.641232 12287 ts_tablet_manager.cc:1398] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.013s user 0.012s sys 0.001s
I20240503 08:15:34.641186 12306 consensus_queue.cc:237] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 190, Committed index: 190, Last appended: 1.190, Last appended by leader: 190, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:34.641621 12287 tablet_bootstrap.cc:492] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:34.647128 11963 catalog_manager.cc:5484] T 8108e738b39d4299884da3c35259cea1 P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:34.767935 12261 heartbeater.cc:503] Master 127.7.84.190:36175 was elected leader, sending a full tablet report...
I20240503 08:15:34.814611 12287 tablet_bootstrap.cc:492] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51: Bootstrap replayed 1/1 log segments. Stats: ops{read=186 overwritten=0 applied=186 ignored=0} inserts{seen=497 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:15:34.815058 12287 tablet_bootstrap.cc:492] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51: Bootstrap complete.
I20240503 08:15:34.815951 12287 ts_tablet_manager.cc:1367] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.174s user 0.154s sys 0.019s
I20240503 08:15:34.817080 12287 raft_consensus.cc:348] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:34.817293 12287 raft_consensus.cc:729] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:34.817555 12287 consensus_queue.cc:260] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 186, Last appended: 1.186, Last appended by leader: 186, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:34.817730 12287 raft_consensus.cc:388] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:34.817828 12287 raft_consensus.cc:482] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:34.817919 12287 raft_consensus.cc:3037] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:15:34.819831 12287 raft_consensus.cc:504] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:34.820006 12287 leader_election.cc:302] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:34.820163 12287 leader_election.cc:288] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:15:34.820230 12306 raft_consensus.cc:2781] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:15:34.820415 12306 raft_consensus.cc:686] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51 [term 2 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:34.820591 12287 ts_tablet_manager.cc:1398] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 08:15:34.820652 12306 consensus_queue.cc:237] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 186, Committed index: 186, Last appended: 1.186, Last appended by leader: 186, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:34.820835 12287 tablet_bootstrap.cc:492] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:34.822811 11963 catalog_manager.cc:5484] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:35.004953 12287 tablet_bootstrap.cc:492] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51: Bootstrap replayed 1/1 log segments. Stats: ops{read=192 overwritten=0 applied=192 ignored=0} inserts{seen=486 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:15:35.005404 12287 tablet_bootstrap.cc:492] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51: Bootstrap complete.
I20240503 08:15:35.006192 12287 ts_tablet_manager.cc:1367] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.185s user 0.174s sys 0.008s
I20240503 08:15:35.006811 12287 raft_consensus.cc:348] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:35.006984 12287 raft_consensus.cc:729] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:35.007198 12287 consensus_queue.cc:260] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 192, Last appended: 1.192, Last appended by leader: 192, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:35.007350 12287 raft_consensus.cc:388] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:35.007442 12287 raft_consensus.cc:482] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:35.007545 12287 raft_consensus.cc:3037] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:15:35.009270 12287 raft_consensus.cc:504] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:35.009516 12287 leader_election.cc:302] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:35.009687 12287 leader_election.cc:288] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:15:35.009788 12306 raft_consensus.cc:2781] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:15:35.009967 12306 raft_consensus.cc:686] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51 [term 2 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:35.010123 12287 ts_tablet_manager.cc:1398] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 08:15:35.010195 12306 consensus_queue.cc:237] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 192, Committed index: 192, Last appended: 1.192, Last appended by leader: 192, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:35.010332 12287 tablet_bootstrap.cc:492] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:35.012916 11963 catalog_manager.cc:5484] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:35.177592 12287 tablet_bootstrap.cc:492] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51: Bootstrap replayed 1/1 log segments. Stats: ops{read=189 overwritten=0 applied=189 ignored=0} inserts{seen=521 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:15:35.178056 12287 tablet_bootstrap.cc:492] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51: Bootstrap complete.
I20240503 08:15:35.178968 12287 ts_tablet_manager.cc:1367] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.169s user 0.149s sys 0.016s
I20240503 08:15:35.179684 12287 raft_consensus.cc:348] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:35.179826 12287 raft_consensus.cc:729] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:35.180044 12287 consensus_queue.cc:260] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 189, Last appended: 1.189, Last appended by leader: 189, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:35.180191 12287 raft_consensus.cc:388] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:35.180277 12287 raft_consensus.cc:482] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:35.180357 12287 raft_consensus.cc:3037] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:15:35.182068 12287 raft_consensus.cc:504] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:35.182260 12287 leader_election.cc:302] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:35.182427 12287 leader_election.cc:288] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:15:35.182497 12306 raft_consensus.cc:2781] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:15:35.182704 12306 raft_consensus.cc:686] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51 [term 2 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:35.182833 12287 ts_tablet_manager.cc:1398] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 08:15:35.182933 12306 consensus_queue.cc:237] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 189, Committed index: 189, Last appended: 1.189, Last appended by leader: 189, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:35.183081 12287 tablet_bootstrap.cc:492] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:35.185163 11963 catalog_manager.cc:5484] T 5374069fd60d43319b14cd44331e39cb P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:35.352510 12287 tablet_bootstrap.cc:492] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51: Bootstrap replayed 1/1 log segments. Stats: ops{read=195 overwritten=0 applied=195 ignored=0} inserts{seen=505 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:15:35.352967 12287 tablet_bootstrap.cc:492] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51: Bootstrap complete.
I20240503 08:15:35.353782 12287 ts_tablet_manager.cc:1367] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.171s user 0.145s sys 0.024s
I20240503 08:15:35.354502 12287 raft_consensus.cc:348] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:35.354677 12287 raft_consensus.cc:729] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:35.354897 12287 consensus_queue.cc:260] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:35.355059 12287 raft_consensus.cc:388] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:35.355134 12287 raft_consensus.cc:482] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:35.355239 12287 raft_consensus.cc:3037] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:15:35.356953 12287 raft_consensus.cc:504] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:35.357148 12287 leader_election.cc:302] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:35.357311 12287 leader_election.cc:288] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:15:35.357403 12306 raft_consensus.cc:2781] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:15:35.357592 12306 raft_consensus.cc:686] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51 [term 2 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:35.357671 12287 ts_tablet_manager.cc:1398] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.002s sys 0.002s
I20240503 08:15:35.357936 12287 tablet_bootstrap.cc:492] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:35.357862 12306 consensus_queue.cc:237] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 195, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:35.360181 11963 catalog_manager.cc:5484] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:35.535686 12287 tablet_bootstrap.cc:492] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51: Bootstrap replayed 1/1 log segments. Stats: ops{read=190 overwritten=0 applied=190 ignored=0} inserts{seen=501 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:15:35.536270 12287 tablet_bootstrap.cc:492] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51: Bootstrap complete.
I20240503 08:15:35.537344 12287 ts_tablet_manager.cc:1367] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.179s user 0.157s sys 0.020s
I20240503 08:15:35.538050 12287 raft_consensus.cc:348] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:35.538241 12287 raft_consensus.cc:729] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:35.538496 12287 consensus_queue.cc:260] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 190, Last appended: 1.190, Last appended by leader: 190, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:35.538673 12287 raft_consensus.cc:388] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:35.538760 12287 raft_consensus.cc:482] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:35.538852 12287 raft_consensus.cc:3037] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:15:35.540882 12287 raft_consensus.cc:504] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:35.541077 12287 leader_election.cc:302] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:35.541278 12287 leader_election.cc:288] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:15:35.541326 12306 raft_consensus.cc:2781] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:15:35.541527 12306 raft_consensus.cc:686] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51 [term 2 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:35.541739 12287 ts_tablet_manager.cc:1398] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 08:15:35.541756 12306 consensus_queue.cc:237] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 190, Committed index: 190, Last appended: 1.190, Last appended by leader: 190, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:35.542039 12287 tablet_bootstrap.cc:492] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:35.544117 11963 catalog_manager.cc:5484] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:35.710085 12287 tablet_bootstrap.cc:492] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51: Bootstrap replayed 1/1 log segments. Stats: ops{read=193 overwritten=0 applied=193 ignored=0} inserts{seen=512 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:15:35.710503 12287 tablet_bootstrap.cc:492] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51: Bootstrap complete.
I20240503 08:15:35.711279 12287 ts_tablet_manager.cc:1367] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.169s user 0.141s sys 0.024s
I20240503 08:15:35.711920 12287 raft_consensus.cc:348] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:35.712074 12287 raft_consensus.cc:729] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:35.712282 12287 consensus_queue.cc:260] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 193, Last appended: 1.193, Last appended by leader: 193, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:35.712435 12287 raft_consensus.cc:388] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:35.712505 12287 raft_consensus.cc:482] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:35.712603 12287 raft_consensus.cc:3037] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:15:35.714660 12287 raft_consensus.cc:504] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:35.714883 12287 leader_election.cc:302] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:35.715123 12287 leader_election.cc:288] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:15:35.715180 12306 raft_consensus.cc:2781] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:15:35.715384 12306 raft_consensus.cc:686] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51 [term 2 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:35.715667 12287 ts_tablet_manager.cc:1398] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.008s sys 0.000s
I20240503 08:15:35.715692 12306 consensus_queue.cc:237] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 193, Committed index: 193, Last appended: 1.193, Last appended by leader: 193, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:35.715904 12287 tablet_bootstrap.cc:492] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:35.721343 11963 catalog_manager.cc:5484] T 898e17c25d4c4c2d8ad8d81d56436be9 P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:35.883201 12287 tablet_bootstrap.cc:492] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51: Bootstrap replayed 1/1 log segments. Stats: ops{read=190 overwritten=0 applied=190 ignored=0} inserts{seen=536 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:15:35.883756 12287 tablet_bootstrap.cc:492] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51: Bootstrap complete.
I20240503 08:15:35.884765 12287 ts_tablet_manager.cc:1367] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.169s user 0.156s sys 0.012s
I20240503 08:15:35.885612 12287 raft_consensus.cc:348] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:35.885812 12287 raft_consensus.cc:729] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:35.886054 12287 consensus_queue.cc:260] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 190, Last appended: 1.190, Last appended by leader: 190, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:35.886183 12287 raft_consensus.cc:388] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:35.886263 12287 raft_consensus.cc:482] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:35.886336 12287 raft_consensus.cc:3037] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:15:35.888124 12287 raft_consensus.cc:504] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:35.888305 12287 leader_election.cc:302] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:35.888484 12287 leader_election.cc:288] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:15:35.888549 12306 raft_consensus.cc:2781] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:15:35.888748 12306 raft_consensus.cc:686] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51 [term 2 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:35.888893 12287 ts_tablet_manager.cc:1398] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 08:15:35.888981 12306 consensus_queue.cc:237] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 190, Committed index: 190, Last appended: 1.190, Last appended by leader: 190, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:35.889133 12287 tablet_bootstrap.cc:492] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:35.891461 11963 catalog_manager.cc:5484] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:36.059373 12287 tablet_bootstrap.cc:492] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51: Bootstrap replayed 1/1 log segments. Stats: ops{read=194 overwritten=0 applied=194 ignored=0} inserts{seen=531 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:15:36.059856 12287 tablet_bootstrap.cc:492] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51: Bootstrap complete.
I20240503 08:15:36.060639 12287 ts_tablet_manager.cc:1367] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.172s user 0.154s sys 0.016s
I20240503 08:15:36.061203 12287 raft_consensus.cc:348] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:36.061383 12287 raft_consensus.cc:729] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:36.061580 12287 consensus_queue.cc:260] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 194, Last appended: 1.194, Last appended by leader: 194, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:36.061728 12287 raft_consensus.cc:388] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:36.061796 12287 raft_consensus.cc:482] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:36.061893 12287 raft_consensus.cc:3037] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:15:36.063700 12287 raft_consensus.cc:504] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:36.063910 12287 leader_election.cc:302] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:36.064067 12287 leader_election.cc:288] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:15:36.064148 12306 raft_consensus.cc:2781] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:15:36.064328 12306 raft_consensus.cc:686] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51 [term 2 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:36.064558 12287 ts_tablet_manager.cc:1398] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 08:15:36.064577 12306 consensus_queue.cc:237] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 194, Committed index: 194, Last appended: 1.194, Last appended by leader: 194, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:36.064781 12287 tablet_bootstrap.cc:492] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:36.066944 11963 catalog_manager.cc:5484] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:36.234895 12287 tablet_bootstrap.cc:492] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51: Bootstrap replayed 1/1 log segments. Stats: ops{read=188 overwritten=0 applied=188 ignored=0} inserts{seen=538 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:15:36.235422 12287 tablet_bootstrap.cc:492] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51: Bootstrap complete.
I20240503 08:15:36.236236 12287 ts_tablet_manager.cc:1367] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.172s user 0.155s sys 0.016s
I20240503 08:15:36.236831 12287 raft_consensus.cc:348] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:36.236968 12287 raft_consensus.cc:729] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:36.237159 12287 consensus_queue.cc:260] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 188, Last appended: 1.188, Last appended by leader: 188, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:36.237280 12287 raft_consensus.cc:388] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:36.237344 12287 raft_consensus.cc:482] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:36.237413 12287 raft_consensus.cc:3037] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:15:36.239104 12287 raft_consensus.cc:504] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:36.239277 12287 leader_election.cc:302] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:36.239451 12287 leader_election.cc:288] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:15:36.239516 12306 raft_consensus.cc:2781] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:15:36.239703 12306 raft_consensus.cc:686] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51 [term 2 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:36.239857 12287 ts_tablet_manager.cc:1398] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20240503 08:15:36.239928 12306 consensus_queue.cc:237] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 188, Committed index: 188, Last appended: 1.188, Last appended by leader: 188, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:36.240087 12287 tablet_bootstrap.cc:492] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:36.242259 11963 catalog_manager.cc:5484] T 8f2201d7e2014776baa5b130bcd0fa6b P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:36.405293 12287 tablet_bootstrap.cc:492] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51: Bootstrap replayed 1/1 log segments. Stats: ops{read=192 overwritten=0 applied=192 ignored=0} inserts{seen=535 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:15:36.405701 12287 tablet_bootstrap.cc:492] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51: Bootstrap complete.
I20240503 08:15:36.406477 12287 ts_tablet_manager.cc:1367] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.166s user 0.143s sys 0.020s
I20240503 08:15:36.407074 12287 raft_consensus.cc:348] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:36.407239 12287 raft_consensus.cc:729] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:36.407469 12287 consensus_queue.cc:260] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 192, Last appended: 1.192, Last appended by leader: 192, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:36.407629 12287 raft_consensus.cc:388] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:36.407702 12287 raft_consensus.cc:482] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:36.407800 12287 raft_consensus.cc:3037] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:15:36.409511 12287 raft_consensus.cc:504] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:36.409716 12287 leader_election.cc:302] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:36.409879 12287 leader_election.cc:288] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:15:36.409968 12306 raft_consensus.cc:2781] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:15:36.410162 12306 raft_consensus.cc:686] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51 [term 2 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:36.410317 12287 ts_tablet_manager.cc:1398] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 08:15:36.410401 12306 consensus_queue.cc:237] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 192, Committed index: 192, Last appended: 1.192, Last appended by leader: 192, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:36.410537 12287 tablet_bootstrap.cc:492] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:36.412911 11963 catalog_manager.cc:5484] T 94e61f0486e040fb810ce305b925b5af P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:36.589095 12287 tablet_bootstrap.cc:492] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51: Bootstrap replayed 1/1 log segments. Stats: ops{read=194 overwritten=0 applied=194 ignored=0} inserts{seen=539 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:15:36.589532 12287 tablet_bootstrap.cc:492] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51: Bootstrap complete.
I20240503 08:15:36.590282 12287 ts_tablet_manager.cc:1367] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.180s user 0.157s sys 0.020s
I20240503 08:15:36.590881 12287 raft_consensus.cc:348] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:36.591027 12287 raft_consensus.cc:729] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:36.591207 12287 consensus_queue.cc:260] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 194, Last appended: 1.194, Last appended by leader: 194, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:36.591324 12287 raft_consensus.cc:388] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:36.591428 12287 raft_consensus.cc:482] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:36.591514 12287 raft_consensus.cc:3037] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:15:36.593565 12287 raft_consensus.cc:504] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:36.593775 12287 leader_election.cc:302] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:36.593967 12287 leader_election.cc:288] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:15:36.594029 12306 raft_consensus.cc:2781] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:15:36.594261 12306 raft_consensus.cc:686] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51 [term 2 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:36.594434 12287 ts_tablet_manager.cc:1398] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 08:15:36.594529 12306 consensus_queue.cc:237] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 194, Committed index: 194, Last appended: 1.194, Last appended by leader: 194, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:36.594671 12287 tablet_bootstrap.cc:492] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:36.597069 11963 catalog_manager.cc:5484] T b850787712a842b0b953840254c4f427 P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:36.769814 12287 tablet_bootstrap.cc:492] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51: Bootstrap replayed 1/1 log segments. Stats: ops{read=193 overwritten=0 applied=193 ignored=0} inserts{seen=508 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:15:36.770239 12287 tablet_bootstrap.cc:492] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51: Bootstrap complete.
I20240503 08:15:36.771060 12287 ts_tablet_manager.cc:1367] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.176s user 0.149s sys 0.024s
I20240503 08:15:36.771745 12287 raft_consensus.cc:348] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:36.771940 12287 raft_consensus.cc:729] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:36.772217 12287 consensus_queue.cc:260] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 193, Last appended: 1.193, Last appended by leader: 193, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:36.772373 12287 raft_consensus.cc:388] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:36.772456 12287 raft_consensus.cc:482] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:36.772583 12287 raft_consensus.cc:3037] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:15:36.774544 12287 raft_consensus.cc:504] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:36.774763 12287 leader_election.cc:302] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:36.774931 12287 leader_election.cc:288] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:15:36.775002 12306 raft_consensus.cc:2781] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:15:36.775440 12306 raft_consensus.cc:686] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51 [term 2 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:36.775460 12287 ts_tablet_manager.cc:1398] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20240503 08:15:36.775770 12287 tablet_bootstrap.cc:492] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:36.775741 12306 consensus_queue.cc:237] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 193, Committed index: 193, Last appended: 1.193, Last appended by leader: 193, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:36.778147 11963 catalog_manager.cc:5484] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:36.946480 12287 tablet_bootstrap.cc:492] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51: Bootstrap replayed 1/1 log segments. Stats: ops{read=196 overwritten=0 applied=196 ignored=0} inserts{seen=519 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:15:36.946915 12287 tablet_bootstrap.cc:492] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51: Bootstrap complete.
I20240503 08:15:36.947711 12287 ts_tablet_manager.cc:1367] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.172s user 0.159s sys 0.012s
I20240503 08:15:36.948328 12287 raft_consensus.cc:348] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:36.948482 12287 raft_consensus.cc:729] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:36.948697 12287 consensus_queue.cc:260] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 196, Last appended: 1.196, Last appended by leader: 196, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:36.948827 12287 raft_consensus.cc:388] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:36.948912 12287 raft_consensus.cc:482] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:36.948982 12287 raft_consensus.cc:3037] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:15:36.950688 12287 raft_consensus.cc:504] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:36.950881 12287 leader_election.cc:302] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:36.951069 12287 leader_election.cc:288] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:15:36.951099 12306 raft_consensus.cc:2781] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:15:36.951309 12306 raft_consensus.cc:686] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51 [term 2 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:36.951543 12287 ts_tablet_manager.cc:1398] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 08:15:36.951597 12306 consensus_queue.cc:237] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 196, Committed index: 196, Last appended: 1.196, Last appended by leader: 196, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:36.951772 12287 tablet_bootstrap.cc:492] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:36.953867 11963 catalog_manager.cc:5484] T 63da2aa91161466595ed8f191427a9c7 P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:37.129727 12287 tablet_bootstrap.cc:492] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51: Bootstrap replayed 1/1 log segments. Stats: ops{read=190 overwritten=0 applied=190 ignored=0} inserts{seen=554 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:15:37.130180 12287 tablet_bootstrap.cc:492] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51: Bootstrap complete.
I20240503 08:15:37.130959 12287 ts_tablet_manager.cc:1367] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.179s user 0.147s sys 0.028s
I20240503 08:15:37.131564 12287 raft_consensus.cc:348] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:37.131729 12287 raft_consensus.cc:729] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:37.131942 12287 consensus_queue.cc:260] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 190, Last appended: 1.190, Last appended by leader: 190, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:37.132090 12287 raft_consensus.cc:388] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:37.132164 12287 raft_consensus.cc:482] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:37.132265 12287 raft_consensus.cc:3037] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:15:37.134366 12287 raft_consensus.cc:504] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:37.134649 12287 leader_election.cc:302] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:37.134860 12287 leader_election.cc:288] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:15:37.134935 12306 raft_consensus.cc:2781] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:15:37.135123 12306 raft_consensus.cc:686] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51 [term 2 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:37.135362 12287 ts_tablet_manager.cc:1398] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 08:15:37.135444 12306 consensus_queue.cc:237] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 190, Committed index: 190, Last appended: 1.190, Last appended by leader: 190, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:37.135624 12287 tablet_bootstrap.cc:492] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:37.137950 11963 catalog_manager.cc:5484] T 3be99879a9d5456da5fa6f0f2c6bab19 P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:37.326086 12287 tablet_bootstrap.cc:492] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51: Bootstrap replayed 1/1 log segments. Stats: ops{read=197 overwritten=0 applied=197 ignored=0} inserts{seen=485 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:15:37.326519 12287 tablet_bootstrap.cc:492] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51: Bootstrap complete.
I20240503 08:15:37.327348 12287 ts_tablet_manager.cc:1367] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.192s user 0.157s sys 0.016s
I20240503 08:15:37.328054 12287 raft_consensus.cc:348] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:37.328207 12287 raft_consensus.cc:729] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:37.328429 12287 consensus_queue.cc:260] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 197, Last appended: 1.197, Last appended by leader: 197, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:37.328590 12287 raft_consensus.cc:388] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:37.328678 12287 raft_consensus.cc:482] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:37.328753 12287 raft_consensus.cc:3037] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:15:37.330828 12287 raft_consensus.cc:504] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:37.331019 12287 leader_election.cc:302] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:37.331203 12287 leader_election.cc:288] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:15:37.331252 12306 raft_consensus.cc:2781] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:15:37.331482 12306 raft_consensus.cc:686] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51 [term 2 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:37.331683 12287 ts_tablet_manager.cc:1398] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 08:15:37.331720 12306 consensus_queue.cc:237] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 197, Committed index: 197, Last appended: 1.197, Last appended by leader: 197, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:37.331916 12287 tablet_bootstrap.cc:492] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:37.334005 11963 catalog_manager.cc:5484] T 0159f995b6cb48598464969bc8993199 P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:37.495622 12287 tablet_bootstrap.cc:492] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51: Bootstrap replayed 1/1 log segments. Stats: ops{read=185 overwritten=0 applied=185 ignored=0} inserts{seen=474 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:15:37.496026 12287 tablet_bootstrap.cc:492] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51: Bootstrap complete.
I20240503 08:15:37.496809 12287 ts_tablet_manager.cc:1367] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.165s user 0.131s sys 0.032s
I20240503 08:15:37.497387 12287 raft_consensus.cc:348] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:37.497561 12287 raft_consensus.cc:729] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:37.497785 12287 consensus_queue.cc:260] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 185, Last appended: 1.185, Last appended by leader: 185, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:37.497939 12287 raft_consensus.cc:388] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:37.498011 12287 raft_consensus.cc:482] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:37.498109 12287 raft_consensus.cc:3037] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:15:37.499837 12287 raft_consensus.cc:504] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:37.500038 12287 leader_election.cc:302] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:37.500206 12287 leader_election.cc:288] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:15:37.500298 12306 raft_consensus.cc:2781] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:15:37.500509 12306 raft_consensus.cc:686] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51 [term 2 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:37.500627 12287 ts_tablet_manager.cc:1398] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 08:15:37.500842 12287 tablet_bootstrap.cc:492] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:37.500761 12306 consensus_queue.cc:237] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 185, Committed index: 185, Last appended: 1.185, Last appended by leader: 185, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:37.503568 11963 catalog_manager.cc:5484] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:37.671267 12287 tablet_bootstrap.cc:492] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51: Bootstrap replayed 1/1 log segments. Stats: ops{read=187 overwritten=0 applied=187 ignored=0} inserts{seen=515 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:15:37.671712 12287 tablet_bootstrap.cc:492] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51: Bootstrap complete.
I20240503 08:15:37.672446 12287 ts_tablet_manager.cc:1367] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.172s user 0.155s sys 0.016s
I20240503 08:15:37.673077 12287 raft_consensus.cc:348] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:37.673219 12287 raft_consensus.cc:729] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:37.673421 12287 consensus_queue.cc:260] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 187, Last appended: 1.187, Last appended by leader: 187, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:37.673560 12287 raft_consensus.cc:388] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:37.673651 12287 raft_consensus.cc:482] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:37.673730 12287 raft_consensus.cc:3037] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:15:37.675520 12287 raft_consensus.cc:504] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:37.675711 12287 leader_election.cc:302] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:37.675889 12287 leader_election.cc:288] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:15:37.675935 12306 raft_consensus.cc:2781] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:15:37.676141 12306 raft_consensus.cc:686] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51 [term 2 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:37.676405 12287 ts_tablet_manager.cc:1398] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20240503 08:15:37.676394 12306 consensus_queue.cc:237] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 187, Committed index: 187, Last appended: 1.187, Last appended by leader: 187, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:37.676741 12287 tablet_bootstrap.cc:492] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:37.679718 11963 catalog_manager.cc:5484] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:37.849942 12287 tablet_bootstrap.cc:492] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51: Bootstrap replayed 1/1 log segments. Stats: ops{read=193 overwritten=0 applied=193 ignored=0} inserts{seen=533 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:15:37.850364 12287 tablet_bootstrap.cc:492] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51: Bootstrap complete.
I20240503 08:15:37.851125 12287 ts_tablet_manager.cc:1367] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.174s user 0.151s sys 0.020s
I20240503 08:15:37.851764 12287 raft_consensus.cc:348] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:37.851928 12287 raft_consensus.cc:729] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:37.852149 12287 consensus_queue.cc:260] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 193, Last appended: 1.193, Last appended by leader: 193, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:37.852295 12287 raft_consensus.cc:388] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:37.852365 12287 raft_consensus.cc:482] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:37.852468 12287 raft_consensus.cc:3037] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:15:37.854198 12287 raft_consensus.cc:504] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:37.854411 12287 leader_election.cc:302] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:37.854576 12287 leader_election.cc:288] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:15:37.854677 12306 raft_consensus.cc:2781] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:15:37.854862 12306 raft_consensus.cc:686] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51 [term 2 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:37.855020 12287 ts_tablet_manager.cc:1398] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 08:15:37.855067 12306 consensus_queue.cc:237] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 193, Committed index: 193, Last appended: 1.193, Last appended by leader: 193, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:37.855222 12287 tablet_bootstrap.cc:492] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51: Bootstrap starting.
I20240503 08:15:37.857664 11963 catalog_manager.cc:5484] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:38.027561 12287 tablet_bootstrap.cc:492] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51: Bootstrap replayed 1/1 log segments. Stats: ops{read=191 overwritten=0 applied=191 ignored=0} inserts{seen=504 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:15:38.027981 12287 tablet_bootstrap.cc:492] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51: Bootstrap complete.
I20240503 08:15:38.028738 12287 ts_tablet_manager.cc:1367] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51: Time spent bootstrapping tablet: real 0.174s user 0.164s sys 0.008s
I20240503 08:15:38.029382 12287 raft_consensus.cc:348] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:38.029527 12287 raft_consensus.cc:729] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Initialized, Role: FOLLOWER
I20240503 08:15:38.029747 12287 consensus_queue.cc:260] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 191, Last appended: 1.191, Last appended by leader: 191, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:38.029878 12287 raft_consensus.cc:388] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:15:38.029963 12287 raft_consensus.cc:482] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:15:38.030040 12287 raft_consensus.cc:3037] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:15:38.031790 12287 raft_consensus.cc:504] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:38.031996 12287 leader_election.cc:302] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66effc59fb9c44b19404f557486cef51; no voters:
I20240503 08:15:38.032176 12287 leader_election.cc:288] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240503 08:15:38.032235 12306 raft_consensus.cc:2781] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:15:38.032464 12306 raft_consensus.cc:686] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51 [term 2 LEADER]: Becoming Leader. State: Replica: 66effc59fb9c44b19404f557486cef51, State: Running, Role: LEADER
I20240503 08:15:38.032599 12287 ts_tablet_manager.cc:1398] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240503 08:15:38.032712 12306 consensus_queue.cc:237] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 191, Committed index: 191, Last appended: 1.191, Last appended by leader: 191, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } }
I20240503 08:15:38.034902 11963 catalog_manager.cc:5484] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "66effc59fb9c44b19404f557486cef51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66effc59fb9c44b19404f557486cef51" member_type: VOTER last_known_addr { host: "127.7.84.129" port: 35923 } health_report { overall_health: HEALTHY } } }
I20240503 08:15:38.180282 12373 ts_tablet_manager.cc:902] T 7126547fbe1e4f8394e4083af0ab61de P a07199bd73484340962d1be07a60fdf7: Initiating tablet copy from peer 66effc59fb9c44b19404f557486cef51 (127.7.84.129:35923)
I20240503 08:15:38.181949 12375 ts_tablet_manager.cc:902] T 566e0891d2b6410a97f16552e6f26200 P a07199bd73484340962d1be07a60fdf7: Initiating tablet copy from peer 66effc59fb9c44b19404f557486cef51 (127.7.84.129:35923)
I20240503 08:15:38.183056 12376 ts_tablet_manager.cc:902] T 4adc74175f5c413b8cfaef8c65fcf75a P a07199bd73484340962d1be07a60fdf7: Initiating tablet copy from peer 66effc59fb9c44b19404f557486cef51 (127.7.84.129:35923)
I20240503 08:15:38.184242 12377 ts_tablet_manager.cc:902] T 7068b2d26c594f10afee195baf075d31 P a07199bd73484340962d1be07a60fdf7: Initiating tablet copy from peer 66effc59fb9c44b19404f557486cef51 (127.7.84.129:35923)
I20240503 08:15:38.185309 12380 ts_tablet_manager.cc:902] T 4eef8f99866f4d479a83a5403000a519 P a07199bd73484340962d1be07a60fdf7: Initiating tablet copy from peer 66effc59fb9c44b19404f557486cef51 (127.7.84.129:35923)
I20240503 08:15:38.186304 12374 ts_tablet_manager.cc:902] T 5702520a1d1042d9b535edbd656ee0b3 P a07199bd73484340962d1be07a60fdf7: Initiating tablet copy from peer 66effc59fb9c44b19404f557486cef51 (127.7.84.129:35923)
I20240503 08:15:38.187323 12372 ts_tablet_manager.cc:902] T 5374069fd60d43319b14cd44331e39cb P a07199bd73484340962d1be07a60fdf7: Initiating tablet copy from peer 66effc59fb9c44b19404f557486cef51 (127.7.84.129:35923)
I20240503 08:15:38.188304 12378 ts_tablet_manager.cc:902] T d7b8fb82aab144b3bb85c84d4a9e99a5 P a07199bd73484340962d1be07a60fdf7: Initiating tablet copy from peer 66effc59fb9c44b19404f557486cef51 (127.7.84.129:35923)
I20240503 08:15:38.189296 12381 ts_tablet_manager.cc:902] T ea52b951a87f4438a88cfa95d9c98909 P a07199bd73484340962d1be07a60fdf7: Initiating tablet copy from peer 66effc59fb9c44b19404f557486cef51 (127.7.84.129:35923)
I20240503 08:15:38.190261 12382 ts_tablet_manager.cc:902] T b850787712a842b0b953840254c4f427 P a07199bd73484340962d1be07a60fdf7: Initiating tablet copy from peer 66effc59fb9c44b19404f557486cef51 (127.7.84.129:35923)
I20240503 08:15:38.191188 12379 ts_tablet_manager.cc:902] T 11ca588428804add9a829ef0fdc24056 P a07199bd73484340962d1be07a60fdf7: Initiating tablet copy from peer 66effc59fb9c44b19404f557486cef51 (127.7.84.129:35923)
I20240503 08:15:38.262174 12370 ts_tablet_manager.cc:902] T 8108e738b39d4299884da3c35259cea1 P a07199bd73484340962d1be07a60fdf7: Initiating tablet copy from peer 66effc59fb9c44b19404f557486cef51 (127.7.84.129:35923)
I20240503 08:15:38.263288 12371 ts_tablet_manager.cc:902] T 8f2201d7e2014776baa5b130bcd0fa6b P a07199bd73484340962d1be07a60fdf7: Initiating tablet copy from peer 66effc59fb9c44b19404f557486cef51 (127.7.84.129:35923)
I20240503 08:15:38.269081 12417 ts_tablet_manager.cc:902] T d9923bef86d64d169d9d872203a5ed32 P a07199bd73484340962d1be07a60fdf7: Initiating tablet copy from peer 66effc59fb9c44b19404f557486cef51 (127.7.84.129:35923)
I20240503 08:15:38.281760 12435 ts_tablet_manager.cc:902] T 898e17c25d4c4c2d8ad8d81d56436be9 P a07199bd73484340962d1be07a60fdf7: Initiating tablet copy from peer 66effc59fb9c44b19404f557486cef51 (127.7.84.129:35923)
I20240503 08:15:38.309616 12378 tablet_copy_client.cc:308] T d7b8fb82aab144b3bb85c84d4a9e99a5 P a07199bd73484340962d1be07a60fdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:35923
I20240503 08:15:38.310570 12377 tablet_copy_client.cc:308] T 7068b2d26c594f10afee195baf075d31 P a07199bd73484340962d1be07a60fdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:35923
I20240503 08:15:38.311177 12376 tablet_copy_client.cc:308] T 4adc74175f5c413b8cfaef8c65fcf75a P a07199bd73484340962d1be07a60fdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:35923
I20240503 08:15:38.321624 12379 tablet_copy_client.cc:308] T 11ca588428804add9a829ef0fdc24056 P a07199bd73484340962d1be07a60fdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:35923
I20240503 08:15:38.322167 12380 tablet_copy_client.cc:308] T 4eef8f99866f4d479a83a5403000a519 P a07199bd73484340962d1be07a60fdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:35923
I20240503 08:15:38.322618 12381 tablet_copy_client.cc:308] T ea52b951a87f4438a88cfa95d9c98909 P a07199bd73484340962d1be07a60fdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:35923
I20240503 08:15:38.323078 12373 tablet_copy_client.cc:308] T 7126547fbe1e4f8394e4083af0ab61de P a07199bd73484340962d1be07a60fdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:35923
I20240503 08:15:38.323575 12374 tablet_copy_client.cc:308] T 5702520a1d1042d9b535edbd656ee0b3 P a07199bd73484340962d1be07a60fdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:35923
I20240503 08:15:38.324040 12417 tablet_copy_client.cc:308] T d9923bef86d64d169d9d872203a5ed32 P a07199bd73484340962d1be07a60fdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:35923
I20240503 08:15:38.324473 12375 tablet_copy_client.cc:308] T 566e0891d2b6410a97f16552e6f26200 P a07199bd73484340962d1be07a60fdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:35923
I20240503 08:15:38.324930 12372 tablet_copy_client.cc:308] T 5374069fd60d43319b14cd44331e39cb P a07199bd73484340962d1be07a60fdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:35923
I20240503 08:15:38.325345 12382 tablet_copy_client.cc:308] T b850787712a842b0b953840254c4f427 P a07199bd73484340962d1be07a60fdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:35923
I20240503 08:15:38.329699 12370 tablet_copy_client.cc:308] T 8108e738b39d4299884da3c35259cea1 P a07199bd73484340962d1be07a60fdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:35923
I20240503 08:15:38.330519 12422 ts_tablet_manager.cc:902] T e407576b763a4d3db8efa96817b0e536 P a07199bd73484340962d1be07a60fdf7: Initiating tablet copy from peer 66effc59fb9c44b19404f557486cef51 (127.7.84.129:35923)
I20240503 08:15:38.331249 12371 tablet_copy_client.cc:308] T 8f2201d7e2014776baa5b130bcd0fa6b P a07199bd73484340962d1be07a60fdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:35923
I20240503 08:15:38.332922 12453 ts_tablet_manager.cc:902] T 94e61f0486e040fb810ce305b925b5af P a07199bd73484340962d1be07a60fdf7: Initiating tablet copy from peer 66effc59fb9c44b19404f557486cef51 (127.7.84.129:35923)
F20240503 08:15:38.334203 12453 trace_metrics.cc:68] Check failed: g_intern_map->size() < 100 (100 vs. 100) Too many interned strings: (MaintenanceMgr.queue_time_us, MaintenanceMgr.queue_time_us) (MaintenanceMgr.run_cpu_time_us, MaintenanceMgr.run_cpu_time_us) (MaintenanceMgr.run_wall_time_us, MaintenanceMgr.run_wall_time_us) (apply.queue_time_us, apply.queue_time_us) (apply.run_cpu_time_us, apply.run_cpu_time_us) (apply.run_wall_time_us, apply.run_wall_time_us) (client-negotiator.queue_time_us, client-negotiator.queue_time_us) (client-negotiator.run_cpu_time_us, client-negotiator.run_cpu_time_us) (client-negotiator.run_wall_time_us, client-negotiator.run_wall_time_us) (compiler_manager_pool.queue_time_us, compiler_manager_pool.queue_time_us) (compiler_manager_pool.run_cpu_time_us, compiler_manager_pool.run_cpu_time_us) (compiler_manager_pool.run_wall_time_us, compiler_manager_pool.run_wall_time_us) (dirs.queue_time_us, dirs.queue_time_us) (dirs.run_cpu_time_us, dirs.run_cpu_time_us) (dirs.run_wall_time_us, dirs.run_wall_time_us) (dns-resolver.queue_time_us, dns-resolver.queue_time_us) (dns-resolver.run_cpu_time_us, dns-resolver.run_cpu_time_us) (dns-resolver.run_wall_time_us, dns-resolver.run_wall_time_us) (prepare.queue_time_us, prepare.queue_time_us) (prepare.run_cpu_time_us, prepare.run_cpu_time_us) (prepare.run_wall_time_us, prepare.run_wall_time_us) (raft.queue_time_us, raft.queue_time_us) (raft.run_cpu_time_us, raft.run_cpu_time_us) (raft.run_wall_time_us, raft.run_wall_time_us) (repair_pool.queue_time_us, repair_pool.queue_time_us) (repair_pool.run_cpu_time_us, repair_pool.run_cpu_time_us) (repair_pool.run_wall_time_us, repair_pool.run_wall_time_us) (server-negotiator.queue_time_us, server-negotiator.queue_time_us) (server-negotiator.run_cpu_time_us, server-negotiator.run_cpu_time_us) (server-negotiator.run_wall_time_us, server-negotiator.run_wall_time_us) (tablet-copy.queue_time_us, tablet-copy.queue_time_us) (tablet-copy.run_cpu_time_us, tablet-copy.run_cpu_time_us) (tablet-copy.run_wall_time_us, tablet-copy.run_wall_time_us) (tablet-delete.queue_time_us, tablet-delete.queue_time_us) (tablet-delete.run_cpu_time_us, tablet-delete.run_cpu_time_us) (tablet-delete.run_wall_time_us, tablet-delete.run_wall_time_us) (tablet-download-pool-11ca588428804add9a829ef0fdc24056.queue_time_us, tablet-download-pool-11ca588428804add9a829ef0fdc24056.queue_time_us) (tablet-download-pool-11ca588428804add9a829ef0fdc24056.run_cpu_time_us, tablet-download-pool-11ca588428804add9a829ef0fdc24056.run_cpu_time_us) (tablet-download-pool-11ca588428804add9a829ef0fdc24056.run_wall_time_us, tablet-download-pool-11ca588428804add9a829ef0fdc24056.run_wall_time_us) (tablet-download-pool-4adc74175f5c413b8cfaef8c65fcf75a.queue_time_us, tablet-download-pool-4adc74175f5c413b8cfaef8c65fcf75a.queue_time_us) (tablet-download-pool-4adc74175f5c413b8cfaef8c65fcf75a.run_cpu_time_us, tablet-download-pool-4adc74175f5c413b8cfaef8c65fcf75a.run_cpu_time_us) (tablet-download-pool-4adc74175f5c413b8cfaef8c65fcf75a.run_wall_time_us, tablet-download-pool-4adc74175f5c413b8cfaef8c65fcf75a.run_wall_time_us) (tablet-download-pool-4eef8f99866f4d479a83a5403000a519.queue_time_us, tablet-download-pool-4eef8f99866f4d479a83a5403000a519.queue_time_us) (tablet-download-pool-4eef8f99866f4d479a83a5403000a519.run_cpu_time_us, tablet-download-pool-4eef8f99866f4d479a83a5403000a519.run_cpu_time_us) (tablet-download-pool-4eef8f99866f4d479a83a5403000a519.run_wall_time_us, tablet-download-pool-4eef8f99866f4d479a83a5403000a519.run_wall_time_us) (tablet-download-pool-5374069fd60d43319b14cd44331e39cb.queue_time_us, tablet-download-pool-5374069fd60d43319b14cd44331e39cb.queue_time_us) (tablet-download-pool-5374069fd60d43319b14cd44331e39cb.run_cpu_time_us, tablet-download-pool-5374069fd60d43319b14cd44331e39cb.run_cpu_time_us) (tablet-download-pool-5374069fd60d43319b14cd44331e39cb.run_wall_time_us, tablet-download-pool-5374069fd60d43319b14cd44331e39cb.run_wall_time_us) (tablet-download-pool-566e0891d2b6410a97f16552e6f26200.queue_time_us, tablet-download-pool-566e0891d2b6410a97f16552e6f26200.queue_time_us) (tablet-download-pool-566e0891d2b6410a97f16552e6f26200.run_cpu_time_us, tablet-download-pool-566e0891d2b6410a97f16552e6f26200.run_cpu_time_us) (tablet-download-pool-566e0891d2b6410a97f16552e6f26200.run_wall_time_us, tablet-download-pool-566e0891d2b6410a97f16552e6f26200.run_wall_time_us) (tablet-download-pool-5702520a1d1042d9b535edbd656ee0b3.queue_time_us, tablet-download-pool-5702520a1d1042d9b535edbd656ee0b3.queue_time_us) (tablet-download-pool-5702520a1d1042d9b535edbd656ee0b3.run_cpu_time_us, tablet-download-pool-5702520a1d1042d9b535edbd656ee0b3.run_cpu_time_us) (tablet-download-pool-5702520a1d1042d9b535edbd656ee0b3.run_wall_time_us, tablet-download-pool-5702520a1d1042d9b535edbd656ee0b3.run_wall_time_us) (tablet-download-pool-7068b2d26c594f10afee195baf075d31.queue_time_us, tablet-download-pool-7068b2d26c594f10afee195baf075d31.queue_time_us) (tablet-download-pool-7068b2d26c594f10afee195baf075d31.run_cpu_time_us, tablet-download-pool-7068b2d26c594f10afee195baf075d31.run_cpu_time_us) (tablet-download-pool-7068b2d26c594f10afee195baf075d31.run_wall_time_us, tablet-download-pool-7068b2d26c594f10afee195baf075d31.run_wall_time_us) (tablet-download-pool-7126547fbe1e4f8394e4083af0ab61de.queue_time_us, tablet-download-pool-7126547fbe1e4f8394e4083af0ab61de.queue_time_us) (tablet-download-pool-7126547fbe1e4f8394e4083af0ab61de.run_cpu_time_us, tablet-download-pool-7126547fbe1e4f8394e4083af0ab61de.run_cpu_time_us) (tablet-download-pool-7126547fbe1e4f8394e4083af0ab61de.run_wall_time_us, tablet-download-pool-7126547fbe1e4f8394e4083af0ab61de.run_wall_time_us) (tablet-download-pool-8108e738b39d4299884da3c35259cea1.queue_time_us, tablet-download-pool-8108e738b39d4299884da3c35259cea1.queue_time_us) (tablet-download-pool-8108e738b39d4299884da3c35259cea1.run_cpu_time_us, tablet-download-pool-8108e738b39d4299884da3c35259cea1.run_cpu_time_us) (tablet-download-pool-8108e738b39d4299884da3c35259cea1.run_wall_time_us, tablet-download-pool-8108e738b39d4299884da3c35259cea1.run_wall_time_us) (tablet-download-pool-898e17c25d4c4c2d8ad8d81d56436be9.queue_time_us, tablet-download-pool-898e17c25d4c4c2d8ad8d81d56436be9.queue_time_us) (tablet-download-pool-898e17c25d4c4c2d8ad8d81d56436be9.run_cpu_time_us, tablet-download-pool-898e17c25d4c4c2d8ad8d81d56436be9.run_cpu_time_us) (tablet-download-pool-898e17c25d4c4c2d8ad8d81d56436be9.run_wall_time_us, tablet-download-pool-898e17c25d4c4c2d8ad8d81d56436be9.run_wall_time_us) (tablet-download-pool-8f2201d7e2014776baa5b130bcd0fa6b.queue_time_us, tablet-download-pool-8f2201d7e2014776baa5b130bcd0fa6b.queue_time_us) (tablet-download-pool-8f2201d7e2014776baa5b130bcd0fa6b.run_cpu_time_us, tablet-download-pool-8f2201d7e2014776baa5b130bcd0fa6b.run_cpu_time_us) (tablet-download-pool-8f2201d7e2014776baa5b130bcd0fa6b.run_wall_time_us, tablet-download-pool-8f2201d7e2014776baa5b130bcd0fa6b.run_wall_time_us) (tablet-download-pool-94e61f0486e040fb810ce305b925b5af.queue_time_us, tablet-download-pool-94e61f0486e040fb810ce305b925b5af.queue_time_us) (tablet-download-pool-b850787712a842b0b953840254c4f427.queue_time_us, tablet-download-pool-b850787712a842b0b953840254c4f427.queue_time_us) (tablet-download-pool-b850787712a842b0b953840254c4f427.run_cpu_time_us, tablet-download-pool-b850787712a842b0b953840254c4f427.run_cpu_time_us) (tablet-download-pool-b850787712a842b0b953840254c4f427.run_wall_time_us, tablet-download-pool-b850787712a842b0b953840254c4f427.run_wall_time_us) (tablet-download-pool-d7b8fb82aab144b3bb85c84d4a9e99a5.queue_time_us, tablet-download-pool-d7b8fb82aab144b3bb85c84d4a9e99a5.queue_time_us) (tablet-download-pool-d7b8fb82aab144b3bb85c84d4a9e99a5.run_cpu_time_us, tablet-download-pool-d7b8fb82aab144b3bb85c84d4a9e99a5.run_cpu_time_us) (tablet-download-pool-d7b8fb82aab144b3bb85c84d4a9e99a5.run_wall_time_us, tablet-download-pool-d7b8fb82aab144b3bb85c84d4a9e99a5.run_wall_time_us) (tablet-download-pool-d9923bef86d64d169d9d872203a5ed32.queue_time_us, tablet-download-pool-d9923bef86d64d169d9d872203a5ed32.queue_time_us) (tablet-download-pool-d9923bef86d64d169d9d872203a5ed32.run_cpu_time_us, tablet-download-pool-d9923bef86d64d169d9d872203a5ed32.run_cpu_time_us) (tablet-download-pool-d9923bef86d64d169d9d872203a5ed32.run_wall_time_us, tablet-download-pool-d9923bef86d64d169d9d872203a5ed32.run_wall_time_us) (tablet-download-pool-e407576b763a4d3db8efa96817b0e536.queue_time_us, tablet-download-pool-e407576b763a4d3db8efa96817b0e536.queue_time_us) (tablet-download-pool-e407576b763a4d3db8efa96817b0e536.run_cpu_time_us, tablet-download-pool-e407576b763a4d3db8efa96817b0e536.run_cpu_time_us) (tablet-download-pool-e407576b763a4d3db8efa96817b0e536.run_wall_time_us, tablet-download-pool-e407576b763a4d3db8efa96817b0e536.run_wall_time_us) (tablet-download-pool-ea52b951a87f4438a88cfa95d9c98909.queue_time_us, tablet-download-pool-ea52b951a87f4438a88cfa95d9c98909.queue_time_us) (tablet-download-pool-ea52b951a87f4438a88cfa95d9c98909.run_cpu_time_us, tablet-download-pool-ea52b951a87f4438a88cfa95d9c98909.run_cpu_time_us) (tablet-download-pool-ea52b951a87f4438a88cfa95d9c98909.run_wall_time_us, tablet-download-pool-ea52b951a87f4438a88cfa95d9c98909.run_wall_time_us) (tablet-open.queue_time_us, tablet-open.queue_time_us) (tablet-open.run_cpu_time_us, tablet-open.run_cpu_time_us) (tablet-open.run_wall_time_us, tablet-open.run_wall_time_us) (txn-commit.queue_time_us, txn-commit.queue_time_us) (txn-commit.run_cpu_time_us, txn-commit.run_cpu_time_us) (txn-commit.run_wall_time_us, txn-commit.run_wall_time_us) (txn-participant-registration.queue_time_us, txn-participant-registration.queue_time_us) (txn-participant-registration.run_cpu_time_us, txn-participant-registration.run_cpu_time_us) (txn-participant-registration.run_wall_time_us, txn-participant-registration.run_wall_time_us) (txn-status-manager.queue_time_us, txn-status-manager.queue_time_us) (txn-status-manager.run_cpu_time_us, txn-status-manager.run_cpu_time_us) (txn-status-manager.run_wall_time_us, txn-status-manager.run_wall_time_us) (txn-status-tablet-reload.queue_time_us, txn-status-tablet-reload.queue_time_us) (txn-status-tablet-reload.run_cpu_time_us, txn-status-tablet-reload.run_cpu_time_us) (txn-status-tablet-reload.run_wall_time_us, txn-status-tablet-reload.run_wall_time_us)
I20240503 08:15:38.336192 12435 tablet_copy_client.cc:308] T 898e17c25d4c4c2d8ad8d81d56436be9 P a07199bd73484340962d1be07a60fdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:35923
*** Check failure stack trace: ***
W20240503 08:15:38.339772 12281 service_pool.cc:135] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items.
I20240503 08:15:38.340152 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 1)
@ 0x7f67f3b84dcd google::LogMessage::Fail() at ??:0
I20240503 08:15:38.340605 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 1)
I20240503 08:15:38.340878 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 1)
I20240503 08:15:38.341125 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 1)
I20240503 08:15:38.341346 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 1)
I20240503 08:15:38.341579 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 1)
I20240503 08:15:38.341811 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 1)
I20240503 08:15:38.342070 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 1)
I20240503 08:15:38.342298 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 1)
@ 0x7f67f3b88b93 google::LogMessage::SendToLog() at ??:0
I20240503 08:15:38.342551 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 1)
I20240503 08:15:38.342810 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 1)
I20240503 08:15:38.343063 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 1)
I20240503 08:15:38.343300 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 1)
I20240503 08:15:38.343788 12293 tablet_copy_service.cc:140] P 66effc59fb9c44b19404f557486cef51: Received BeginTabletCopySession request for tablet 7068b2d26c594f10afee195baf075d31 from peer a07199bd73484340962d1be07a60fdf7 ({username='slave'} at 127.7.84.130:52693)
I20240503 08:15:38.344024 12293 tablet_copy_service.cc:161] P 66effc59fb9c44b19404f557486cef51: Beginning new tablet copy session on tablet 7068b2d26c594f10afee195baf075d31 from peer a07199bd73484340962d1be07a60fdf7 at {username='slave'} at 127.7.84.130:52693: session id = a07199bd73484340962d1be07a60fdf7-7068b2d26c594f10afee195baf075d31
@ 0x7f67f3b847cc google::LogMessage::Flush() at ??:0
I20240503 08:15:38.351505 12293 tablet_copy_source_session.cc:205] T 7068b2d26c594f10afee195baf075d31 P 66effc59fb9c44b19404f557486cef51: Tablet Copy: opened 0 blocks and 1 log segments
@ 0x7f67f3b85f59 google::LogMessageFatal::~LogMessageFatal() at ??:0
I20240503 08:15:38.352759 12293 tablet_copy_service.cc:140] P 66effc59fb9c44b19404f557486cef51: Received BeginTabletCopySession request for tablet d7b8fb82aab144b3bb85c84d4a9e99a5 from peer a07199bd73484340962d1be07a60fdf7 ({username='slave'} at 127.7.84.130:52693)
I20240503 08:15:38.352934 12293 tablet_copy_service.cc:161] P 66effc59fb9c44b19404f557486cef51: Beginning new tablet copy session on tablet d7b8fb82aab144b3bb85c84d4a9e99a5 from peer a07199bd73484340962d1be07a60fdf7 at {username='slave'} at 127.7.84.130:52693: session id = a07199bd73484340962d1be07a60fdf7-d7b8fb82aab144b3bb85c84d4a9e99a5
@ 0x7f67f68c5742 kudu::TraceMetrics::InternName() at ??:0
I20240503 08:15:38.362075 12293 tablet_copy_source_session.cc:205] T d7b8fb82aab144b3bb85c84d4a9e99a5 P 66effc59fb9c44b19404f557486cef51: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:15:38.363549 12377 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7068b2d26c594f10afee195baf075d31. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:38.364059 12378 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7b8fb82aab144b3bb85c84d4a9e99a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:38.367000 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 16)
I20240503 08:15:38.367353 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 16)
I20240503 08:15:38.367744 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 19)
I20240503 08:15:38.369189 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 19)
I20240503 08:15:38.369493 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 19)
I20240503 08:15:38.369752 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 19)
I20240503 08:15:38.370038 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 19)
I20240503 08:15:38.370296 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 19)
I20240503 08:15:38.370535 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 19)
I20240503 08:15:38.370779 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 19)
I20240503 08:15:38.371074 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 19)
I20240503 08:15:38.372228 12293 tablet_copy_service.cc:140] P 66effc59fb9c44b19404f557486cef51: Received BeginTabletCopySession request for tablet 4adc74175f5c413b8cfaef8c65fcf75a from peer a07199bd73484340962d1be07a60fdf7 ({username='slave'} at 127.7.84.130:52693)
I20240503 08:15:38.372383 12293 tablet_copy_service.cc:161] P 66effc59fb9c44b19404f557486cef51: Beginning new tablet copy session on tablet 4adc74175f5c413b8cfaef8c65fcf75a from peer a07199bd73484340962d1be07a60fdf7 at {username='slave'} at 127.7.84.130:52693: session id = a07199bd73484340962d1be07a60fdf7-4adc74175f5c413b8cfaef8c65fcf75a
I20240503 08:15:38.375037 12456 ts_tablet_manager.cc:902] T 3be99879a9d5456da5fa6f0f2c6bab19 P a07199bd73484340962d1be07a60fdf7: Initiating tablet copy from peer 66effc59fb9c44b19404f557486cef51 (127.7.84.129:35923)
I20240503 08:15:38.377077 12293 tablet_copy_source_session.cc:205] T 4adc74175f5c413b8cfaef8c65fcf75a P 66effc59fb9c44b19404f557486cef51: Tablet Copy: opened 0 blocks and 1 log segments
@ 0x7f67f6891f8b kudu::ThreadPool::ThreadPool() at ??:0
I20240503 08:15:38.382419 12378 tablet_copy_client.cc:783] T d7b8fb82aab144b3bb85c84d4a9e99a5 P a07199bd73484340962d1be07a60fdf7: tablet copy: Starting download of 0 data blocks...
@ 0x7f67f688bcd6 kudu::ThreadPoolBuilder::Build() at ??:0
I20240503 08:15:38.383258 12378 tablet_copy_client.cc:647] T d7b8fb82aab144b3bb85c84d4a9e99a5 P a07199bd73484340962d1be07a60fdf7: tablet copy: Starting download of 1 WAL segments...
I20240503 08:15:38.383553 12376 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4adc74175f5c413b8cfaef8c65fcf75a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:38.385048 12281 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 19)
I20240503 08:15:38.390004 12376 tablet_copy_client.cc:783] T 4adc74175f5c413b8cfaef8c65fcf75a P a07199bd73484340962d1be07a60fdf7: tablet copy: Starting download of 0 data blocks...
I20240503 08:15:38.390252 12376 tablet_copy_client.cc:647] T 4adc74175f5c413b8cfaef8c65fcf75a P a07199bd73484340962d1be07a60fdf7: tablet copy: Starting download of 1 WAL segments...
I20240503 08:15:38.390480 12293 tablet_copy_service.cc:140] P 66effc59fb9c44b19404f557486cef51: Received BeginTabletCopySession request for tablet 11ca588428804add9a829ef0fdc24056 from peer a07199bd73484340962d1be07a60fdf7 ({username='slave'} at 127.7.84.130:52693)
I20240503 08:15:38.390630 12293 tablet_copy_service.cc:161] P 66effc59fb9c44b19404f557486cef51: Beginning new tablet copy session on tablet 11ca588428804add9a829ef0fdc24056 from peer a07199bd73484340962d1be07a60fdf7 at {username='slave'} at 127.7.84.130:52693: session id = a07199bd73484340962d1be07a60fdf7-11ca588428804add9a829ef0fdc24056
I20240503 08:15:38.391942 12281 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.7.84.130:52693 (request call id 29)
I20240503 08:15:38.392762 12281 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 31)
I20240503 08:15:38.393422 12293 tablet_copy_source_session.cc:205] T 11ca588428804add9a829ef0fdc24056 P 66effc59fb9c44b19404f557486cef51: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:15:38.393443 12462 ts_tablet_manager.cc:902] T 63da2aa91161466595ed8f191427a9c7 P a07199bd73484340962d1be07a60fdf7: Initiating tablet copy from peer 66effc59fb9c44b19404f557486cef51 (127.7.84.129:35923)
I20240503 08:15:38.393832 12293 tablet_copy_service.cc:140] P 66effc59fb9c44b19404f557486cef51: Received BeginTabletCopySession request for tablet 566e0891d2b6410a97f16552e6f26200 from peer a07199bd73484340962d1be07a60fdf7 ({username='slave'} at 127.7.84.130:52693)
I20240503 08:15:38.393954 12293 tablet_copy_service.cc:161] P 66effc59fb9c44b19404f557486cef51: Beginning new tablet copy session on tablet 566e0891d2b6410a97f16552e6f26200 from peer a07199bd73484340962d1be07a60fdf7 at {username='slave'} at 127.7.84.130:52693: session id = a07199bd73484340962d1be07a60fdf7-566e0891d2b6410a97f16552e6f26200
I20240503 08:15:38.395038 12379 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11ca588428804add9a829ef0fdc24056. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:38.395529 12377 tablet_copy_client.cc:783] T 7068b2d26c594f10afee195baf075d31 P a07199bd73484340962d1be07a60fdf7: tablet copy: Starting download of 0 data blocks...
I20240503 08:15:38.396829 12377 tablet_copy_client.cc:647] T 7068b2d26c594f10afee195baf075d31 P a07199bd73484340962d1be07a60fdf7: tablet copy: Starting download of 1 WAL segments...
I20240503 08:15:38.400357 12293 tablet_copy_source_session.cc:205] T 566e0891d2b6410a97f16552e6f26200 P 66effc59fb9c44b19404f557486cef51: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:15:38.401047 12281 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.7.84.130:52693 (request call id 34)
I20240503 08:15:38.401360 12281 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 35)
@ 0x7f6805cdf8de kudu::tserver::TabletCopyClient::TabletCopyClient() at ??:0
I20240503 08:15:38.402429 12375 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 566e0891d2b6410a97f16552e6f26200. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:38.408130 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 35)
I20240503 08:15:38.408402 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 35)
I20240503 08:15:38.406986 12460 ts_tablet_manager.cc:902] T 0159f995b6cb48598464969bc8993199 P a07199bd73484340962d1be07a60fdf7: Initiating tablet copy from peer 66effc59fb9c44b19404f557486cef51 (127.7.84.129:35923)
I20240503 08:15:38.408679 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 35)
I20240503 08:15:38.408941 12281 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 35)
I20240503 08:15:38.410249 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 35)
I20240503 08:15:38.410619 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 35)
I20240503 08:15:38.410943 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 42)
I20240503 08:15:38.413822 12379 tablet_copy_client.cc:783] T 11ca588428804add9a829ef0fdc24056 P a07199bd73484340962d1be07a60fdf7: tablet copy: Starting download of 0 data blocks...
I20240503 08:15:38.414094 12379 tablet_copy_client.cc:647] T 11ca588428804add9a829ef0fdc24056 P a07199bd73484340962d1be07a60fdf7: tablet copy: Starting download of 1 WAL segments...
I20240503 08:15:38.414433 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 42)
I20240503 08:15:38.414932 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 42)
I20240503 08:15:38.415606 12293 tablet_copy_service.cc:140] P 66effc59fb9c44b19404f557486cef51: Received BeginTabletCopySession request for tablet 7126547fbe1e4f8394e4083af0ab61de from peer a07199bd73484340962d1be07a60fdf7 ({username='slave'} at 127.7.84.130:52693)
I20240503 08:15:38.415763 12293 tablet_copy_service.cc:161] P 66effc59fb9c44b19404f557486cef51: Beginning new tablet copy session on tablet 7126547fbe1e4f8394e4083af0ab61de from peer a07199bd73484340962d1be07a60fdf7 at {username='slave'} at 127.7.84.130:52693: session id = a07199bd73484340962d1be07a60fdf7-7126547fbe1e4f8394e4083af0ab61de
I20240503 08:15:38.415982 12422 tablet_copy_client.cc:308] T e407576b763a4d3db8efa96817b0e536 P a07199bd73484340962d1be07a60fdf7: tablet copy: Beginning tablet copy session from remote peer at address 127.7.84.129:35923
@ 0x7f6805cf7daf kudu::tserver::RemoteTabletCopyClient::RemoteTabletCopyClient() at ??:0
I20240503 08:15:38.416435 12375 tablet_copy_client.cc:783] T 566e0891d2b6410a97f16552e6f26200 P a07199bd73484340962d1be07a60fdf7: tablet copy: Starting download of 0 data blocks...
I20240503 08:15:38.416805 12375 tablet_copy_client.cc:647] T 566e0891d2b6410a97f16552e6f26200 P a07199bd73484340962d1be07a60fdf7: tablet copy: Starting download of 1 WAL segments...
I20240503 08:15:38.416814 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 42)
I20240503 08:15:38.418524 12293 tablet_copy_source_session.cc:205] T 7126547fbe1e4f8394e4083af0ab61de P 66effc59fb9c44b19404f557486cef51: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:15:38.418813 12281 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
I20240503 08:15:38.418922 12293 tablet_copy_service.cc:140] P 66effc59fb9c44b19404f557486cef51: Received BeginTabletCopySession request for tablet d9923bef86d64d169d9d872203a5ed32 from peer a07199bd73484340962d1be07a60fdf7 ({username='slave'} at 127.7.84.130:52693)
I20240503 08:15:38.419054 12293 tablet_copy_service.cc:161] P 66effc59fb9c44b19404f557486cef51: Beginning new tablet copy session on tablet d9923bef86d64d169d9d872203a5ed32 from peer a07199bd73484340962d1be07a60fdf7 at {username='slave'} at 127.7.84.130:52693: session id = a07199bd73484340962d1be07a60fdf7-d9923bef86d64d169d9d872203a5ed32
I20240503 08:15:38.419878 12373 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7126547fbe1e4f8394e4083af0ab61de. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f6805e22480 kudu::tserver::TSTabletManager::RunTabletCopy() at ??:0
I20240503 08:15:38.424636 12281 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.7.84.130:52693 (request call id 48)
I20240503 08:15:38.428229 12281 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 49)
@ 0x7f6805e5aa8d kudu::tserver::TabletCopyRunnable::Run() at ??:0
I20240503 08:15:38.428936 12281 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 49)
I20240503 08:15:38.430240 12293 tablet_copy_source_session.cc:205] T d9923bef86d64d169d9d872203a5ed32 P 66effc59fb9c44b19404f557486cef51: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:15:38.430526 12281 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 49)
I20240503 08:15:38.430668 12293 tablet_copy_service.cc:140] P 66effc59fb9c44b19404f557486cef51: Received BeginTabletCopySession request for tablet e407576b763a4d3db8efa96817b0e536 from peer a07199bd73484340962d1be07a60fdf7 ({username='slave'} at 127.7.84.130:52693)
I20240503 08:15:38.430757 12373 tablet_copy_client.cc:783] T 7126547fbe1e4f8394e4083af0ab61de P a07199bd73484340962d1be07a60fdf7: tablet copy: Starting download of 0 data blocks...
I20240503 08:15:38.430815 12293 tablet_copy_service.cc:161] P 66effc59fb9c44b19404f557486cef51: Beginning new tablet copy session on tablet e407576b763a4d3db8efa96817b0e536 from peer a07199bd73484340962d1be07a60fdf7 at {username='slave'} at 127.7.84.130:52693: session id = a07199bd73484340962d1be07a60fdf7-e407576b763a4d3db8efa96817b0e536
I20240503 08:15:38.430999 12373 tablet_copy_client.cc:647] T 7126547fbe1e4f8394e4083af0ab61de P a07199bd73484340962d1be07a60fdf7: tablet copy: Starting download of 1 WAL segments...
I20240503 08:15:38.431845 12417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9923bef86d64d169d9d872203a5ed32. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:38.432978 12293 tablet_copy_source_session.cc:205] T e407576b763a4d3db8efa96817b0e536 P 66effc59fb9c44b19404f557486cef51: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:15:38.433975 12422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e407576b763a4d3db8efa96817b0e536. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f6805e3d981 kudu::tserver::TSTabletManager::StartTabletCopy()::$_12::operator()() at ??:0
I20240503 08:15:38.441520 12377 tablet_copy_client.cc:523] T 7068b2d26c594f10afee195baf075d31 P a07199bd73484340962d1be07a60fdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:15:38.443356 12422 tablet_copy_client.cc:783] T e407576b763a4d3db8efa96817b0e536 P a07199bd73484340962d1be07a60fdf7: tablet copy: Starting download of 0 data blocks...
I20240503 08:15:38.443614 12422 tablet_copy_client.cc:647] T e407576b763a4d3db8efa96817b0e536 P a07199bd73484340962d1be07a60fdf7: tablet copy: Starting download of 1 WAL segments...
I20240503 08:15:38.447134 12377 tablet_bootstrap.cc:492] T 7068b2d26c594f10afee195baf075d31 P a07199bd73484340962d1be07a60fdf7: Bootstrap starting.
I20240503 08:15:38.448002 12417 tablet_copy_client.cc:783] T d9923bef86d64d169d9d872203a5ed32 P a07199bd73484340962d1be07a60fdf7: tablet copy: Starting download of 0 data blocks...
I20240503 08:15:38.448237 12417 tablet_copy_client.cc:647] T d9923bef86d64d169d9d872203a5ed32 P a07199bd73484340962d1be07a60fdf7: tablet copy: Starting download of 1 WAL segments...
I20240503 08:15:38.448357 12373 tablet_copy_client.cc:523] T 7126547fbe1e4f8394e4083af0ab61de P a07199bd73484340962d1be07a60fdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:15:38.451790 12373 tablet_bootstrap.cc:492] T 7126547fbe1e4f8394e4083af0ab61de P a07199bd73484340962d1be07a60fdf7: Bootstrap starting.
I20240503 08:15:38.452417 12376 tablet_copy_client.cc:523] T 4adc74175f5c413b8cfaef8c65fcf75a P a07199bd73484340962d1be07a60fdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:15:38.456107 12376 tablet_bootstrap.cc:492] T 4adc74175f5c413b8cfaef8c65fcf75a P a07199bd73484340962d1be07a60fdf7: Bootstrap starting.
I20240503 08:15:38.456962 12281 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.7.84.130:52693 (request call id 57)
I20240503 08:15:38.463513 12281 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 58)
I20240503 08:15:38.463891 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 59)
I20240503 08:15:38.464222 12281 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 59)
I20240503 08:15:38.465951 12281 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 59)
I20240503 08:15:38.468870 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 59)
I20240503 08:15:38.470465 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 59)
I20240503 08:15:38.471150 12293 tablet_copy_service.cc:140] P 66effc59fb9c44b19404f557486cef51: Received BeginTabletCopySession request for tablet 5702520a1d1042d9b535edbd656ee0b3 from peer a07199bd73484340962d1be07a60fdf7 ({username='slave'} at 127.7.84.130:52693)
I20240503 08:15:38.471294 12293 tablet_copy_service.cc:161] P 66effc59fb9c44b19404f557486cef51: Beginning new tablet copy session on tablet 5702520a1d1042d9b535edbd656ee0b3 from peer a07199bd73484340962d1be07a60fdf7 at {username='slave'} at 127.7.84.130:52693: session id = a07199bd73484340962d1be07a60fdf7-5702520a1d1042d9b535edbd656ee0b3
I20240503 08:15:38.471916 12422 tablet_copy_client.cc:523] T e407576b763a4d3db8efa96817b0e536 P a07199bd73484340962d1be07a60fdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:15:38.476472 12422 tablet_bootstrap.cc:492] T e407576b763a4d3db8efa96817b0e536 P a07199bd73484340962d1be07a60fdf7: Bootstrap starting.
@ 0x7f6805e3d70e std::_Function_handler<>::_M_invoke() at ??:0
@ 0xa60bcd std::function<>::operator()() at ??:?
I20240503 08:15:38.483580 12293 tablet_copy_source_session.cc:205] T 5702520a1d1042d9b535edbd656ee0b3 P 66effc59fb9c44b19404f557486cef51: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:15:38.484848 12374 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5702520a1d1042d9b535edbd656ee0b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:38.485201 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 64)
I20240503 08:15:38.487941 12281 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 64)
I20240503 08:15:38.488340 12293 tablet_copy_service.cc:140] P 66effc59fb9c44b19404f557486cef51: Received BeginTabletCopySession request for tablet 4eef8f99866f4d479a83a5403000a519 from peer a07199bd73484340962d1be07a60fdf7 ({username='slave'} at 127.7.84.130:52693)
I20240503 08:15:38.488497 12293 tablet_copy_service.cc:161] P 66effc59fb9c44b19404f557486cef51: Beginning new tablet copy session on tablet 4eef8f99866f4d479a83a5403000a519 from peer a07199bd73484340962d1be07a60fdf7 at {username='slave'} at 127.7.84.130:52693: session id = a07199bd73484340962d1be07a60fdf7-4eef8f99866f4d479a83a5403000a519
I20240503 08:15:38.491590 12293 tablet_copy_source_session.cc:205] T 4eef8f99866f4d479a83a5403000a519 P 66effc59fb9c44b19404f557486cef51: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:15:38.491928 12374 tablet_copy_client.cc:783] T 5702520a1d1042d9b535edbd656ee0b3 P a07199bd73484340962d1be07a60fdf7: tablet copy: Starting download of 0 data blocks...
I20240503 08:15:38.492164 12374 tablet_copy_client.cc:647] T 5702520a1d1042d9b535edbd656ee0b3 P a07199bd73484340962d1be07a60fdf7: tablet copy: Starting download of 1 WAL segments...
I20240503 08:15:38.492632 12380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4eef8f99866f4d479a83a5403000a519. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:15:38.493175 12281 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 67)
I20240503 08:15:38.495818 12281 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.7.84.130:52693 (request call id 67)
I20240503 08:15:38.496093 12293 tablet_copy_service.cc:140] P 66effc59fb9c44b19404f557486cef51: Received BeginTabletCopySession request for tablet ea52b951a87f4438a88cfa95d9c98909 from peer a07199bd73484340962d1be07a60fdf7 ({username='slave'} at 127.7.84.130:52693)
I20240503 08:15:38.496219 12293 tablet_copy_service.cc:161] P 66effc59fb9c44b19404f557486cef51: Beginning new tablet copy session on tablet ea52b951a87f4438a88cfa95d9c98909 from peer a07199bd73484340962d1be07a60fdf7 at {username='slave'} at 127.7.84.130:52693: session id = a07199bd73484340962d1be07a60fdf7-ea52b951a87f4438a88cfa95d9c98909
I20240503 08:15:38.498802 12380 tablet_copy_client.cc:783] T 4eef8f99866f4d479a83a5403000a519 P a07199bd73484340962d1be07a60fdf7: tablet copy: Starting download of 0 data blocks...
I20240503 08:15:38.499045 12380 tablet_copy_client.cc:647] T 4eef8f99866f4d479a83a5403000a519 P a07199bd73484340962d1be07a60fdf7: tablet copy: Starting download of 1 WAL segments...
I20240503 08:15:38.501809 12293 tablet_copy_source_session.cc:205] T ea52b951a87f4438a88cfa95d9c98909 P 66effc59fb9c44b19404f557486cef51: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:15:38.501935 12281 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.7.84.130:52693 (request call id 71)
I20240503 08:15:38.503046 12381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea52b951a87f4438a88cfa95d9c98909. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f67f6895b75 kudu::ThreadPool::DispatchThread() at ??:0
I20240503 08:15:38.507910 12374 tablet_copy_client.cc:523] T 5702520a1d1042d9b535edbd656ee0b3 P a07199bd73484340962d1be07a60fdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
@ 0x7f67f689919c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
I20240503 08:15:38.509593 12381 tablet_copy_client.cc:783] T ea52b951a87f4438a88cfa95d9c98909 P a07199bd73484340962d1be07a60fdf7: tablet copy: Starting download of 0 data blocks...
I20240503 08:15:38.509819 12381 tablet_copy_client.cc:647] T ea52b951a87f4438a88cfa95d9c98909 P a07199bd73484340962d1be07a60fdf7: tablet copy: Starting download of 1 WAL segments...
I20240503 08:15:38.512327 12381 tablet_copy_client.cc:523] T ea52b951a87f4438a88cfa95d9c98909 P a07199bd73484340962d1be07a60fdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:15:38.512591 12281 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.7.84.130:52693 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.7.84.130:52693 (request call id 74)
I20240503 08:15:38.514417 12378 tablet_copy_client.cc:523] T d7b8fb82aab144b3bb85c84d4a9e99a5 P a07199bd73484340962d1be07a60fdf7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:15:38.515821 12381 tablet_bootstrap.cc:492] T ea52b951a87f4438a88cfa95d9c98909 P a07199bd73484340962d1be07a60fdf7: Bootstrap starting.
I20240503 08:15:38.517798 12378 tablet_bootstrap.cc:492] T d7b8fb82aab144b3bb85c84d4a9e99a5 P a07199bd73484340962d1be07a60fdf7: Bootstrap starting.
I20240503 08:15:38.521600 12374 tablet_bootstrap.cc:492] T 5702520a1d1042d9b535edbd656ee0b3 P a07199bd73484340962d1be07a60fdf7: Bootstrap starting.
I20240503 08:15:38.521871 12377 log.cc:824] T 7068b2d26c594f10afee195baf075d31 P a07199bd73484340962d1be07a60fdf7: Log is configured to *not* fsync() on all Append() calls
@ 0x7f67f6899019 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xa60bcd std::function<>::operator()() at ??:?
@ 0x7f67f687401e kudu::Thread::SuperviseThread() at ??:0
@ 0x7f67f9bf96db start_thread at ??:0
@ 0x7f67f2a3771f clone at ??:0
W20240503 08:15:38.713660 12281 connection.cc:535] server connection from 127.7.84.130:52693 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20240503 08:15:38.713930 11569 connection.cc:535] client connection to 127.7.84.130:38849 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
F20240503 08:15:38.714474 12455 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
*** Aborted at 1714724138 (unix time) try "date -d @1714724138" if you are using GNU date ***
F20240503 08:15:38.714567 12452 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.714845 12416 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.714972 12368 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.715099 12367 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
F20240503 08:15:38.714567 12452 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.714845 12416 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.714972 12368 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.715099 12367 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.715277 12365 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
F20240503 08:15:38.714567 12452 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.714845 12416 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.714972 12368 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.715099 12367 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.715277 12365 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.715449 12421 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
F20240503 08:15:38.714567 12452 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.714845 12416 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.714972 12368 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.715099 12367 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.715277 12365 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.715449 12421 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.715809 12461 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
F20240503 08:15:38.714567 12452 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.714845 12416 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.714972 12368 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.715099 12367 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.715277 12365 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.715449 12421 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.715809 12461 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.715943 12362 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
F20240503 08:15:38.714567 12452 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.714845 12416 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.714972 12368 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.715099 12367 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.715277 12365 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.715449 12421 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.715809 12461 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.715943 12362 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
F20240503 08:15:38.714567 12452 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.714845 12416 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.714972 12368 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.715099 12367 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.715277 12365 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.715449 12421 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.715809 12461 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.715943 12362 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
F20240503 08:15:38.714567 12452 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.714845 12416 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.714972 12368 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.715099 12367 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.715277 12365 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.715449 12421 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.715809 12461 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240503 08:15:38.715943 12362 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e800001d52) received by PID 7506 (TID 0x7f8d6c521700) from PID 7506; stack trace: ***
@ 0x7f8d8868c980 (unknown) at ??:0
@ 0x7f8d81737fb7 gsignal at ??:0
@ 0x7f8d81739921 abort at ??:0
@ 0x7f8d84460dcd google::LogMessage::Fail() at ??:0
@ 0x7f8d84464b93 google::LogMessage::SendToLog() at ??:0
@ 0x7f8d844607cc google::LogMessage::Flush() at ??:0
@ 0x7f8d84461f59 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x3b9874 kudu::TabletCopyClientSessionITest_TestTabletCopyWithBusySource_Test::TestBody()::$_3::operator()() at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/tablet_copy_client_session-itest.cc:313
@ 0x3b926e std::__invoke_impl<>() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/invoke.h:60
@ 0x3b91ee std::__invoke<>() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/invoke.h:95
@ 0x3b91b3 _ZNSt6thread8_InvokerISt5tupleIJZN4kudu62TabletCopyClientSessionITest_TestTabletCopyWithBusySource_Test8TestBodyEvE3$_3EEE9_M_invokeIJLm0EEEEDTclsr3stdE8__invokespcl10_S_declvalIXT_EEEEESt12_Index_tupleIJXspT_EEE at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:234
@ 0x3b917e std::thread::_Invoker<>::operator()() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:243
@ 0x3b9069 std::thread::_State_impl<>::_M_run() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:186
@ 0x7f8d81dc16df (unknown) at ??:0
@ 0x7f8d886816db start_thread at ??:0
@ 0x7f8d8181a71f clone at ??:0