[==========] Running 5 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 5 tests from TabletCopyClientSessionITest
[ RUN ] TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping
2024-05-01T08:14:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-01T08:14:38Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20240501 08:14:38.967465 14847 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
/tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.127.254:36067
--webserver_interface=127.14.127.254
--webserver_port=0
--builtin_ntp_servers=127.14.127.212:46101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.127.254:36067
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240501 08:14:39.264520 14855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 08:14:39.264775 14855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 08:14:39.264853 14855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 08:14:39.271464 14855 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240501 08:14:39.271544 14855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 08:14:39.271584 14855 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240501 08:14:39.271636 14855 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240501 08:14:39.279629 14855 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.127.212:46101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.14.127.254:36067
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.127.254:36067
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.127.254
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 07:43:24 UTC on efd1337a2aa3
build id 71
ASAN enabled
I20240501 08:14:39.280616 14855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 08:14:39.282109 14855 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:14:39.291844 14863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:39.292285 14860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:39.293025 14861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:14:39.293720 14855 server_base.cc:1034] running on GCE node
I20240501 08:14:39.294375 14855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 08:14:39.295585 14855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 08:14:39.296785 14855 hybrid_clock.cc:648] HybridClock initialized: now 1714551279296731 us; error 32 us; skew 500 ppm
I20240501 08:14:39.297076 14855 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:14:39.303507 14855 webserver.cc:460] Webserver started at http://127.14.127.254:44889/ using document root <none> and password file <none>
I20240501 08:14:39.304100 14855 fs_manager.cc:359] Metadata directory not provided
I20240501 08:14:39.304216 14855 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:14:39.304466 14855 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 08:14:39.306830 14855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/master-0/data/instance:
uuid: "ba2051b92d2b469f8dd2ec1f5fc759c0"
format_stamp: "Formatted at 2024-05-01 08:14:39 on dist-test-slave-2bdt"
I20240501 08:14:39.311115 14855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/master-0/wal/instance:
uuid: "ba2051b92d2b469f8dd2ec1f5fc759c0"
format_stamp: "Formatted at 2024-05-01 08:14:39 on dist-test-slave-2bdt"
I20240501 08:14:39.315935 14855 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20240501 08:14:39.318948 14869 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:39.320078 14855 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240501 08:14:39.320227 14855 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/master-0/data,/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/master-0/wal
uuid: "ba2051b92d2b469f8dd2ec1f5fc759c0"
format_stamp: "Formatted at 2024-05-01 08:14:39 on dist-test-slave-2bdt"
I20240501 08:14:39.320394 14855 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:14:39.340135 14855 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:14:39.340814 14855 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 08:14:39.341080 14855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:14:39.357555 14855 rpc_server.cc:307] RPC server started. Bound to: 127.14.127.254:36067
I20240501 08:14:39.357576 14920 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.127.254:36067 every 8 connection(s)
I20240501 08:14:39.358741 14855 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/master-0/data/info.pb
I20240501 08:14:39.360155 14847 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu as pid 14855
I20240501 08:14:39.360448 14847 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/master-0/wal/instance
I20240501 08:14:39.363054 14921 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:14:39.372575 14921 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0: Bootstrap starting.
I20240501 08:14:39.375236 14921 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0: Neither blocks nor log segments found. Creating new log.
I20240501 08:14:39.376554 14921 log.cc:824] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0: Log is configured to *not* fsync() on all Append() calls
I20240501 08:14:39.379151 14921 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0: No bootstrap required, opened a new log
I20240501 08:14:39.386785 14921 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba2051b92d2b469f8dd2ec1f5fc759c0" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 36067 } }
I20240501 08:14:39.387053 14921 raft_consensus.cc:374] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:14:39.387166 14921 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2051b92d2b469f8dd2ec1f5fc759c0, State: Initialized, Role: FOLLOWER
I20240501 08:14:39.387804 14921 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba2051b92d2b469f8dd2ec1f5fc759c0" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 36067 } }
I20240501 08:14:39.388038 14921 raft_consensus.cc:388] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:14:39.388165 14921 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:14:39.388343 14921 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:14:39.390265 14921 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba2051b92d2b469f8dd2ec1f5fc759c0" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 36067 } }
I20240501 08:14:39.390645 14921 leader_election.cc:302] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba2051b92d2b469f8dd2ec1f5fc759c0; no voters:
I20240501 08:14:39.391105 14921 leader_election.cc:288] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 08:14:39.391227 14926 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:14:39.391829 14926 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0 [term 1 LEADER]: Becoming Leader. State: Replica: ba2051b92d2b469f8dd2ec1f5fc759c0, State: Running, Role: LEADER
I20240501 08:14:39.392333 14926 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba2051b92d2b469f8dd2ec1f5fc759c0" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 36067 } }
I20240501 08:14:39.392836 14921 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0 [sys.catalog]: configured and running, proceeding with master startup.
I20240501 08:14:39.394842 14927 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ba2051b92d2b469f8dd2ec1f5fc759c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba2051b92d2b469f8dd2ec1f5fc759c0" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 36067 } } }
I20240501 08:14:39.395093 14927 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0 [sys.catalog]: This master's current role is: LEADER
I20240501 08:14:39.396381 14928 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba2051b92d2b469f8dd2ec1f5fc759c0. Latest consensus state: current_term: 1 leader_uuid: "ba2051b92d2b469f8dd2ec1f5fc759c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba2051b92d2b469f8dd2ec1f5fc759c0" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 36067 } } }
I20240501 08:14:39.396576 14932 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240501 08:14:39.396629 14928 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0 [sys.catalog]: This master's current role is: LEADER
I20240501 08:14:39.401895 14932 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240501 08:14:39.409844 14932 catalog_manager.cc:1347] Generated new cluster ID: 6cb20aaae5ee4f3186197630ecbf80dd
I20240501 08:14:39.409936 14932 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240501 08:14:39.427101 14932 catalog_manager.cc:1370] Generated new certificate authority record
I20240501 08:14:39.428087 14932 catalog_manager.cc:1504] Loading token signing keys...
I20240501 08:14:39.438323 14932 catalog_manager.cc:5857] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0: Generated new TSK 0
I20240501 08:14:39.438968 14932 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240501 08:14:39.448822 14847 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
/tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.127.193:0
--local_ip_for_outbound_sockets=127.14.127.193
--webserver_interface=127.14.127.193
--webserver_port=0
--tserver_master_addrs=127.14.127.254:36067
--builtin_ntp_servers=127.14.127.212:46101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240501 08:14:39.746829 14945 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 08:14:39.747056 14945 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 08:14:39.747130 14945 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 08:14:39.754004 14945 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 08:14:39.754146 14945 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.127.193
I20240501 08:14:39.762004 14945 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.127.212:46101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.127.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.127.193
--webserver_port=0
--tserver_master_addrs=127.14.127.254:36067
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.127.193
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 07:43:24 UTC on efd1337a2aa3
build id 71
ASAN enabled
I20240501 08:14:39.763031 14945 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 08:14:39.764470 14945 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:14:39.774878 14951 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:39.775568 14950 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:39.776150 14953 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:14:39.776835 14945 server_base.cc:1034] running on GCE node
I20240501 08:14:39.777312 14945 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 08:14:39.778091 14945 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 08:14:39.779295 14945 hybrid_clock.cc:648] HybridClock initialized: now 1714551279779239 us; error 30 us; skew 500 ppm
I20240501 08:14:39.779583 14945 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:14:39.781494 14945 webserver.cc:460] Webserver started at http://127.14.127.193:40023/ using document root <none> and password file <none>
I20240501 08:14:39.782140 14945 fs_manager.cc:359] Metadata directory not provided
I20240501 08:14:39.782246 14945 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:14:39.782500 14945 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 08:14:39.784708 14945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/data/instance:
uuid: "61b9e916fc66428cbcbbf341e8f65261"
format_stamp: "Formatted at 2024-05-01 08:14:39 on dist-test-slave-2bdt"
I20240501 08:14:39.785432 14945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/wal/instance:
uuid: "61b9e916fc66428cbcbbf341e8f65261"
format_stamp: "Formatted at 2024-05-01 08:14:39 on dist-test-slave-2bdt"
I20240501 08:14:39.789958 14945 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20240501 08:14:39.792779 14959 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:39.793953 14945 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240501 08:14:39.794082 14945 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/data,/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/wal
uuid: "61b9e916fc66428cbcbbf341e8f65261"
format_stamp: "Formatted at 2024-05-01 08:14:39 on dist-test-slave-2bdt"
I20240501 08:14:39.794239 14945 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:14:39.810407 14945 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:14:39.811079 14945 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 08:14:39.811329 14945 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:14:39.812158 14945 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 08:14:39.813472 14945 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 08:14:39.813549 14945 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:39.813684 14945 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 08:14:39.813738 14945 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:39.842121 14945 rpc_server.cc:307] RPC server started. Bound to: 127.14.127.193:43655
I20240501 08:14:39.842157 15071 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.127.193:43655 every 8 connection(s)
I20240501 08:14:39.843195 14945 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/data/info.pb
I20240501 08:14:39.852977 14847 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu as pid 14945
I20240501 08:14:39.853215 14847 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/wal/instance
I20240501 08:14:39.854348 15072 heartbeater.cc:347] Connected to a master server at 127.14.127.254:36067
I20240501 08:14:39.854635 15072 heartbeater.cc:464] Registering TS with master...
I20240501 08:14:39.855485 15072 heartbeater.cc:511] Master 127.14.127.254:36067 requested a full tablet report, sending...
I20240501 08:14:39.856413 14847 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
/tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.127.194:0
--local_ip_for_outbound_sockets=127.14.127.194
--webserver_interface=127.14.127.194
--webserver_port=0
--tserver_master_addrs=127.14.127.254:36067
--builtin_ntp_servers=127.14.127.212:46101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240501 08:14:39.857335 14886 ts_manager.cc:194] Registered new tserver with Master: 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:39.858778 14886 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.127.193:49693
W20240501 08:14:40.158046 15075 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 08:14:40.158314 15075 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 08:14:40.158435 15075 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 08:14:40.165398 15075 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 08:14:40.165582 15075 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.127.194
I20240501 08:14:40.173918 15075 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.127.212:46101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.127.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.127.194
--webserver_port=0
--tserver_master_addrs=127.14.127.254:36067
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.127.194
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 07:43:24 UTC on efd1337a2aa3
build id 71
ASAN enabled
I20240501 08:14:40.175105 15075 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 08:14:40.176754 15075 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:14:40.188112 15080 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:40.188562 15083 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:40.189379 15081 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:14:40.190008 15075 server_base.cc:1034] running on GCE node
I20240501 08:14:40.190553 15075 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 08:14:40.191303 15075 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 08:14:40.192528 15075 hybrid_clock.cc:648] HybridClock initialized: now 1714551280192470 us; error 28 us; skew 500 ppm
I20240501 08:14:40.192800 15075 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:14:40.194973 15075 webserver.cc:460] Webserver started at http://127.14.127.194:38583/ using document root <none> and password file <none>
I20240501 08:14:40.195603 15075 fs_manager.cc:359] Metadata directory not provided
I20240501 08:14:40.195727 15075 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:14:40.195982 15075 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 08:14:40.198462 15075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data/instance:
uuid: "5230673348d44738ba9ff0edc702b200"
format_stamp: "Formatted at 2024-05-01 08:14:40 on dist-test-slave-2bdt"
I20240501 08:14:40.199232 15075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/wal/instance:
uuid: "5230673348d44738ba9ff0edc702b200"
format_stamp: "Formatted at 2024-05-01 08:14:40 on dist-test-slave-2bdt"
I20240501 08:14:40.204339 15075 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20240501 08:14:40.207427 15089 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:40.208531 15075 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20240501 08:14:40.208673 15075 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data,/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/wal
uuid: "5230673348d44738ba9ff0edc702b200"
format_stamp: "Formatted at 2024-05-01 08:14:40 on dist-test-slave-2bdt"
I20240501 08:14:40.208835 15075 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:14:40.238565 15075 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:14:40.239220 15075 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 08:14:40.239495 15075 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:14:40.240357 15075 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 08:14:40.241667 15075 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 08:14:40.241740 15075 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:40.241861 15075 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 08:14:40.241915 15075 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:40.270260 15075 rpc_server.cc:307] RPC server started. Bound to: 127.14.127.194:42935
I20240501 08:14:40.270327 15201 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.127.194:42935 every 8 connection(s)
I20240501 08:14:40.271363 15075 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data/info.pb
I20240501 08:14:40.280048 14847 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu as pid 15075
I20240501 08:14:40.280187 14847 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/wal/instance
I20240501 08:14:40.282315 15202 heartbeater.cc:347] Connected to a master server at 127.14.127.254:36067
I20240501 08:14:40.282596 15202 heartbeater.cc:464] Registering TS with master...
I20240501 08:14:40.283373 15202 heartbeater.cc:511] Master 127.14.127.254:36067 requested a full tablet report, sending...
I20240501 08:14:40.284636 14886 ts_manager.cc:194] Registered new tserver with Master: 5230673348d44738ba9ff0edc702b200 (127.14.127.194:42935)
I20240501 08:14:40.285338 14886 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.127.194:37305
I20240501 08:14:40.295756 14847 external_mini_cluster.cc:930] 2 TS(s) registered with all masters
I20240501 08:14:40.311198 14847 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu pid 15075
I20240501 08:14:40.318351 15197 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 08:14:40.396087 14847 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu with pid 15075
I20240501 08:14:40.412362 14847 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu pid 14855
I20240501 08:14:40.413465 14916 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 08:14:40.507894 14847 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu with pid 14855
I20240501 08:14:40.526705 14847 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
/tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.127.254:36067
--webserver_interface=127.14.127.254
--webserver_port=44889
--builtin_ntp_servers=127.14.127.212:46101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.127.254:36067
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240501 08:14:40.827550 15214 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 08:14:40.827796 15214 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 08:14:40.827909 15214 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 08:14:40.834575 15214 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240501 08:14:40.834657 15214 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 08:14:40.834722 15214 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240501 08:14:40.834790 15214 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240501 08:14:40.842732 15214 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.127.212:46101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.14.127.254:36067
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.127.254:36067
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.127.254
--webserver_port=44889
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 07:43:24 UTC on efd1337a2aa3
build id 71
ASAN enabled
I20240501 08:14:40.843892 15214 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 08:14:40.845461 15214 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:14:40.855151 15219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:40.855782 15220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:40.856330 15222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:14:40.856906 15214 server_base.cc:1034] running on GCE node
I20240501 08:14:40.857525 15214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 08:14:40.858744 15214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 08:14:40.859948 15214 hybrid_clock.cc:648] HybridClock initialized: now 1714551280859898 us; error 26 us; skew 500 ppm
I20240501 08:14:40.860224 15214 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:14:40.861436 15072 heartbeater.cc:503] Master 127.14.127.254:36067 was elected leader, sending a full tablet report...
I20240501 08:14:40.862605 15214 webserver.cc:460] Webserver started at http://127.14.127.254:44889/ using document root <none> and password file <none>
W20240501 08:14:40.862886 15072 heartbeater.cc:644] Failed to heartbeat to 127.14.127.254:36067 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.14.127.254:36067: connect: Connection refused (error 111)
I20240501 08:14:40.863288 15214 fs_manager.cc:359] Metadata directory not provided
I20240501 08:14:40.863456 15214 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:14:40.867996 15214 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20240501 08:14:40.870605 15229 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:40.871747 15214 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20240501 08:14:40.871896 15214 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/master-0/data,/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/master-0/wal
uuid: "ba2051b92d2b469f8dd2ec1f5fc759c0"
format_stamp: "Formatted at 2024-05-01 08:14:39 on dist-test-slave-2bdt"
I20240501 08:14:40.872612 15214 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:14:40.899593 15214 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:14:40.900271 15214 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 08:14:40.900537 15214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:14:40.917146 15214 rpc_server.cc:307] RPC server started. Bound to: 127.14.127.254:36067
I20240501 08:14:40.917165 15280 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.127.254:36067 every 8 connection(s)
I20240501 08:14:40.918448 15214 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/master-0/data/info.pb
I20240501 08:14:40.921170 14847 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu as pid 15214
I20240501 08:14:40.925109 15281 sys_catalog.cc:263] Verifying existing consensus state
I20240501 08:14:40.928187 15281 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0: Bootstrap starting.
I20240501 08:14:40.942584 15281 log.cc:824] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0: Log is configured to *not* fsync() on all Append() calls
I20240501 08:14:40.949429 15281 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:14:40.949893 15281 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0: Bootstrap complete.
I20240501 08:14:40.955857 15281 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba2051b92d2b469f8dd2ec1f5fc759c0" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 36067 } }
I20240501 08:14:40.956472 15281 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2051b92d2b469f8dd2ec1f5fc759c0, State: Initialized, Role: FOLLOWER
I20240501 08:14:40.956976 15281 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba2051b92d2b469f8dd2ec1f5fc759c0" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 36067 } }
I20240501 08:14:40.957226 15281 raft_consensus.cc:388] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:14:40.957332 15281 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:14:40.957505 15281 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:14:40.960453 15281 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba2051b92d2b469f8dd2ec1f5fc759c0" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 36067 } }
I20240501 08:14:40.960848 15281 leader_election.cc:302] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba2051b92d2b469f8dd2ec1f5fc759c0; no voters:
I20240501 08:14:40.961357 15281 leader_election.cc:288] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 08:14:40.961489 15286 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:14:40.962069 15286 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0 [term 2 LEADER]: Becoming Leader. State: Replica: ba2051b92d2b469f8dd2ec1f5fc759c0, State: Running, Role: LEADER
I20240501 08:14:40.962505 15286 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba2051b92d2b469f8dd2ec1f5fc759c0" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 36067 } }
I20240501 08:14:40.963042 15281 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0 [sys.catalog]: configured and running, proceeding with master startup.
I20240501 08:14:40.964632 15287 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "ba2051b92d2b469f8dd2ec1f5fc759c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba2051b92d2b469f8dd2ec1f5fc759c0" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 36067 } } }
I20240501 08:14:40.965018 15287 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0 [sys.catalog]: This master's current role is: LEADER
I20240501 08:14:40.965312 15288 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba2051b92d2b469f8dd2ec1f5fc759c0. Latest consensus state: current_term: 2 leader_uuid: "ba2051b92d2b469f8dd2ec1f5fc759c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba2051b92d2b469f8dd2ec1f5fc759c0" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 36067 } } }
I20240501 08:14:40.965579 15288 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0 [sys.catalog]: This master's current role is: LEADER
I20240501 08:14:40.965749 15293 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240501 08:14:40.971002 15293 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240501 08:14:40.971906 15293 catalog_manager.cc:1259] Loaded cluster ID: 6cb20aaae5ee4f3186197630ecbf80dd
I20240501 08:14:40.971985 15293 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240501 08:14:40.975184 15293 catalog_manager.cc:1504] Loading token signing keys...
I20240501 08:14:40.976142 15293 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ba2051b92d2b469f8dd2ec1f5fc759c0: Loaded TSK: 0
I20240501 08:14:40.977185 15293 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240501 08:14:41.869352 15072 heartbeater.cc:347] Connected to a master server at 127.14.127.254:36067
I20240501 08:14:41.869560 15072 heartbeater.cc:503] Master 127.14.127.254:36067 was elected leader, sending a full tablet report...
I20240501 08:14:41.871213 15245 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "61b9e916fc66428cbcbbf341e8f65261" instance_seqno: 1714551279835333) as {username='slave'} at 127.14.127.193:52859; Asking this server to re-register.
I20240501 08:14:41.871822 15072 heartbeater.cc:464] Registering TS with master...
I20240501 08:14:41.872021 15072 heartbeater.cc:511] Master 127.14.127.254:36067 requested a full tablet report, sending...
I20240501 08:14:41.873358 15245 ts_manager.cc:194] Registered new tserver with Master: 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:41.881800 14847 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20240501 08:14:41.882082 14847 test_util.cc:268] Using random seed: 337318841
I20240501 08:14:41.902815 15245 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53758:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20240501 08:14:41.924160 15007 tablet_service.cc:1467] Processing CreateTablet for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 (DEFAULT_TABLE table=test-workload [id=e0c8f0ff65e146c2ac8042b31480cae6]), partition=RANGE (key) PARTITION UNBOUNDED
I20240501 08:14:41.925400 15007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:14:41.937122 15316 tablet_bootstrap.cc:492] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261: Bootstrap starting.
I20240501 08:14:41.939707 15316 tablet_bootstrap.cc:654] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261: Neither blocks nor log segments found. Creating new log.
I20240501 08:14:41.940610 15316 log.cc:824] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261: Log is configured to *not* fsync() on all Append() calls
I20240501 08:14:41.942713 15316 tablet_bootstrap.cc:492] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261: No bootstrap required, opened a new log
I20240501 08:14:41.942934 15316 ts_tablet_manager.cc:1367] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20240501 08:14:41.948312 15316 raft_consensus.cc:348] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b9e916fc66428cbcbbf341e8f65261" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 43655 } }
I20240501 08:14:41.948570 15316 raft_consensus.cc:374] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:14:41.948653 15316 raft_consensus.cc:729] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61b9e916fc66428cbcbbf341e8f65261, State: Initialized, Role: FOLLOWER
I20240501 08:14:41.949131 15316 consensus_queue.cc:260] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b9e916fc66428cbcbbf341e8f65261" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 43655 } }
I20240501 08:14:41.949308 15316 raft_consensus.cc:388] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:14:41.949411 15316 raft_consensus.cc:482] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:14:41.949540 15316 raft_consensus.cc:3037] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:14:41.951208 15316 raft_consensus.cc:504] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b9e916fc66428cbcbbf341e8f65261" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 43655 } }
I20240501 08:14:41.951608 15316 leader_election.cc:302] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 61b9e916fc66428cbcbbf341e8f65261; no voters:
I20240501 08:14:41.952198 15316 leader_election.cc:288] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 08:14:41.952351 15318 raft_consensus.cc:2781] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:14:41.952919 15318 raft_consensus.cc:686] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [term 1 LEADER]: Becoming Leader. State: Replica: 61b9e916fc66428cbcbbf341e8f65261, State: Running, Role: LEADER
I20240501 08:14:41.953493 15318 consensus_queue.cc:237] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b9e916fc66428cbcbbf341e8f65261" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 43655 } }
I20240501 08:14:41.953706 15316 ts_tablet_manager.cc:1398] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20240501 08:14:41.958128 15245 catalog_manager.cc:5484] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193). New cstate: current_term: 1 leader_uuid: "61b9e916fc66428cbcbbf341e8f65261" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b9e916fc66428cbcbbf341e8f65261" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 43655 } health_report { overall_health: HEALTHY } } }
I20240501 08:14:42.530189 14847 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
/tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.127.194:42935
--local_ip_for_outbound_sockets=127.14.127.194
--tserver_master_addrs=127.14.127.254:36067
--webserver_port=38583
--webserver_interface=127.14.127.194
--builtin_ntp_servers=127.14.127.212:46101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240501 08:14:42.830783 15334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 08:14:42.831027 15334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 08:14:42.831157 15334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 08:14:42.837568 15334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 08:14:42.837751 15334 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.127.194
I20240501 08:14:42.845582 15334 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.127.212:46101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.127.194:42935
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.127.194
--webserver_port=38583
--tserver_master_addrs=127.14.127.254:36067
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.127.194
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 07:43:24 UTC on efd1337a2aa3
build id 71
ASAN enabled
I20240501 08:14:42.846733 15334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 08:14:42.848266 15334 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:14:42.859386 15339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:42.860138 15342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:42.860941 15340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:14:42.862279 15334 server_base.cc:1034] running on GCE node
I20240501 08:14:42.863559 15334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 08:14:42.864897 15334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 08:14:42.866087 15334 hybrid_clock.cc:648] HybridClock initialized: now 1714551282866022 us; error 46 us; skew 500 ppm
I20240501 08:14:42.866343 15334 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:14:42.868229 15334 webserver.cc:460] Webserver started at http://127.14.127.194:38583/ using document root <none> and password file <none>
I20240501 08:14:42.868867 15334 fs_manager.cc:359] Metadata directory not provided
I20240501 08:14:42.868999 15334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:14:42.873533 15334 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20240501 08:14:42.876204 15348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:42.877365 15334 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20240501 08:14:42.877514 15334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data,/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/wal
uuid: "5230673348d44738ba9ff0edc702b200"
format_stamp: "Formatted at 2024-05-01 08:14:40 on dist-test-slave-2bdt"
I20240501 08:14:42.878296 15334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:14:42.896260 15334 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:14:42.896909 15334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 08:14:42.897131 15334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:14:42.898015 15334 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 08:14:42.899411 15334 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 08:14:42.899519 15334 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:42.899616 15334 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 08:14:42.899679 15334 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:42.927475 15334 rpc_server.cc:307] RPC server started. Bound to: 127.14.127.194:42935
I20240501 08:14:42.927511 15460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.127.194:42935 every 8 connection(s)
I20240501 08:14:42.928990 15334 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data/info.pb
I20240501 08:14:42.935348 14847 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu as pid 15334
I20240501 08:14:42.939203 14847 tablet_copy_client_session-itest.cc:139] Starting loop 0
I20240501 08:14:42.939441 14847 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu pid 14945
I20240501 08:14:42.940410 15067 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 08:14:42.941624 15461 heartbeater.cc:347] Connected to a master server at 127.14.127.254:36067
I20240501 08:14:42.942014 15461 heartbeater.cc:464] Registering TS with master...
I20240501 08:14:42.942760 15461 heartbeater.cc:511] Master 127.14.127.254:36067 requested a full tablet report, sending...
I20240501 08:14:42.944216 15244 ts_manager.cc:194] Registered new tserver with Master: 5230673348d44738ba9ff0edc702b200 (127.14.127.194:42935)
I20240501 08:14:42.946189 15244 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.127.194:43315
I20240501 08:14:43.037371 14847 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu with pid 14945
W20240501 08:14:43.055478 15231 connection.cc:535] server connection from 127.14.127.193:52859 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20240501 08:14:43.058193 14847 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
/tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.127.193:43655
--local_ip_for_outbound_sockets=127.14.127.193
--tserver_master_addrs=127.14.127.254:36067
--webserver_port=40023
--webserver_interface=127.14.127.193
--builtin_ntp_servers=127.14.127.212:46101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240501 08:14:43.081352 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.090204 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.103493 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.104382 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.115855 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.116735 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.119833 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.120944 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.131856 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.132833 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.149322 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.150384 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.152804 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.153797 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.157344 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.158429 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.160491 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.161468 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.164559 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.165398 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.180231 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.181581 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.189015 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.190116 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.194368 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.195432 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.202222 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.203255 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.204989 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.206107 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.213214 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.216063 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.244890 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.246032 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.247843 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.249056 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.261301 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.262406 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.282215 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.283998 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.285780 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.286931 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.291863 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.295500 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.304457 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.305503 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.325759 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.326833 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.328933 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.334893 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.339157 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.340096 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.343277 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.344906 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.350943 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.358078 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.364440 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.365365 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.368122 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.369055 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.378512 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.381939 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.388092 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.389326 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.394096 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.395067 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
W20240501 08:14:43.396937 15472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 08:14:43.397197 15472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 08:14:43.397287 15472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20240501 08:14:43.402020 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.402976 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
W20240501 08:14:43.405799 15472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 08:14:43.406006 15472 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.127.193
I20240501 08:14:43.414276 15472 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.127.212:46101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.127.193:43655
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.127.193
--webserver_port=40023
--tserver_master_addrs=127.14.127.254:36067
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.127.193
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 07:43:24 UTC on efd1337a2aa3
build id 71
ASAN enabled
I20240501 08:14:43.415484 15472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 08:14:43.416985 15472 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:14:43.428067 15617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:43.428762 15620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:43.429309 15618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:14:43.430008 15472 server_base.cc:1034] running on GCE node
I20240501 08:14:43.430554 15472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 08:14:43.431529 15472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 08:14:43.431775 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.432696 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.432746 15472 hybrid_clock.cc:648] HybridClock initialized: now 1714551283432670 us; error 56 us; skew 500 ppm
I20240501 08:14:43.432999 15472 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:14:43.435089 15472 webserver.cc:460] Webserver started at http://127.14.127.193:40023/ using document root <none> and password file <none>
I20240501 08:14:43.435688 15472 fs_manager.cc:359] Metadata directory not provided
I20240501 08:14:43.435807 15472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:14:43.437199 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.438844 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.441756 15472 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20240501 08:14:43.444128 15634 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:43.445176 15472 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240501 08:14:43.445325 15472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/data,/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/wal
uuid: "61b9e916fc66428cbcbbf341e8f65261"
format_stamp: "Formatted at 2024-05-01 08:14:39 on dist-test-slave-2bdt"
I20240501 08:14:43.446050 15472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:14:43.459798 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.460613 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.462496 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.469413 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.476049 15472 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:14:43.476737 15472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 08:14:43.476987 15472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:14:43.477852 15472 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 08:14:43.478964 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.480131 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.480393 15652 ts_tablet_manager.cc:522] Loading tablet metadata (0/1 complete)
I20240501 08:14:43.483439 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.484390 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.485760 15472 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240501 08:14:43.485877 15472 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20240501 08:14:43.485991 15472 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240501 08:14:43.488449 15472 ts_tablet_manager.cc:590] Registered 1 tablets
I20240501 08:14:43.488519 15472 ts_tablet_manager.cc:569] Time spent register tablets: real 0.003s user 0.000s sys 0.000s
I20240501 08:14:43.488809 15652 tablet_bootstrap.cc:492] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261: Bootstrap starting.
I20240501 08:14:43.509250 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.510423 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.512995 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.514078 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.521435 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.533890 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.541424 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.554862 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.556667 15472 rpc_server.cc:307] RPC server started. Bound to: 127.14.127.193:43655
I20240501 08:14:43.556721 15779 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.127.193:43655 every 8 connection(s)
I20240501 08:14:43.557519 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.558486 15472 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/data/info.pb
I20240501 08:14:43.567670 14847 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu as pid 15472
I20240501 08:14:43.569677 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.584659 15781 heartbeater.cc:347] Connected to a master server at 127.14.127.254:36067
I20240501 08:14:43.584838 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.585237 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
I20240501 08:14:43.585384 15781 heartbeater.cc:464] Registering TS with master...
I20240501 08:14:43.586607 15781 heartbeater.cc:511] Master 127.14.127.254:36067 requested a full tablet report, sending...
W20240501 08:14:43.587344 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.589896 15244 ts_manager.cc:194] Re-registered known tserver with Master: 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.591297 15244 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.127.193:53893
I20240501 08:14:43.601054 15652 log.cc:824] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261: Log is configured to *not* fsync() on all Append() calls
I20240501 08:14:43.603466 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.604538 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.605134 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.605260 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.605414 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.607295 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.608240 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.608757 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.608863 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.609022 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.619777 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.620690 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.621268 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.621413 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.621565 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.629525 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.630441 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.631112 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.631253 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.631429 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.635847 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.636723 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.637286 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.637436 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.637638 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.642004 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.642912 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.643493 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.643623 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.643803 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.655201 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.657006 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.657542 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.657717 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.657871 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.663102 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.664050 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.664572 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.664728 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.664896 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.668015 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.668895 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.669422 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.669588 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.669770 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.672689 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.673660 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.674229 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.674360 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.674566 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.676815 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.677875 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.678401 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.678539 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.678679 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.687765 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.688838 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.689381 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.689504 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.689692 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.692898 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.693856 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.694339 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.694456 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.694624 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.700134 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.705266 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.705883 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.706008 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.706183 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.710943 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.711912 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.712448 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.712571 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.712702 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.721035 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.722421 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.722955 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.723073 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.723223 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.726224 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.732283 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.732828 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.732952 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.733099 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.739785 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.740798 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.741318 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.741429 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.741626 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.745342 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.746318 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.746815 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.746935 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.747097 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.753134 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.754462 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.755019 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.755126 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.755340 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.759805 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.760797 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.761301 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.761421 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.761569 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.776852 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.777876 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.778442 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.778575 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.778745 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.785686 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.787880 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.788453 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.788602 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.788753 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.798370 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.799439 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.800042 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.800195 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.800408 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.821811 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.822752 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.823311 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.823518 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.823689 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.836272 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.840991 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.841498 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.841630 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.841789 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.851815 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.852788 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.853333 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.853478 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.853652 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.861688 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.863003 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.863591 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.863725 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.863893 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.867365 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.868350 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.868866 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.868996 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.869136 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.873275 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.874305 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.874857 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.874975 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.875140 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.876916 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.878304 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.878821 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.878968 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.879124 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.889681 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.890602 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.891153 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.891288 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.891459 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.893321 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.894191 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.894747 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.894892 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.895064 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.906322 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.907420 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.907966 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.908080 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.908244 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.914363 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.921622 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.922245 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.922403 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.922552 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.929782 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.934510 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.935166 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.935308 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.935477 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.943250 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.944383 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.944891 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.945065 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.945246 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.948283 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.949097 15461 heartbeater.cc:503] Master 127.14.127.254:36067 was elected leader, sending a full tablet report...
I20240501 08:14:43.955500 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.956118 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.956248 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.956422 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.967299 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.968361 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.968881 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.969010 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.969139 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.975630 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.976791 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.977350 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.977499 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.977694 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.980342 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.987253 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.987856 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.987996 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.988139 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:43.990751 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:43.991712 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:43.992202 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:43.992316 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:43.992477 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:44.002274 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:44.009507 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:44.010053 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:44.010187 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:44.010336 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:44.017462 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:44.019044 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:44.019642 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:44.019783 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:44.019958 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:44.028417 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:44.029357 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:44.029868 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:44.029989 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:44.030141 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:44.033596 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:44.036635 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:44.037223 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:44.037353 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:44.037529 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:44.045370 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:44.046348 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:44.046802 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:44.046923 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:44.047076 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:44.048722 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:44.049760 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:44.050293 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:44.050411 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:44.050577 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:44.061169 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:44.062229 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:44.062767 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:44.062927 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:44.063074 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:44.069011 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:44.070173 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:44.070735 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:44.070891 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:44.071054 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:44.082181 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:44.084730 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:44.085209 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:44.085371 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:44.085523 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:44.090368 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:44.091660 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:44.092200 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:44.092345 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:44.092526 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:44.096289 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:44.097301 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:44.097975 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:44.098105 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:44.098280 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:44.116451 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:44.117421 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:44.118014 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:44.118132 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:44.118309 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:44.125530 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:44.128440 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:44.129045 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:44.129370 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:44.129684 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:44.136004 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:44.137404 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:44.138021 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:44.138315 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:44.138487 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:44.144023 15652 tablet_bootstrap.cc:492] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261: Bootstrap replayed 1/1 log segments. Stats: ops{read=209 overwritten=0 applied=209 ignored=0} inserts{seen=10400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:14:44.144577 15652 tablet_bootstrap.cc:492] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261: Bootstrap complete.
I20240501 08:14:44.145434 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:44.146044 15652 ts_tablet_manager.cc:1367] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261: Time spent bootstrapping tablet: real 0.657s user 0.593s sys 0.059s
I20240501 08:14:44.147897 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:44.148449 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:44.148609 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:44.148767 15749 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:44223: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:44.153000 15652 raft_consensus.cc:348] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b9e916fc66428cbcbbf341e8f65261" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 43655 } }
I20240501 08:14:44.154182 15475 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:44.154165 15652 raft_consensus.cc:729] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61b9e916fc66428cbcbbf341e8f65261, State: Initialized, Role: FOLLOWER
I20240501 08:14:44.154914 15652 consensus_queue.cc:260] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 209, Last appended: 1.209, Last appended by leader: 209, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b9e916fc66428cbcbbf341e8f65261" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 43655 } }
I20240501 08:14:44.155177 15652 raft_consensus.cc:388] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:14:44.155306 15652 raft_consensus.cc:482] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:14:44.155494 15652 raft_consensus.cc:3037] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:14:44.160482 15652 raft_consensus.cc:504] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b9e916fc66428cbcbbf341e8f65261" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 43655 } }
I20240501 08:14:44.161098 15652 leader_election.cc:302] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 61b9e916fc66428cbcbbf341e8f65261; no voters:
I20240501 08:14:44.161783 15652 leader_election.cc:288] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 08:14:44.162041 16021 raft_consensus.cc:2781] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:14:44.162883 15781 heartbeater.cc:503] Master 127.14.127.254:36067 was elected leader, sending a full tablet report...
I20240501 08:14:44.163594 15652 ts_tablet_manager.cc:1398] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261: Time spent starting tablet: real 0.017s user 0.009s sys 0.008s
I20240501 08:14:44.164136 16021 raft_consensus.cc:686] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [term 2 LEADER]: Becoming Leader. State: Replica: 61b9e916fc66428cbcbbf341e8f65261, State: Running, Role: LEADER
I20240501 08:14:44.164598 15475 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:44.164813 16021 consensus_queue.cc:237] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 209, Committed index: 209, Last appended: 1.209, Last appended by leader: 209, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b9e916fc66428cbcbbf341e8f65261" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 43655 } }
I20240501 08:14:44.165350 15749 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:44223)
I20240501 08:14:44.165534 15749 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:44223: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
I20240501 08:14:44.169123 15244 catalog_manager.cc:5484] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "61b9e916fc66428cbcbbf341e8f65261" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b9e916fc66428cbcbbf341e8f65261" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 43655 } health_report { overall_health: HEALTHY } } }
I20240501 08:14:44.169602 15749 tablet_copy_source_session.cc:205] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 08:14:44.174773 15475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:14:44.184926 15475 tablet_copy_client.cc:783] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Starting download of 0 data blocks...
I20240501 08:14:44.185642 15475 tablet_copy_client.cc:647] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Starting download of 1 WAL segments...
I20240501 08:14:44.189268 15475 tablet_copy_client.cc:523] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 08:14:44.192142 15475 tablet_bootstrap.cc:492] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Bootstrap starting.
I20240501 08:14:44.255235 15475 log.cc:824] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Log is configured to *not* fsync() on all Append() calls
I20240501 08:14:44.738173 15475 tablet_bootstrap.cc:492] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Bootstrap replayed 1/1 log segments. Stats: ops{read=210 overwritten=0 applied=210 ignored=0} inserts{seen=10400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:14:44.738638 15475 tablet_bootstrap.cc:492] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Bootstrap complete.
I20240501 08:14:44.739169 15475 ts_tablet_manager.cc:1367] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Time spent bootstrapping tablet: real 0.547s user 0.504s sys 0.043s
I20240501 08:14:44.743327 15475 raft_consensus.cc:348] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b9e916fc66428cbcbbf341e8f65261" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 43655 } }
I20240501 08:14:44.743643 15475 raft_consensus.cc:729] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200 [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 5230673348d44738ba9ff0edc702b200, State: Initialized, Role: NON_PARTICIPANT
I20240501 08:14:44.744124 15475 consensus_queue.cc:260] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 210, Last appended: 2.210, Last appended by leader: 210, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b9e916fc66428cbcbbf341e8f65261" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 43655 } }
I20240501 08:14:44.745302 15475 ts_tablet_manager.cc:1398] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Time spent starting tablet: real 0.006s user 0.002s sys 0.004s
I20240501 08:14:44.746137 15749 tablet_copy_service.cc:342] P 61b9e916fc66428cbcbbf341e8f65261: Request end of tablet copy session 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6 received from {username='slave'} at 127.14.127.194:44223
I20240501 08:14:44.746285 15749 tablet_copy_service.cc:433] P 61b9e916fc66428cbcbbf341e8f65261: ending tablet copy session 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6 on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 with peer 5230673348d44738ba9ff0edc702b200
W20240501 08:14:44.754076 15475 ts_tablet_manager.cc:701] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Tablet Copy: Invalid argument: Leader has replica of tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 with term 0, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20240501 08:14:44.759979 15475 ts_tablet_manager.cc:701] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Tablet Copy: Invalid argument: Leader has replica of tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 with term 0, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20240501 08:14:44.781718 15475 ts_tablet_manager.cc:701] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Tablet Copy: Invalid argument: Leader has replica of tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 with term 0, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
I20240501 08:14:44.783844 15396 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:52522
I20240501 08:14:44.784396 16034 tablet_replica.cc:330] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: stopping tablet replica
I20240501 08:14:44.784719 16034 raft_consensus.cc:2229] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200 [term 2 NON_PARTICIPANT]: Raft consensus shutting down.
I20240501 08:14:44.784966 16034 raft_consensus.cc:2258] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200 [term 2 NON_PARTICIPANT]: Raft consensus is shut down!
I20240501 08:14:44.786036 16034 ts_tablet_manager.cc:1875] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Deleting tablet data with delete state TABLET_DATA_DELETED
I20240501 08:14:44.789831 16034 ts_tablet_manager.cc:1888] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.210
I20240501 08:14:44.789932 16034 log.cc:1196] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Deleting WAL directory at /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/wal/wals/4ce1a5f2b6e1493999cfbd7fbde6fab6
I20240501 08:14:44.790383 16034 ts_tablet_manager.cc:1909] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Deleting consensus metadata
I20240501 08:14:44.791718 14847 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu pid 15334
I20240501 08:14:44.792501 15456 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 08:14:44.888103 14847 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu with pid 15334
I20240501 08:14:44.907778 14847 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
/tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.127.194:42935
--local_ip_for_outbound_sockets=127.14.127.194
--tserver_master_addrs=127.14.127.254:36067
--webserver_port=38583
--webserver_interface=127.14.127.194
--builtin_ntp_servers=127.14.127.212:46101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240501 08:14:45.207734 16036 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 08:14:45.207968 16036 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 08:14:45.208081 16036 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 08:14:45.215080 16036 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 08:14:45.215237 16036 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.127.194
I20240501 08:14:45.224730 16036 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.127.212:46101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.127.194:42935
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.127.194
--webserver_port=38583
--tserver_master_addrs=127.14.127.254:36067
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.127.194
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 07:43:24 UTC on efd1337a2aa3
build id 71
ASAN enabled
I20240501 08:14:45.225878 16036 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 08:14:45.227566 16036 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:14:45.238647 16041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:14:45.239279 16036 server_base.cc:1034] running on GCE node
W20240501 08:14:45.239989 16044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:45.240607 16042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:14:45.241218 16036 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 08:14:45.242136 16036 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 08:14:45.243346 16036 hybrid_clock.cc:648] HybridClock initialized: now 1714551285243302 us; error 43 us; skew 500 ppm
I20240501 08:14:45.243616 16036 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:14:45.250962 16036 webserver.cc:460] Webserver started at http://127.14.127.194:38583/ using document root <none> and password file <none>
I20240501 08:14:45.251638 16036 fs_manager.cc:359] Metadata directory not provided
I20240501 08:14:45.251781 16036 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:14:45.256508 16036 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20240501 08:14:45.259126 16050 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:45.260308 16036 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240501 08:14:45.260452 16036 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data,/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/wal
uuid: "5230673348d44738ba9ff0edc702b200"
format_stamp: "Formatted at 2024-05-01 08:14:40 on dist-test-slave-2bdt"
I20240501 08:14:45.261227 16036 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:14:45.284548 16036 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:14:45.285199 16036 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 08:14:45.285445 16036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:14:45.286285 16036 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 08:14:45.287606 16036 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 08:14:45.287699 16036 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:45.287809 16036 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 08:14:45.287884 16036 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:45.317248 16036 rpc_server.cc:307] RPC server started. Bound to: 127.14.127.194:42935
I20240501 08:14:45.317298 16162 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.127.194:42935 every 8 connection(s)
I20240501 08:14:45.318526 16036 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data/info.pb
I20240501 08:14:45.323057 14847 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu as pid 16036
I20240501 08:14:45.323359 14847 tablet_copy_client_session-itest.cc:139] Starting loop 1
I20240501 08:14:45.323450 14847 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu pid 15472
I20240501 08:14:45.330374 15773 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 08:14:45.331418 16163 heartbeater.cc:347] Connected to a master server at 127.14.127.254:36067
I20240501 08:14:45.331703 16163 heartbeater.cc:464] Registering TS with master...
I20240501 08:14:45.332615 16163 heartbeater.cc:511] Master 127.14.127.254:36067 requested a full tablet report, sending...
I20240501 08:14:45.334010 15244 ts_manager.cc:194] Re-registered known tserver with Master: 5230673348d44738ba9ff0edc702b200 (127.14.127.194:42935)
I20240501 08:14:45.335067 15244 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.127.194:54989
I20240501 08:14:45.427870 14847 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu with pid 15472
I20240501 08:14:45.448568 14847 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
/tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.127.193:43655
--local_ip_for_outbound_sockets=127.14.127.193
--tserver_master_addrs=127.14.127.254:36067
--webserver_port=40023
--webserver_interface=127.14.127.193
--builtin_ntp_servers=127.14.127.212:46101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240501 08:14:45.472515 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.475687 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.491820 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.492769 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.497980 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.499085 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.509070 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.510042 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.522526 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.523506 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.534488 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.535475 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.539546 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.540596 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.570454 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.571725 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.582406 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.583380 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.585330 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.586674 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.598999 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.600080 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.614347 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.616139 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.619154 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.620195 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.640940 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.642056 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.650089 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.651057 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.653648 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.654583 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.665771 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.666769 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.679314 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.680903 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.687660 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.688679 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.691560 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.692505 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.705307 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.706281 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.719556 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.720566 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.724463 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.732331 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.734264 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.743916 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.764513 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.765516 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.769291 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.775177 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
W20240501 08:14:45.784621 16175 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 08:14:45.784862 16175 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 08:14:45.784978 16175 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 08:14:45.791357 16175 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 08:14:45.791553 16175 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.127.193
I20240501 08:14:45.792729 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.793705 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.795958 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.796929 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.801192 16175 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.127.212:46101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.127.193:43655
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.127.193
--webserver_port=40023
--tserver_master_addrs=127.14.127.254:36067
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.127.193
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 07:43:24 UTC on efd1337a2aa3
build id 71
ASAN enabled
I20240501 08:14:45.802070 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.802424 16175 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 08:14:45.803009 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.804381 16175 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20240501 08:14:45.808342 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.809311 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
W20240501 08:14:45.815958 16304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:45.816486 16305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:45.817234 16307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:14:45.817921 16175 server_base.cc:1034] running on GCE node
I20240501 08:14:45.818473 16175 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 08:14:45.818658 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.819537 16175 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 08:14:45.819578 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.820751 16175 hybrid_clock.cc:648] HybridClock initialized: now 1714551285820697 us; error 38 us; skew 500 ppm
I20240501 08:14:45.821024 16175 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:14:45.822933 16175 webserver.cc:460] Webserver started at http://127.14.127.193:40023/ using document root <none> and password file <none>
I20240501 08:14:45.823573 16175 fs_manager.cc:359] Metadata directory not provided
I20240501 08:14:45.823711 16175 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:14:45.825306 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.826274 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.828709 16175 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.005s
I20240501 08:14:45.831167 16321 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:45.832325 16175 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20240501 08:14:45.832495 16175 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/data,/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/wal
uuid: "61b9e916fc66428cbcbbf341e8f65261"
format_stamp: "Formatted at 2024-05-01 08:14:39 on dist-test-slave-2bdt"
I20240501 08:14:45.833245 16175 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:14:45.835386 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.836301 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.852775 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.853664 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.856437 16175 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:14:45.857059 16175 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 08:14:45.857311 16175 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:14:45.858100 16175 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 08:14:45.859620 16336 ts_tablet_manager.cc:522] Loading tablet metadata (0/1 complete)
I20240501 08:14:45.860615 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.861559 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.864959 16175 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240501 08:14:45.865039 16175 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20240501 08:14:45.865108 16175 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240501 08:14:45.867494 16175 ts_tablet_manager.cc:590] Registered 1 tablets
I20240501 08:14:45.867584 16175 ts_tablet_manager.cc:569] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20240501 08:14:45.867870 16336 tablet_bootstrap.cc:492] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261: Bootstrap starting.
I20240501 08:14:45.870658 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.874933 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.884761 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.894270 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.896173 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.897329 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.904937 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.905961 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.916985 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.922297 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.933187 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.942565 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.947827 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.948796 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.957044 16175 rpc_server.cc:307] RPC server started. Bound to: 127.14.127.193:43655
I20240501 08:14:45.957062 16474 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.127.193:43655 every 8 connection(s)
I20240501 08:14:45.958815 16175 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/data/info.pb
I20240501 08:14:45.961444 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.967725 14847 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu as pid 16175
I20240501 08:14:45.986466 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:45.987520 16475 heartbeater.cc:347] Connected to a master server at 127.14.127.254:36067
I20240501 08:14:45.987784 16475 heartbeater.cc:464] Registering TS with master...
I20240501 08:14:45.988821 16475 heartbeater.cc:511] Master 127.14.127.254:36067 requested a full tablet report, sending...
I20240501 08:14:45.991453 15244 ts_manager.cc:194] Re-registered known tserver with Master: 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:45.992745 15244 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.127.193:33801
I20240501 08:14:45.996039 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:45.996388 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:45.998452 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.005268 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.006527 16336 log.cc:824] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261: Log is configured to *not* fsync() on all Append() calls
I20240501 08:14:46.007061 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.007679 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.007804 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.007973 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.030292 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.034132 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.034807 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.034938 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.035092 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.044250 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.045377 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.045917 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.046085 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.046277 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.048553 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.049584 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.050185 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.050343 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.050516 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.059473 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.060380 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.060952 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.061085 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.061249 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.067210 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.068253 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.068854 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.068956 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.069134 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.071882 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.073983 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.074736 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.074873 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.075009 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.080489 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.084054 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.084825 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.084973 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.085144 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.086627 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.087612 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.088140 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.088289 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.088440 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.094081 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.095049 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.095580 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.095714 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.095906 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.097770 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.104780 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.105321 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.105453 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.105594 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.113145 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.114153 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.114758 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.114882 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.115028 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.119082 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.122859 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.123350 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.123510 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.123643 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.125972 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.126940 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.127494 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.127620 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.127777 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.131556 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.138145 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.138700 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.138825 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.139000 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.159824 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.160800 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.161389 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.161517 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.161687 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.165045 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.169915 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.170480 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.170645 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.170810 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.174305 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.177964 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.178453 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.178579 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.178752 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.198805 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.199959 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.200660 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.200788 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.200963 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.207994 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.208925 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.209517 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.209679 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.209846 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.215029 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.218045 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.218650 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.218825 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.218984 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.242017 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.243723 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.244298 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.244408 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.244550 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.248728 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.249773 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.250267 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.250386 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.250536 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.252390 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.253427 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.253993 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.254098 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.254243 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.256556 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.257472 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.257977 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.258095 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.258237 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.260787 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.261687 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.262197 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.262389 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.262548 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.267589 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.274245 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.274749 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.274912 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.275113 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.277153 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.278056 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.278613 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.278724 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.278864 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.281728 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.282651 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.283155 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.283289 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.283423 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.287585 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.288484 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.289021 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.289139 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.289283 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.308145 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.309554 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.310245 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.310366 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.310518 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.313294 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.314278 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.314842 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.314936 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.315125 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.316591 16177 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.319731 16177 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.320294 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.320442 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.320596 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.324105 16179 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.331167 16179 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.331689 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.331809 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.331961 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.337595 16163 heartbeater.cc:503] Master 127.14.127.254:36067 was elected leader, sending a full tablet report...
I20240501 08:14:46.345602 16179 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.346637 16179 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.347151 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.347306 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.347463 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.354872 16179 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.356348 16179 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.356958 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.357085 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.357254 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.362649 16179 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.368651 16179 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.369165 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.369310 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.369454 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.371059 16179 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.373836 16179 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.374363 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.374518 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.374706 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.390727 16179 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.392066 16179 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.392666 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.392813 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.392966 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.402823 16179 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.409983 16179 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.410530 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.410658 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.410827 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.413084 16179 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.414141 16179 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.414696 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.414844 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.414994 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.420104 16179 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.427249 16179 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.427976 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.428119 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.428344 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.437975 16179 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.438968 16179 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.439468 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.439597 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.439725 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.447764 16179 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.448726 16179 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.449255 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.449400 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.449566 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.457804 16179 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.458828 16179 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.459355 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.459499 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.459664 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.479811 16179 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.480861 16179 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.481424 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.481671 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.481854 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.483417 16179 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.484474 16179 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.485067 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.485201 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.485363 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.493582 16179 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.494606 16179 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.495225 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.495342 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.495515 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.500360 16179 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.501334 16179 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.501859 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.501988 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.502142 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.505273 16179 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.512171 16179 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.512639 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.512737 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.512899 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.530455 16336 tablet_bootstrap.cc:492] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261: Bootstrap replayed 1/1 log segments. Stats: ops{read=210 overwritten=0 applied=210 ignored=0} inserts{seen=10400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:14:46.530565 16179 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.530979 16336 tablet_bootstrap.cc:492] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261: Bootstrap complete.
I20240501 08:14:46.531788 16179 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.532214 16336 ts_tablet_manager.cc:1367] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261: Time spent bootstrapping tablet: real 0.665s user 0.573s sys 0.080s
I20240501 08:14:46.532349 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.532516 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:46.533020 16442 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:43119: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:46.537051 16336 raft_consensus.cc:348] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b9e916fc66428cbcbbf341e8f65261" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 43655 } }
I20240501 08:14:46.537808 16336 raft_consensus.cc:729] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61b9e916fc66428cbcbbf341e8f65261, State: Initialized, Role: FOLLOWER
I20240501 08:14:46.538372 16336 consensus_queue.cc:260] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 210, Last appended: 2.210, Last appended by leader: 210, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b9e916fc66428cbcbbf341e8f65261" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 43655 } }
I20240501 08:14:46.538586 16336 raft_consensus.cc:388] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:14:46.538688 16336 raft_consensus.cc:482] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:14:46.538842 16336 raft_consensus.cc:3037] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [term 2 FOLLOWER]: Advancing to term 3
I20240501 08:14:46.539289 16179 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:46.542109 16336 raft_consensus.cc:504] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b9e916fc66428cbcbbf341e8f65261" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 43655 } }
I20240501 08:14:46.542599 16336 leader_election.cc:302] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 61b9e916fc66428cbcbbf341e8f65261; no voters:
I20240501 08:14:46.542981 16179 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:46.543097 16336 leader_election.cc:288] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [CANDIDATE]: Term 3 election: Requested vote from peers
I20240501 08:14:46.543208 16694 raft_consensus.cc:2781] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [term 3 FOLLOWER]: Leader election won for term 3
I20240501 08:14:46.543610 16442 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:43119)
I20240501 08:14:46.543782 16442 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:43119: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
I20240501 08:14:46.544272 16475 heartbeater.cc:503] Master 127.14.127.254:36067 was elected leader, sending a full tablet report...
I20240501 08:14:46.544893 16336 ts_tablet_manager.cc:1398] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
I20240501 08:14:46.549515 16694 raft_consensus.cc:686] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [term 3 LEADER]: Becoming Leader. State: Replica: 61b9e916fc66428cbcbbf341e8f65261, State: Running, Role: LEADER
I20240501 08:14:46.549930 16694 consensus_queue.cc:237] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 210, Committed index: 210, Last appended: 2.210, Last appended by leader: 210, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b9e916fc66428cbcbbf341e8f65261" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 43655 } }
I20240501 08:14:46.552598 16442 tablet_copy_source_session.cc:205] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 08:14:46.553671 15244 catalog_manager.cc:5484] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 reported cstate change: term changed from 2 to 3. New cstate: current_term: 3 leader_uuid: "61b9e916fc66428cbcbbf341e8f65261" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b9e916fc66428cbcbbf341e8f65261" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 43655 } health_report { overall_health: HEALTHY } } }
I20240501 08:14:46.557335 16179 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:14:46.566890 16179 tablet_copy_client.cc:783] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Starting download of 0 data blocks...
I20240501 08:14:46.567139 16179 tablet_copy_client.cc:647] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Starting download of 1 WAL segments...
I20240501 08:14:46.571193 16179 tablet_copy_client.cc:523] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 08:14:46.574070 16179 tablet_bootstrap.cc:492] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Bootstrap starting.
I20240501 08:14:46.631589 16179 log.cc:824] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Log is configured to *not* fsync() on all Append() calls
I20240501 08:14:47.125867 16179 tablet_bootstrap.cc:492] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Bootstrap replayed 1/1 log segments. Stats: ops{read=211 overwritten=0 applied=210 ignored=0} inserts{seen=10400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20240501 08:14:47.126468 16179 tablet_bootstrap.cc:492] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Bootstrap complete.
I20240501 08:14:47.126993 16179 ts_tablet_manager.cc:1367] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Time spent bootstrapping tablet: real 0.553s user 0.520s sys 0.030s
I20240501 08:14:47.131319 16179 raft_consensus.cc:348] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200 [term 3 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b9e916fc66428cbcbbf341e8f65261" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 43655 } }
I20240501 08:14:47.131778 16179 raft_consensus.cc:729] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200 [term 3 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 5230673348d44738ba9ff0edc702b200, State: Initialized, Role: NON_PARTICIPANT
I20240501 08:14:47.132155 16179 consensus_queue.cc:260] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 210, Last appended: 3.211, Last appended by leader: 211, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b9e916fc66428cbcbbf341e8f65261" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 43655 } }
I20240501 08:14:47.133577 16179 ts_tablet_manager.cc:1398] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20240501 08:14:47.134359 16442 tablet_copy_service.cc:342] P 61b9e916fc66428cbcbbf341e8f65261: Request end of tablet copy session 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6 received from {username='slave'} at 127.14.127.194:43119
I20240501 08:14:47.134474 16442 tablet_copy_service.cc:433] P 61b9e916fc66428cbcbbf341e8f65261: ending tablet copy session 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6 on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 with peer 5230673348d44738ba9ff0edc702b200
W20240501 08:14:47.145568 16179 ts_tablet_manager.cc:701] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Tablet Copy: Invalid argument: Leader has replica of tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 with term 0, which is lower than last-logged term 3 on local replica. Rejecting tablet copy request
W20240501 08:14:47.155441 16179 ts_tablet_manager.cc:701] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Tablet Copy: Invalid argument: Leader has replica of tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 with term 0, which is lower than last-logged term 3 on local replica. Rejecting tablet copy request
W20240501 08:14:47.158062 16179 ts_tablet_manager.cc:701] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Tablet Copy: Invalid argument: Leader has replica of tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 with term 0, which is lower than last-logged term 3 on local replica. Rejecting tablet copy request
I20240501 08:14:47.160023 16098 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:52526
I20240501 08:14:47.160707 16705 tablet_replica.cc:330] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: stopping tablet replica
I20240501 08:14:47.161017 16705 raft_consensus.cc:2229] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200 [term 3 NON_PARTICIPANT]: Raft consensus shutting down.
I20240501 08:14:47.161309 16705 pending_rounds.cc:62] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Trying to abort 1 pending ops.
I20240501 08:14:47.161437 16705 pending_rounds.cc:68] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Aborting op as it isn't in flight: id { term: 3 index: 211 } timestamp: 7022802069709172736 op_type: NO_OP noop_request { }
I20240501 08:14:47.161648 16705 raft_consensus.cc:2866] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200 [term 3 NON_PARTICIPANT]: NO_OP replication failed: Aborted: Op aborted
I20240501 08:14:47.161767 16705 raft_consensus.cc:2258] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200 [term 3 NON_PARTICIPANT]: Raft consensus is shut down!
I20240501 08:14:47.162827 16705 ts_tablet_manager.cc:1875] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Deleting tablet data with delete state TABLET_DATA_DELETED
I20240501 08:14:47.167201 16705 ts_tablet_manager.cc:1888] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 3.211
I20240501 08:14:47.167330 16705 log.cc:1196] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Deleting WAL directory at /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/wal/wals/4ce1a5f2b6e1493999cfbd7fbde6fab6
I20240501 08:14:47.167757 16705 ts_tablet_manager.cc:1909] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Deleting consensus metadata
I20240501 08:14:47.169162 14847 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu pid 16036
I20240501 08:14:47.170042 16158 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 08:14:47.269358 14847 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu with pid 16036
I20240501 08:14:47.289636 14847 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
/tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.127.194:42935
--local_ip_for_outbound_sockets=127.14.127.194
--tserver_master_addrs=127.14.127.254:36067
--webserver_port=38583
--webserver_interface=127.14.127.194
--builtin_ntp_servers=127.14.127.212:46101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240501 08:14:47.592087 16707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 08:14:47.592356 16707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 08:14:47.592487 16707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 08:14:47.600240 16707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 08:14:47.600422 16707 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.127.194
I20240501 08:14:47.608646 16707 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.127.212:46101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.127.194:42935
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.127.194
--webserver_port=38583
--tserver_master_addrs=127.14.127.254:36067
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.127.194
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 07:43:24 UTC on efd1337a2aa3
build id 71
ASAN enabled
I20240501 08:14:47.609887 16707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 08:14:47.611513 16707 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:14:47.622526 16715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:47.623104 16712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:47.623719 16713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:14:47.624326 16707 server_base.cc:1034] running on GCE node
I20240501 08:14:47.624830 16707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 08:14:47.625634 16707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 08:14:47.626845 16707 hybrid_clock.cc:648] HybridClock initialized: now 1714551287626778 us; error 47 us; skew 500 ppm
I20240501 08:14:47.627099 16707 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:14:47.629070 16707 webserver.cc:460] Webserver started at http://127.14.127.194:38583/ using document root <none> and password file <none>
I20240501 08:14:47.629729 16707 fs_manager.cc:359] Metadata directory not provided
I20240501 08:14:47.629853 16707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:14:47.634635 16707 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.002s
I20240501 08:14:47.637077 16721 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:47.638335 16707 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20240501 08:14:47.638489 16707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data,/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/wal
uuid: "5230673348d44738ba9ff0edc702b200"
format_stamp: "Formatted at 2024-05-01 08:14:40 on dist-test-slave-2bdt"
I20240501 08:14:47.639314 16707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:14:47.655339 16707 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:14:47.656008 16707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 08:14:47.656245 16707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:14:47.657061 16707 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 08:14:47.658417 16707 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 08:14:47.658514 16707 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:47.658615 16707 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 08:14:47.658684 16707 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:47.688768 16707 rpc_server.cc:307] RPC server started. Bound to: 127.14.127.194:42935
I20240501 08:14:47.688833 16833 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.127.194:42935 every 8 connection(s)
I20240501 08:14:47.690141 16707 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data/info.pb
I20240501 08:14:47.694636 14847 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu as pid 16707
I20240501 08:14:47.694859 14847 tablet_copy_client_session-itest.cc:139] Starting loop 2
I20240501 08:14:47.694957 14847 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu pid 16175
I20240501 08:14:47.703179 16470 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 08:14:47.703616 16834 heartbeater.cc:347] Connected to a master server at 127.14.127.254:36067
I20240501 08:14:47.703887 16834 heartbeater.cc:464] Registering TS with master...
I20240501 08:14:47.704782 16834 heartbeater.cc:511] Master 127.14.127.254:36067 requested a full tablet report, sending...
I20240501 08:14:47.706277 15244 ts_manager.cc:194] Re-registered known tserver with Master: 5230673348d44738ba9ff0edc702b200 (127.14.127.194:42935)
I20240501 08:14:47.707273 15244 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.127.194:51469
I20240501 08:14:47.793232 14847 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu with pid 16175
I20240501 08:14:47.814069 14847 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
/tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.127.193:43655
--local_ip_for_outbound_sockets=127.14.127.193
--tserver_master_addrs=127.14.127.254:36067
--webserver_port=40023
--webserver_interface=127.14.127.193
--builtin_ntp_servers=127.14.127.212:46101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240501 08:14:47.836460 16850 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:47.844203 16850 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:47.848217 16850 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:47.858242 16850 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:47.868566 16850 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:47.869465 16850 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:47.871901 16850 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:47.872906 16850 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:47.881351 16850 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:47.882439 16850 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:47.885015 16850 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:47.885993 16850 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:47.889886 16850 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:47.891157 16850 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:47.893177 16850 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:47.894223 16850 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:47.906958 16850 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:47.907910 16850 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:47.913826 16850 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:47.914812 16850 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:47.920502 16850 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:47.922277 16850 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:47.933601 16850 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:47.934715 16850 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:47.936345 16850 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:47.937217 16850 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:47.943495 16850 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:47.944813 16850 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:47.948213 16850 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:47.949116 16850 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:47.961719 16850 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:47.963138 16850 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:47.970453 16850 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:47.971455 16850 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:47.986078 16850 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:47.987098 16850 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:47.988821 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:47.989786 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.009330 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.010288 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.018792 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.020553 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.058161 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.059327 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.063779 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.071738 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.081239 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.082302 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.085134 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.086095 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.091593 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.092540 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.102726 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.103668 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.114025 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.115039 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.116712 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.117733 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.121850 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.124174 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.141228 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.143327 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
W20240501 08:14:48.152284 16846 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 08:14:48.152587 16846 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 08:14:48.152736 16846 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20240501 08:14:48.153079 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.154099 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.159236 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.160202 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
W20240501 08:14:48.160931 16846 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 08:14:48.161175 16846 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.127.193
I20240501 08:14:48.165729 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.171139 16846 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.127.212:46101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.127.193:43655
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.127.193
--webserver_port=40023
--tserver_master_addrs=127.14.127.254:36067
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.127.193
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 07:43:24 UTC on efd1337a2aa3
build id 71
ASAN enabled
I20240501 08:14:48.172343 16846 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 08:14:48.172742 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.174826 16846 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:14:48.186739 16995 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:48.187179 16992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:48.187580 16993 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:14:48.188194 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.188444 16846 server_base.cc:1034] running on GCE node
I20240501 08:14:48.189172 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.189211 16846 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 08:14:48.190342 16846 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 08:14:48.191622 16846 hybrid_clock.cc:648] HybridClock initialized: now 1714551288191546 us; error 47 us; skew 500 ppm
I20240501 08:14:48.191912 16846 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:14:48.193645 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.194700 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.195096 16846 webserver.cc:460] Webserver started at http://127.14.127.193:40023/ using document root <none> and password file <none>
I20240501 08:14:48.195951 16846 fs_manager.cc:359] Metadata directory not provided
I20240501 08:14:48.196130 16846 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:14:48.197394 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.198462 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.201586 16846 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20240501 08:14:48.202921 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.204466 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.204548 17016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:48.205991 16846 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20240501 08:14:48.206122 16846 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/data,/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/wal
uuid: "61b9e916fc66428cbcbbf341e8f65261"
format_stamp: "Formatted at 2024-05-01 08:14:39 on dist-test-slave-2bdt"
I20240501 08:14:48.206900 16846 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:14:48.222023 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.223040 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.226616 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.227669 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.230477 16846 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:14:48.231297 16846 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 08:14:48.231541 16846 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:14:48.232595 16846 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 08:14:48.232856 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.233860 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.235018 17036 ts_tablet_manager.cc:522] Loading tablet metadata (0/1 complete)
I20240501 08:14:48.236307 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.237432 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.241449 16846 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240501 08:14:48.241552 16846 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20240501 08:14:48.241684 16846 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240501 08:14:48.241991 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.243067 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.244964 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.245010 16846 ts_tablet_manager.cc:590] Registered 1 tablets
I20240501 08:14:48.245090 16846 ts_tablet_manager.cc:569] Time spent register tablets: real 0.003s user 0.000s sys 0.000s
I20240501 08:14:48.245492 17036 tablet_bootstrap.cc:492] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261: Bootstrap starting.
I20240501 08:14:48.255932 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.289278 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.299950 16846 rpc_server.cc:307] RPC server started. Bound to: 127.14.127.193:43655
I20240501 08:14:48.300004 17156 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.127.193:43655 every 8 connection(s)
I20240501 08:14:48.300693 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.301720 16846 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-0/data/info.pb
I20240501 08:14:48.302214 14847 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu as pid 16846
I20240501 08:14:48.316846 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.317199 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.318733 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.325960 17159 heartbeater.cc:347] Connected to a master server at 127.14.127.254:36067
I20240501 08:14:48.326184 17159 heartbeater.cc:464] Registering TS with master...
I20240501 08:14:48.327096 17159 heartbeater.cc:511] Master 127.14.127.254:36067 requested a full tablet report, sending...
I20240501 08:14:48.329527 15244 ts_manager.cc:194] Re-registered known tserver with Master: 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.330556 15244 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.127.193:42105
I20240501 08:14:48.334287 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.335290 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.335852 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.336014 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.336192 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.339913 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.340876 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.341467 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.341573 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.341786 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.344849 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.345896 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.346444 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.346602 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.346755 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.358513 17036 log.cc:824] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261: Log is configured to *not* fsync() on all Append() calls
I20240501 08:14:48.369303 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.370462 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.371026 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.371181 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.371368 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.374110 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.375124 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.375675 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.375828 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.376076 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.384302 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.385524 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.386070 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.386175 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.386374 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.395328 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.396363 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.396940 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.397074 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.397267 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.413569 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.414671 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.415191 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.415320 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.415494 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.417670 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.418681 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.419634 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.419785 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.419939 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.433807 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.434826 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.435389 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.435562 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.435773 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.457054 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.458078 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.458618 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.458771 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.458918 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.461138 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.462100 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.462714 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.462852 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.463011 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.468360 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.469595 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.470127 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.470275 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.470425 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.473186 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.474140 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.474720 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.474841 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.475003 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.479499 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.480388 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.480937 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.481094 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.481280 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.496174 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.497088 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.497701 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.497833 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.497999 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.502130 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.503036 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.503604 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.503751 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.503911 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.506335 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.507189 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.507704 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.507823 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.507983 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.520401 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.521252 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.521770 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.521906 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.522054 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.525100 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.526113 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.526660 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.526769 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.526906 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.544425 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.545429 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.545989 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.546116 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.546264 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.551337 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.552189 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.552837 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.552956 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.553126 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.559039 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.559993 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.560532 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.560652 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.560957 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.568370 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.569249 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.569885 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.570019 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.570168 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.571345 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.572408 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.572989 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.573110 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.573261 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.604147 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.605022 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.605598 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.605762 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.605912 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.611019 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.612039 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.612620 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.612763 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.612926 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.616377 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.617336 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.617871 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.618027 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.618191 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.622422 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.629763 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.630270 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.630436 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.630633 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.638092 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.639021 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.639719 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.639864 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.640045 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.643723 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.644773 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.645354 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.645519 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.645679 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.651446 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.654500 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.655094 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.655223 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.655412 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.661011 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.662168 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.662703 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.662873 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.663038 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.667629 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.668622 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.669173 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.669304 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.669462 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.676607 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.677479 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.678038 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.678215 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.678380 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.684926 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.689056 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.689688 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.689821 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.689975 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.709338 16834 heartbeater.cc:503] Master 127.14.127.254:36067 was elected leader, sending a full tablet report...
I20240501 08:14:48.710685 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.712047 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.712576 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.712728 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.712875 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.718178 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.722064 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.722592 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.722755 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.722923 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.739681 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.740706 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.741197 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.741319 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.741458 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.750152 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.751199 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.751888 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.752038 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.752204 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.758150 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.759330 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.759873 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.760027 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.760201 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.784940 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.786103 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.786669 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.786806 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.786974 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.791559 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.792567 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.793076 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.793231 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.793394 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.797300 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.801903 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.802466 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.802603 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.802780 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.814260 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.816494 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.816990 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.817150 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.817323 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.821790 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.822889 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.823485 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.823616 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.823786 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.828882 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.829825 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.830394 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.830546 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.830701 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.847666 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.849190 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.849880 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.850040 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.850207 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.860556 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.861558 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.862067 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.862218 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.862375 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.867976 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.871495 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.872503 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.872640 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.872815 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.878582 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.879549 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.880089 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.880236 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.880389 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.884449 17036 tablet_bootstrap.cc:492] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261: Bootstrap replayed 1/1 log segments. Stats: ops{read=211 overwritten=0 applied=211 ignored=0} inserts{seen=10400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:14:48.884925 17036 tablet_bootstrap.cc:492] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261: Bootstrap complete.
I20240501 08:14:48.886152 17036 ts_tablet_manager.cc:1367] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261: Time spent bootstrapping tablet: real 0.641s user 0.578s sys 0.056s
I20240501 08:14:48.887272 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.888226 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.888835 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.888978 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.889142 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.891460 17036 raft_consensus.cc:348] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b9e916fc66428cbcbbf341e8f65261" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 43655 } }
I20240501 08:14:48.892210 17036 raft_consensus.cc:729] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61b9e916fc66428cbcbbf341e8f65261, State: Initialized, Role: FOLLOWER
I20240501 08:14:48.892529 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.892923 17036 consensus_queue.cc:260] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 211, Last appended: 3.211, Last appended by leader: 211, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b9e916fc66428cbcbbf341e8f65261" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 43655 } }
I20240501 08:14:48.893172 17036 raft_consensus.cc:388] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [term 3 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:14:48.893306 17036 raft_consensus.cc:482] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [term 3 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:14:48.893468 17036 raft_consensus.cc:3037] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [term 3 FOLLOWER]: Advancing to term 4
I20240501 08:14:48.893720 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.894225 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.894392 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
W20240501 08:14:48.894564 17130 tablet_copy_service.cc:478] P 61b9e916fc66428cbcbbf341e8f65261: Error handling TabletCopyService RPC request from {username='slave'} at 127.14.127.194:50475: Error beginning tablet copy session for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 08:14:48.897964 17036 raft_consensus.cc:504] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b9e916fc66428cbcbbf341e8f65261" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 43655 } }
I20240501 08:14:48.898391 17036 leader_election.cc:302] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 61b9e916fc66428cbcbbf341e8f65261; no voters:
I20240501 08:14:48.898841 17036 leader_election.cc:288] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [CANDIDATE]: Term 4 election: Requested vote from peers
I20240501 08:14:48.898968 17377 raft_consensus.cc:2781] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [term 4 FOLLOWER]: Leader election won for term 4
I20240501 08:14:48.899921 17159 heartbeater.cc:503] Master 127.14.127.254:36067 was elected leader, sending a full tablet report...
I20240501 08:14:48.900496 17036 ts_tablet_manager.cc:1398] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261: Time spent starting tablet: real 0.014s user 0.010s sys 0.004s
I20240501 08:14:48.900812 17377 raft_consensus.cc:686] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [term 4 LEADER]: Becoming Leader. State: Replica: 61b9e916fc66428cbcbbf341e8f65261, State: Running, Role: LEADER
I20240501 08:14:48.900859 16847 ts_tablet_manager.cc:902] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Initiating tablet copy from peer 61b9e916fc66428cbcbbf341e8f65261 (127.14.127.193:43655)
I20240501 08:14:48.901188 17377 consensus_queue.cc:237] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 211, Committed index: 211, Last appended: 3.211, Last appended by leader: 211, Current term: 4, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b9e916fc66428cbcbbf341e8f65261" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 43655 } }
I20240501 08:14:48.904412 15244 catalog_manager.cc:5484] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261 reported cstate change: term changed from 3 to 4. New cstate: current_term: 4 leader_uuid: "61b9e916fc66428cbcbbf341e8f65261" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b9e916fc66428cbcbbf341e8f65261" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 43655 } health_report { overall_health: HEALTHY } } }
I20240501 08:14:48.908159 16847 tablet_copy_client.cc:308] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:43655
I20240501 08:14:48.908671 17130 tablet_copy_service.cc:140] P 61b9e916fc66428cbcbbf341e8f65261: Received BeginTabletCopySession request for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 ({username='slave'} at 127.14.127.194:50475)
I20240501 08:14:48.908816 17130 tablet_copy_service.cc:161] P 61b9e916fc66428cbcbbf341e8f65261: Beginning new tablet copy session on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 from peer 5230673348d44738ba9ff0edc702b200 at {username='slave'} at 127.14.127.194:50475: session id = 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6
I20240501 08:14:48.911327 17130 tablet_copy_source_session.cc:205] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 61b9e916fc66428cbcbbf341e8f65261: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 08:14:48.915310 16847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:14:48.927381 16847 tablet_copy_client.cc:783] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Starting download of 0 data blocks...
I20240501 08:14:48.927637 16847 tablet_copy_client.cc:647] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Starting download of 1 WAL segments...
I20240501 08:14:48.931567 16847 tablet_copy_client.cc:523] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 08:14:48.935339 16847 tablet_bootstrap.cc:492] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Bootstrap starting.
I20240501 08:14:48.992713 16847 log.cc:824] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Log is configured to *not* fsync() on all Append() calls
I20240501 08:14:49.483361 16847 tablet_bootstrap.cc:492] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Bootstrap replayed 1/1 log segments. Stats: ops{read=212 overwritten=0 applied=212 ignored=0} inserts{seen=10400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:14:49.483834 16847 tablet_bootstrap.cc:492] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Bootstrap complete.
I20240501 08:14:49.484284 16847 ts_tablet_manager.cc:1367] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Time spent bootstrapping tablet: real 0.549s user 0.495s sys 0.051s
I20240501 08:14:49.488911 16847 raft_consensus.cc:348] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200 [term 4 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b9e916fc66428cbcbbf341e8f65261" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 43655 } }
I20240501 08:14:49.489223 16847 raft_consensus.cc:729] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200 [term 4 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 5230673348d44738ba9ff0edc702b200, State: Initialized, Role: NON_PARTICIPANT
I20240501 08:14:49.489735 16847 consensus_queue.cc:260] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 212, Last appended: 4.212, Last appended by leader: 212, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b9e916fc66428cbcbbf341e8f65261" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 43655 } }
I20240501 08:14:49.491400 16847 ts_tablet_manager.cc:1398] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Time spent starting tablet: real 0.007s user 0.009s sys 0.000s
I20240501 08:14:49.492269 17130 tablet_copy_service.cc:342] P 61b9e916fc66428cbcbbf341e8f65261: Request end of tablet copy session 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6 received from {username='slave'} at 127.14.127.194:50475
I20240501 08:14:49.492436 17130 tablet_copy_service.cc:433] P 61b9e916fc66428cbcbbf341e8f65261: ending tablet copy session 5230673348d44738ba9ff0edc702b200-4ce1a5f2b6e1493999cfbd7fbde6fab6 on tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 with peer 5230673348d44738ba9ff0edc702b200
W20240501 08:14:49.495824 16847 ts_tablet_manager.cc:701] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Tablet Copy: Invalid argument: Leader has replica of tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 with term 0, which is lower than last-logged term 4 on local replica. Rejecting tablet copy request
W20240501 08:14:49.537218 16847 ts_tablet_manager.cc:701] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Tablet Copy: Invalid argument: Leader has replica of tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 with term 0, which is lower than last-logged term 4 on local replica. Rejecting tablet copy request
I20240501 08:14:49.539599 16769 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ce1a5f2b6e1493999cfbd7fbde6fab6 with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:52536
I20240501 08:14:49.540251 17392 tablet_replica.cc:330] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: stopping tablet replica
I20240501 08:14:49.540625 17392 raft_consensus.cc:2229] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200 [term 4 NON_PARTICIPANT]: Raft consensus shutting down.
I20240501 08:14:49.540895 17392 raft_consensus.cc:2258] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200 [term 4 NON_PARTICIPANT]: Raft consensus is shut down!
I20240501 08:14:49.542038 17392 ts_tablet_manager.cc:1875] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Deleting tablet data with delete state TABLET_DATA_DELETED
I20240501 08:14:49.546203 17392 ts_tablet_manager.cc:1888] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 4.212
I20240501 08:14:49.546314 17392 log.cc:1196] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Deleting WAL directory at /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/wal/wals/4ce1a5f2b6e1493999cfbd7fbde6fab6
I20240501 08:14:49.546756 17392 ts_tablet_manager.cc:1909] T 4ce1a5f2b6e1493999cfbd7fbde6fab6 P 5230673348d44738ba9ff0edc702b200: Deleting consensus metadata
I20240501 08:14:49.548089 14847 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu pid 16707
I20240501 08:14:49.548866 16829 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 08:14:49.649257 14847 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu with pid 16707
I20240501 08:14:49.670123 14847 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
/tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.127.194:42935
--local_ip_for_outbound_sockets=127.14.127.194
--tserver_master_addrs=127.14.127.254:36067
--webserver_port=38583
--webserver_interface=127.14.127.194
--builtin_ntp_servers=127.14.127.212:46101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240501 08:14:49.959204 17394 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 08:14:49.959487 17394 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 08:14:49.959611 17394 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 08:14:49.966408 17394 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 08:14:49.966570 17394 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.127.194
I20240501 08:14:49.974764 17394 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.127.212:46101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.127.194:42935
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.127.194
--webserver_port=38583
--tserver_master_addrs=127.14.127.254:36067
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.127.194
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 07:43:24 UTC on efd1337a2aa3
build id 71
ASAN enabled
I20240501 08:14:49.975869 17394 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 08:14:49.977468 17394 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:14:49.988240 17400 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:49.988873 17399 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:49.989387 17402 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:14:49.989979 17394 server_base.cc:1034] running on GCE node
I20240501 08:14:49.990474 17394 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 08:14:49.991168 17394 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 08:14:49.992347 17394 hybrid_clock.cc:648] HybridClock initialized: now 1714551289992296 us; error 40 us; skew 500 ppm
I20240501 08:14:49.992586 17394 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:14:49.994711 17394 webserver.cc:460] Webserver started at http://127.14.127.194:38583/ using document root <none> and password file <none>
I20240501 08:14:49.995342 17394 fs_manager.cc:359] Metadata directory not provided
I20240501 08:14:49.995441 17394 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:14:50.000047 17394 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20240501 08:14:50.002496 17408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:50.003608 17394 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240501 08:14:50.003751 17394 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data,/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/wal
uuid: "5230673348d44738ba9ff0edc702b200"
format_stamp: "Formatted at 2024-05-01 08:14:40 on dist-test-slave-2bdt"
I20240501 08:14:50.004485 17394 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:14:50.023430 17394 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:14:50.024164 17394 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 08:14:50.024403 17394 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:14:50.025189 17394 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 08:14:50.026528 17394 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 08:14:50.026620 17394 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:50.026736 17394 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 08:14:50.026808 17394 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:50.056303 17394 rpc_server.cc:307] RPC server started. Bound to: 127.14.127.194:42935
I20240501 08:14:50.056366 17520 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.127.194:42935 every 8 connection(s)
I20240501 08:14:50.057526 17394 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714551278873485-14847-0/minicluster-data/ts-1/data/info.pb
I20240501 08:14:50.065191 14847 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu as pid 17394
I20240501 08:14:50.065569 14847 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu pid 16846
I20240501 08:14:50.069314 17521 heartbeater.cc:347] Connected to a master server at 127.14.127.254:36067
I20240501 08:14:50.069548 17521 heartbeater.cc:464] Registering TS with master...
I20240501 08:14:50.070277 17521 heartbeater.cc:511] Master 127.14.127.254:36067 requested a full tablet report, sending...
I20240501 08:14:50.071548 15244 ts_manager.cc:194] Re-registered known tserver with Master: 5230673348d44738ba9ff0edc702b200 (127.14.127.194:42935)
I20240501 08:14:50.072346 15244 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.127.194:36255
I20240501 08:14:50.073113 17150 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 08:14:50.166064 14847 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu with pid 16846
I20240501 08:14:50.184731 14847 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu pid 17394
I20240501 08:14:50.192590 17516 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 08:14:50.270336 14847 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu with pid 17394
I20240501 08:14:50.286700 14847 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu pid 15214
I20240501 08:14:50.287791 15276 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 08:14:50.383318 14847 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu with pid 15214
2024-05-01T08:14:50Z chronyd exiting
[ OK ] TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping (11485 ms)
[ RUN ] TabletCopyClientSessionITest.TestStartTabletCopy
2024-05-01T08:14:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-01T08:14:50Z Disabled control of system clock
I20240501 08:14:50.444219 14847 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
/tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.127.254:33483
--webserver_interface=127.14.127.254
--webserver_port=0
--builtin_ntp_servers=127.14.127.212:45343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.127.254:33483
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240501 08:14:50.736256 17534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 08:14:50.736514 17534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 08:14:50.736589 17534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 08:14:50.743463 17534 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240501 08:14:50.743551 17534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 08:14:50.743592 17534 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240501 08:14:50.743644 17534 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240501 08:14:50.755434 17534 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.127.212:45343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.14.127.254:33483
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.127.254:33483
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.127.254
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 07:43:24 UTC on efd1337a2aa3
build id 71
ASAN enabled
I20240501 08:14:50.756644 17534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 08:14:50.758322 17534 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:14:50.768556 17539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:50.769274 17540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:50.769851 17542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:14:50.770433 17534 server_base.cc:1034] running on GCE node
I20240501 08:14:50.771045 17534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 08:14:50.772465 17534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 08:14:50.773706 17534 hybrid_clock.cc:648] HybridClock initialized: now 1714551290773655 us; error 34 us; skew 500 ppm
I20240501 08:14:50.773995 17534 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:14:50.780510 17534 webserver.cc:460] Webserver started at http://127.14.127.254:41409/ using document root <none> and password file <none>
I20240501 08:14:50.781136 17534 fs_manager.cc:359] Metadata directory not provided
I20240501 08:14:50.781262 17534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:14:50.781540 17534 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 08:14:50.783843 17534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/master-0/data/instance:
uuid: "854539be3de6474eb90ad6c49521cc4e"
format_stamp: "Formatted at 2024-05-01 08:14:50 on dist-test-slave-2bdt"
I20240501 08:14:50.784520 17534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/master-0/wal/instance:
uuid: "854539be3de6474eb90ad6c49521cc4e"
format_stamp: "Formatted at 2024-05-01 08:14:50 on dist-test-slave-2bdt"
I20240501 08:14:50.789158 17534 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20240501 08:14:50.792277 17548 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:50.793362 17534 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240501 08:14:50.793511 17534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/master-0/data,/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/master-0/wal
uuid: "854539be3de6474eb90ad6c49521cc4e"
format_stamp: "Formatted at 2024-05-01 08:14:50 on dist-test-slave-2bdt"
I20240501 08:14:50.793710 17534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:14:50.811218 17534 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:14:50.811866 17534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 08:14:50.812112 17534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:14:50.828385 17534 rpc_server.cc:307] RPC server started. Bound to: 127.14.127.254:33483
I20240501 08:14:50.828415 17599 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.127.254:33483 every 8 connection(s)
I20240501 08:14:50.829509 17534 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/master-0/data/info.pb
I20240501 08:14:50.832799 17600 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:14:50.837253 14847 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu as pid 17534
I20240501 08:14:50.837489 14847 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/master-0/wal/instance
I20240501 08:14:50.841908 17600 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e: Bootstrap starting.
I20240501 08:14:50.844633 17600 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e: Neither blocks nor log segments found. Creating new log.
I20240501 08:14:50.845551 17600 log.cc:824] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e: Log is configured to *not* fsync() on all Append() calls
I20240501 08:14:50.848237 17600 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e: No bootstrap required, opened a new log
I20240501 08:14:50.854398 17600 raft_consensus.cc:348] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "854539be3de6474eb90ad6c49521cc4e" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 33483 } }
I20240501 08:14:50.854684 17600 raft_consensus.cc:374] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:14:50.854756 17600 raft_consensus.cc:729] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 854539be3de6474eb90ad6c49521cc4e, State: Initialized, Role: FOLLOWER
I20240501 08:14:50.855262 17600 consensus_queue.cc:260] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "854539be3de6474eb90ad6c49521cc4e" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 33483 } }
I20240501 08:14:50.855432 17600 raft_consensus.cc:388] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:14:50.855517 17600 raft_consensus.cc:482] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:14:50.855619 17600 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:14:50.857600 17600 raft_consensus.cc:504] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "854539be3de6474eb90ad6c49521cc4e" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 33483 } }
I20240501 08:14:50.858003 17600 leader_election.cc:302] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 854539be3de6474eb90ad6c49521cc4e; no voters:
I20240501 08:14:50.858477 17600 leader_election.cc:288] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 08:14:50.858587 17605 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:14:50.859269 17605 raft_consensus.cc:686] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e [term 1 LEADER]: Becoming Leader. State: Replica: 854539be3de6474eb90ad6c49521cc4e, State: Running, Role: LEADER
I20240501 08:14:50.859741 17605 consensus_queue.cc:237] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "854539be3de6474eb90ad6c49521cc4e" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 33483 } }
I20240501 08:14:50.860210 17600 sys_catalog.cc:564] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e [sys.catalog]: configured and running, proceeding with master startup.
I20240501 08:14:50.862526 17606 sys_catalog.cc:455] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "854539be3de6474eb90ad6c49521cc4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "854539be3de6474eb90ad6c49521cc4e" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 33483 } } }
I20240501 08:14:50.862869 17606 sys_catalog.cc:458] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e [sys.catalog]: This master's current role is: LEADER
I20240501 08:14:50.863451 17607 sys_catalog.cc:455] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 854539be3de6474eb90ad6c49521cc4e. Latest consensus state: current_term: 1 leader_uuid: "854539be3de6474eb90ad6c49521cc4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "854539be3de6474eb90ad6c49521cc4e" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 33483 } } }
I20240501 08:14:50.863729 17607 sys_catalog.cc:458] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e [sys.catalog]: This master's current role is: LEADER
I20240501 08:14:50.864624 17614 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240501 08:14:50.869253 17614 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240501 08:14:50.877067 17614 catalog_manager.cc:1347] Generated new cluster ID: f2661eb737374158859396023d8fba83
I20240501 08:14:50.877161 17614 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240501 08:14:50.888424 17614 catalog_manager.cc:1370] Generated new certificate authority record
I20240501 08:14:50.889940 17614 catalog_manager.cc:1504] Loading token signing keys...
I20240501 08:14:50.903007 17614 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e: Generated new TSK 0
I20240501 08:14:50.903810 17614 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240501 08:14:50.913025 14847 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
/tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.127.193:0
--local_ip_for_outbound_sockets=127.14.127.193
--webserver_interface=127.14.127.193
--webserver_port=0
--tserver_master_addrs=127.14.127.254:33483
--builtin_ntp_servers=127.14.127.212:45343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240501 08:14:51.215905 17624 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 08:14:51.216168 17624 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 08:14:51.216305 17624 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 08:14:51.223315 17624 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 08:14:51.223496 17624 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.127.193
I20240501 08:14:51.231536 17624 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.127.212:45343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.127.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.127.193
--webserver_port=0
--tserver_master_addrs=127.14.127.254:33483
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.127.193
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 07:43:24 UTC on efd1337a2aa3
build id 71
ASAN enabled
I20240501 08:14:51.232632 17624 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 08:14:51.234200 17624 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:14:51.246295 17629 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:51.246963 17630 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:51.247587 17632 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:14:51.248205 17624 server_base.cc:1034] running on GCE node
I20240501 08:14:51.248703 17624 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 08:14:51.249460 17624 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 08:14:51.250720 17624 hybrid_clock.cc:648] HybridClock initialized: now 1714551291250633 us; error 32 us; skew 500 ppm
I20240501 08:14:51.250969 17624 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:14:51.253039 17624 webserver.cc:460] Webserver started at http://127.14.127.193:35305/ using document root <none> and password file <none>
I20240501 08:14:51.253736 17624 fs_manager.cc:359] Metadata directory not provided
I20240501 08:14:51.253851 17624 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:14:51.254101 17624 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 08:14:51.256498 17624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-0/data/instance:
uuid: "5e1fd5888b764b14840989aeb4ecc04a"
format_stamp: "Formatted at 2024-05-01 08:14:51 on dist-test-slave-2bdt"
I20240501 08:14:51.257120 17624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-0/wal/instance:
uuid: "5e1fd5888b764b14840989aeb4ecc04a"
format_stamp: "Formatted at 2024-05-01 08:14:51 on dist-test-slave-2bdt"
I20240501 08:14:51.261924 17624 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20240501 08:14:51.264838 17638 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:51.266072 17624 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240501 08:14:51.266206 17624 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-0/data,/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-0/wal
uuid: "5e1fd5888b764b14840989aeb4ecc04a"
format_stamp: "Formatted at 2024-05-01 08:14:51 on dist-test-slave-2bdt"
I20240501 08:14:51.266384 17624 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:14:51.281802 17624 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:14:51.282445 17624 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 08:14:51.282696 17624 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:14:51.283463 17624 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 08:14:51.284713 17624 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 08:14:51.284780 17624 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:51.284891 17624 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 08:14:51.284950 17624 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:51.314235 17624 rpc_server.cc:307] RPC server started. Bound to: 127.14.127.193:44177
I20240501 08:14:51.314294 17750 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.127.193:44177 every 8 connection(s)
I20240501 08:14:51.315339 17624 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-0/data/info.pb
I20240501 08:14:51.320111 14847 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu as pid 17624
I20240501 08:14:51.320271 14847 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-0/wal/instance
I20240501 08:14:51.323352 14847 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
/tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.127.194:0
--local_ip_for_outbound_sockets=127.14.127.194
--webserver_interface=127.14.127.194
--webserver_port=0
--tserver_master_addrs=127.14.127.254:33483
--builtin_ntp_servers=127.14.127.212:45343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240501 08:14:51.326514 17751 heartbeater.cc:347] Connected to a master server at 127.14.127.254:33483
I20240501 08:14:51.326745 17751 heartbeater.cc:464] Registering TS with master...
I20240501 08:14:51.327423 17751 heartbeater.cc:511] Master 127.14.127.254:33483 requested a full tablet report, sending...
I20240501 08:14:51.329494 17565 ts_manager.cc:194] Registered new tserver with Master: 5e1fd5888b764b14840989aeb4ecc04a (127.14.127.193:44177)
I20240501 08:14:51.331583 17565 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.127.193:49733
W20240501 08:14:51.620292 17754 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 08:14:51.620522 17754 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 08:14:51.620595 17754 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 08:14:51.627199 17754 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 08:14:51.627332 17754 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.127.194
I20240501 08:14:51.635334 17754 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.127.212:45343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.127.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.127.194
--webserver_port=0
--tserver_master_addrs=127.14.127.254:33483
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.127.194
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 07:43:24 UTC on efd1337a2aa3
build id 71
ASAN enabled
I20240501 08:14:51.636379 17754 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 08:14:51.637931 17754 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:14:51.648869 17759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:51.649287 17762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:51.650064 17760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:14:51.650861 17754 server_base.cc:1034] running on GCE node
I20240501 08:14:51.651374 17754 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 08:14:51.652150 17754 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 08:14:51.653353 17754 hybrid_clock.cc:648] HybridClock initialized: now 1714551291653297 us; error 33 us; skew 500 ppm
I20240501 08:14:51.653653 17754 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:14:51.655649 17754 webserver.cc:460] Webserver started at http://127.14.127.194:42819/ using document root <none> and password file <none>
I20240501 08:14:51.656260 17754 fs_manager.cc:359] Metadata directory not provided
I20240501 08:14:51.656379 17754 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:14:51.656646 17754 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 08:14:51.658988 17754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-1/data/instance:
uuid: "9bb315eae89642a385087b1d14cfaa25"
format_stamp: "Formatted at 2024-05-01 08:14:51 on dist-test-slave-2bdt"
I20240501 08:14:51.659638 17754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-1/wal/instance:
uuid: "9bb315eae89642a385087b1d14cfaa25"
format_stamp: "Formatted at 2024-05-01 08:14:51 on dist-test-slave-2bdt"
I20240501 08:14:51.664310 17754 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20240501 08:14:51.667449 17768 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:51.668581 17754 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20240501 08:14:51.668726 17754 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-1/data,/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-1/wal
uuid: "9bb315eae89642a385087b1d14cfaa25"
format_stamp: "Formatted at 2024-05-01 08:14:51 on dist-test-slave-2bdt"
I20240501 08:14:51.668879 17754 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:14:51.692906 17754 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:14:51.693519 17754 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 08:14:51.693773 17754 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:14:51.694510 17754 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 08:14:51.695811 17754 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 08:14:51.695880 17754 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:51.695993 17754 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 08:14:51.696046 17754 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:51.724557 17754 rpc_server.cc:307] RPC server started. Bound to: 127.14.127.194:36871
I20240501 08:14:51.724619 17880 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.127.194:36871 every 8 connection(s)
I20240501 08:14:51.725636 17754 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-1/data/info.pb
I20240501 08:14:51.730259 14847 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu as pid 17754
I20240501 08:14:51.730420 14847 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-1/wal/instance
I20240501 08:14:51.736579 17881 heartbeater.cc:347] Connected to a master server at 127.14.127.254:33483
I20240501 08:14:51.736809 17881 heartbeater.cc:464] Registering TS with master...
I20240501 08:14:51.737481 17881 heartbeater.cc:511] Master 127.14.127.254:33483 requested a full tablet report, sending...
I20240501 08:14:51.738611 17565 ts_manager.cc:194] Registered new tserver with Master: 9bb315eae89642a385087b1d14cfaa25 (127.14.127.194:36871)
I20240501 08:14:51.739289 17565 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.127.194:45733
I20240501 08:14:51.745095 14847 external_mini_cluster.cc:930] 2 TS(s) registered with all masters
I20240501 08:14:51.757329 14847 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu pid 17754
I20240501 08:14:51.764076 17876 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 08:14:51.847739 14847 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu with pid 17754
I20240501 08:14:51.862955 14847 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu pid 17534
I20240501 08:14:51.863919 17595 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 08:14:51.954308 14847 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu with pid 17534
I20240501 08:14:51.973084 14847 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
/tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.127.254:33483
--webserver_interface=127.14.127.254
--webserver_port=41409
--builtin_ntp_servers=127.14.127.212:45343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.127.254:33483
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240501 08:14:52.267881 17893 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 08:14:52.268105 17893 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 08:14:52.268193 17893 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 08:14:52.274919 17893 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240501 08:14:52.275007 17893 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 08:14:52.275050 17893 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240501 08:14:52.275099 17893 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240501 08:14:52.283181 17893 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.127.212:45343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.14.127.254:33483
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.127.254:33483
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.127.254
--webserver_port=41409
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 07:43:24 UTC on efd1337a2aa3
build id 71
ASAN enabled
I20240501 08:14:52.284169 17893 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 08:14:52.285696 17893 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:14:52.295521 17898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:52.296213 17901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:52.296736 17899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:14:52.297431 17893 server_base.cc:1034] running on GCE node
I20240501 08:14:52.298080 17893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 08:14:52.299186 17893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 08:14:52.300400 17893 hybrid_clock.cc:648] HybridClock initialized: now 1714551292300338 us; error 36 us; skew 500 ppm
I20240501 08:14:52.300688 17893 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:14:52.302616 17893 webserver.cc:460] Webserver started at http://127.14.127.254:41409/ using document root <none> and password file <none>
I20240501 08:14:52.303196 17893 fs_manager.cc:359] Metadata directory not provided
I20240501 08:14:52.303342 17893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:14:52.307546 17893 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20240501 08:14:52.309814 17907 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:52.310966 17893 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20240501 08:14:52.311116 17893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/master-0/data,/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/master-0/wal
uuid: "854539be3de6474eb90ad6c49521cc4e"
format_stamp: "Formatted at 2024-05-01 08:14:50 on dist-test-slave-2bdt"
I20240501 08:14:52.311841 17893 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:14:52.322105 17893 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:14:52.322763 17893 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 08:14:52.322999 17893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:14:52.334432 17751 heartbeater.cc:503] Master 127.14.127.254:33483 was elected leader, sending a full tablet report...
W20240501 08:14:52.335839 17751 heartbeater.cc:644] Failed to heartbeat to 127.14.127.254:33483 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.14.127.254:33483: connect: Connection refused (error 111)
I20240501 08:14:52.338588 17893 rpc_server.cc:307] RPC server started. Bound to: 127.14.127.254:33483
I20240501 08:14:52.338613 17959 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.127.254:33483 every 8 connection(s)
I20240501 08:14:52.339685 17893 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/master-0/data/info.pb
I20240501 08:14:52.344915 17960 sys_catalog.cc:263] Verifying existing consensus state
I20240501 08:14:52.347584 17960 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e: Bootstrap starting.
I20240501 08:14:52.347924 14847 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu as pid 17893
I20240501 08:14:52.362490 17960 log.cc:824] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e: Log is configured to *not* fsync() on all Append() calls
I20240501 08:14:52.368974 17960 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:14:52.369375 17960 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e: Bootstrap complete.
I20240501 08:14:52.376120 17960 raft_consensus.cc:348] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "854539be3de6474eb90ad6c49521cc4e" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 33483 } }
I20240501 08:14:52.376730 17960 raft_consensus.cc:729] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 854539be3de6474eb90ad6c49521cc4e, State: Initialized, Role: FOLLOWER
I20240501 08:14:52.377192 17960 consensus_queue.cc:260] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "854539be3de6474eb90ad6c49521cc4e" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 33483 } }
I20240501 08:14:52.377375 17960 raft_consensus.cc:388] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:14:52.377449 17960 raft_consensus.cc:482] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:14:52.377627 17960 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:14:52.380704 17960 raft_consensus.cc:504] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "854539be3de6474eb90ad6c49521cc4e" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 33483 } }
I20240501 08:14:52.381093 17960 leader_election.cc:302] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 854539be3de6474eb90ad6c49521cc4e; no voters:
I20240501 08:14:52.381552 17960 leader_election.cc:288] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 08:14:52.381757 17965 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:14:52.382408 17965 raft_consensus.cc:686] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e [term 2 LEADER]: Becoming Leader. State: Replica: 854539be3de6474eb90ad6c49521cc4e, State: Running, Role: LEADER
I20240501 08:14:52.382911 17965 consensus_queue.cc:237] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "854539be3de6474eb90ad6c49521cc4e" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 33483 } }
I20240501 08:14:52.383437 17960 sys_catalog.cc:564] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e [sys.catalog]: configured and running, proceeding with master startup.
I20240501 08:14:52.385205 17966 sys_catalog.cc:455] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "854539be3de6474eb90ad6c49521cc4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "854539be3de6474eb90ad6c49521cc4e" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 33483 } } }
I20240501 08:14:52.385529 17966 sys_catalog.cc:458] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e [sys.catalog]: This master's current role is: LEADER
I20240501 08:14:52.385331 17967 sys_catalog.cc:455] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 854539be3de6474eb90ad6c49521cc4e. Latest consensus state: current_term: 2 leader_uuid: "854539be3de6474eb90ad6c49521cc4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "854539be3de6474eb90ad6c49521cc4e" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 33483 } } }
I20240501 08:14:52.386063 17967 sys_catalog.cc:458] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e [sys.catalog]: This master's current role is: LEADER
I20240501 08:14:52.387794 17973 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240501 08:14:52.392875 17973 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240501 08:14:52.394188 17973 catalog_manager.cc:1259] Loaded cluster ID: f2661eb737374158859396023d8fba83
I20240501 08:14:52.394258 17973 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240501 08:14:52.397248 17973 catalog_manager.cc:1504] Loading token signing keys...
I20240501 08:14:52.398280 17973 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 854539be3de6474eb90ad6c49521cc4e: Loaded TSK: 0
I20240501 08:14:52.399300 17973 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240501 08:14:53.342967 17751 heartbeater.cc:347] Connected to a master server at 127.14.127.254:33483
I20240501 08:14:53.343187 17751 heartbeater.cc:503] Master 127.14.127.254:33483 was elected leader, sending a full tablet report...
I20240501 08:14:53.345465 17924 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "5e1fd5888b764b14840989aeb4ecc04a" instance_seqno: 1714551291307199) as {username='slave'} at 127.14.127.193:47359; Asking this server to re-register.
I20240501 08:14:53.346194 17751 heartbeater.cc:464] Registering TS with master...
I20240501 08:14:53.346413 17751 heartbeater.cc:511] Master 127.14.127.254:33483 requested a full tablet report, sending...
I20240501 08:14:53.347473 17924 ts_manager.cc:194] Registered new tserver with Master: 5e1fd5888b764b14840989aeb4ecc04a (127.14.127.193:44177)
I20240501 08:14:53.357697 14847 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20240501 08:14:53.357859 14847 test_util.cc:268] Using random seed: 348794640
I20240501 08:14:53.374866 17924 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42366:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20240501 08:14:53.396342 17686 tablet_service.cc:1467] Processing CreateTablet for tablet 5daf3bd4682046a682c4bdfc3a144ac5 (DEFAULT_TABLE table=test-workload [id=36075c98306045f3997a6599bd79a576]), partition=RANGE (key) PARTITION UNBOUNDED
I20240501 08:14:53.397486 17686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5daf3bd4682046a682c4bdfc3a144ac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:14:53.406091 17995 tablet_bootstrap.cc:492] T 5daf3bd4682046a682c4bdfc3a144ac5 P 5e1fd5888b764b14840989aeb4ecc04a: Bootstrap starting.
I20240501 08:14:53.408414 17995 tablet_bootstrap.cc:654] T 5daf3bd4682046a682c4bdfc3a144ac5 P 5e1fd5888b764b14840989aeb4ecc04a: Neither blocks nor log segments found. Creating new log.
I20240501 08:14:53.409391 17995 log.cc:824] T 5daf3bd4682046a682c4bdfc3a144ac5 P 5e1fd5888b764b14840989aeb4ecc04a: Log is configured to *not* fsync() on all Append() calls
I20240501 08:14:53.411304 17995 tablet_bootstrap.cc:492] T 5daf3bd4682046a682c4bdfc3a144ac5 P 5e1fd5888b764b14840989aeb4ecc04a: No bootstrap required, opened a new log
I20240501 08:14:53.411517 17995 ts_tablet_manager.cc:1367] T 5daf3bd4682046a682c4bdfc3a144ac5 P 5e1fd5888b764b14840989aeb4ecc04a: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20240501 08:14:53.416572 17995 raft_consensus.cc:348] T 5daf3bd4682046a682c4bdfc3a144ac5 P 5e1fd5888b764b14840989aeb4ecc04a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e1fd5888b764b14840989aeb4ecc04a" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 44177 } }
I20240501 08:14:53.416822 17995 raft_consensus.cc:374] T 5daf3bd4682046a682c4bdfc3a144ac5 P 5e1fd5888b764b14840989aeb4ecc04a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:14:53.416910 17995 raft_consensus.cc:729] T 5daf3bd4682046a682c4bdfc3a144ac5 P 5e1fd5888b764b14840989aeb4ecc04a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e1fd5888b764b14840989aeb4ecc04a, State: Initialized, Role: FOLLOWER
I20240501 08:14:53.417411 17995 consensus_queue.cc:260] T 5daf3bd4682046a682c4bdfc3a144ac5 P 5e1fd5888b764b14840989aeb4ecc04a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e1fd5888b764b14840989aeb4ecc04a" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 44177 } }
I20240501 08:14:53.417575 17995 raft_consensus.cc:388] T 5daf3bd4682046a682c4bdfc3a144ac5 P 5e1fd5888b764b14840989aeb4ecc04a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:14:53.417709 17995 raft_consensus.cc:482] T 5daf3bd4682046a682c4bdfc3a144ac5 P 5e1fd5888b764b14840989aeb4ecc04a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:14:53.417833 17995 raft_consensus.cc:3037] T 5daf3bd4682046a682c4bdfc3a144ac5 P 5e1fd5888b764b14840989aeb4ecc04a [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:14:53.419508 17995 raft_consensus.cc:504] T 5daf3bd4682046a682c4bdfc3a144ac5 P 5e1fd5888b764b14840989aeb4ecc04a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e1fd5888b764b14840989aeb4ecc04a" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 44177 } }
I20240501 08:14:53.419924 17995 leader_election.cc:302] T 5daf3bd4682046a682c4bdfc3a144ac5 P 5e1fd5888b764b14840989aeb4ecc04a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5e1fd5888b764b14840989aeb4ecc04a; no voters:
I20240501 08:14:53.420419 17995 leader_election.cc:288] T 5daf3bd4682046a682c4bdfc3a144ac5 P 5e1fd5888b764b14840989aeb4ecc04a [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 08:14:53.420572 17997 raft_consensus.cc:2781] T 5daf3bd4682046a682c4bdfc3a144ac5 P 5e1fd5888b764b14840989aeb4ecc04a [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:14:53.421157 17997 raft_consensus.cc:686] T 5daf3bd4682046a682c4bdfc3a144ac5 P 5e1fd5888b764b14840989aeb4ecc04a [term 1 LEADER]: Becoming Leader. State: Replica: 5e1fd5888b764b14840989aeb4ecc04a, State: Running, Role: LEADER
I20240501 08:14:53.421690 17997 consensus_queue.cc:237] T 5daf3bd4682046a682c4bdfc3a144ac5 P 5e1fd5888b764b14840989aeb4ecc04a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e1fd5888b764b14840989aeb4ecc04a" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 44177 } }
I20240501 08:14:53.422055 17995 ts_tablet_manager.cc:1398] T 5daf3bd4682046a682c4bdfc3a144ac5 P 5e1fd5888b764b14840989aeb4ecc04a: Time spent starting tablet: real 0.010s user 0.011s sys 0.000s
I20240501 08:14:53.426097 17924 catalog_manager.cc:5484] T 5daf3bd4682046a682c4bdfc3a144ac5 P 5e1fd5888b764b14840989aeb4ecc04a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e1fd5888b764b14840989aeb4ecc04a (127.14.127.193). New cstate: current_term: 1 leader_uuid: "5e1fd5888b764b14840989aeb4ecc04a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e1fd5888b764b14840989aeb4ecc04a" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 44177 } health_report { overall_health: HEALTHY } } }
I20240501 08:14:54.035034 14847 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
/tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.127.194:36871
--local_ip_for_outbound_sockets=127.14.127.194
--tserver_master_addrs=127.14.127.254:33483
--webserver_port=42819
--webserver_interface=127.14.127.194
--builtin_ntp_servers=127.14.127.212:45343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240501 08:14:54.357383 18012 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 08:14:54.357733 18012 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 08:14:54.357872 18012 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 08:14:54.365000 18012 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 08:14:54.365172 18012 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.127.194
I20240501 08:14:54.373636 18012 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.127.212:45343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.127.194:36871
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.127.194
--webserver_port=42819
--tserver_master_addrs=127.14.127.254:33483
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.127.194
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 07:43:24 UTC on efd1337a2aa3
build id 71
ASAN enabled
I20240501 08:14:54.374766 18012 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 08:14:54.376333 18012 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:14:54.387797 18017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:54.388571 18018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:54.389091 18020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:14:54.389741 18012 server_base.cc:1034] running on GCE node
I20240501 08:14:54.390266 18012 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 08:14:54.391005 18012 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 08:14:54.392220 18012 hybrid_clock.cc:648] HybridClock initialized: now 1714551294392168 us; error 27 us; skew 500 ppm
I20240501 08:14:54.392516 18012 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:14:54.394671 18012 webserver.cc:460] Webserver started at http://127.14.127.194:42819/ using document root <none> and password file <none>
I20240501 08:14:54.395310 18012 fs_manager.cc:359] Metadata directory not provided
I20240501 08:14:54.395463 18012 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:14:54.400214 18012 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.002s
I20240501 08:14:54.402690 18026 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:54.403869 18012 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240501 08:14:54.404016 18012 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-1/data,/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-1/wal
uuid: "9bb315eae89642a385087b1d14cfaa25"
format_stamp: "Formatted at 2024-05-01 08:14:51 on dist-test-slave-2bdt"
I20240501 08:14:54.404731 18012 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:14:54.448995 18012 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:14:54.449769 18012 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 08:14:54.450008 18012 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:14:54.450883 18012 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 08:14:54.452200 18012 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 08:14:54.452296 18012 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:54.452399 18012 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 08:14:54.452474 18012 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:54.481446 18012 rpc_server.cc:307] RPC server started. Bound to: 127.14.127.194:36871
I20240501 08:14:54.481492 18138 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.127.194:36871 every 8 connection(s)
I20240501 08:14:54.482723 18012 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-1/data/info.pb
I20240501 08:14:54.491814 14847 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu as pid 18012
I20240501 08:14:54.494036 18139 heartbeater.cc:347] Connected to a master server at 127.14.127.254:33483
I20240501 08:14:54.494297 18139 heartbeater.cc:464] Registering TS with master...
I20240501 08:14:54.495281 18139 heartbeater.cc:511] Master 127.14.127.254:33483 requested a full tablet report, sending...
I20240501 08:14:54.496806 17921 ts_manager.cc:194] Registered new tserver with Master: 9bb315eae89642a385087b1d14cfaa25 (127.14.127.194:36871)
I20240501 08:14:54.497814 17921 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.127.194:35577
I20240501 08:14:54.502547 18144 ts_tablet_manager.cc:902] T 5daf3bd4682046a682c4bdfc3a144ac5 P 9bb315eae89642a385087b1d14cfaa25: Initiating tablet copy from peer 5e1fd5888b764b14840989aeb4ecc04a (127.14.127.193:44177)
I20240501 08:14:54.503962 18144 tablet_copy_client.cc:308] T 5daf3bd4682046a682c4bdfc3a144ac5 P 9bb315eae89642a385087b1d14cfaa25: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:44177
I20240501 08:14:54.508530 17726 tablet_copy_service.cc:140] P 5e1fd5888b764b14840989aeb4ecc04a: Received BeginTabletCopySession request for tablet 5daf3bd4682046a682c4bdfc3a144ac5 from peer 9bb315eae89642a385087b1d14cfaa25 ({username='slave'} at 127.14.127.194:37329)
I20240501 08:14:54.508728 17726 tablet_copy_service.cc:161] P 5e1fd5888b764b14840989aeb4ecc04a: Beginning new tablet copy session on tablet 5daf3bd4682046a682c4bdfc3a144ac5 from peer 9bb315eae89642a385087b1d14cfaa25 at {username='slave'} at 127.14.127.194:37329: session id = 9bb315eae89642a385087b1d14cfaa25-5daf3bd4682046a682c4bdfc3a144ac5
I20240501 08:14:54.510942 17726 tablet_copy_source_session.cc:205] T 5daf3bd4682046a682c4bdfc3a144ac5 P 5e1fd5888b764b14840989aeb4ecc04a: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 08:14:54.514390 18144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5daf3bd4682046a682c4bdfc3a144ac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:14:54.522905 18144 tablet_copy_client.cc:783] T 5daf3bd4682046a682c4bdfc3a144ac5 P 9bb315eae89642a385087b1d14cfaa25: tablet copy: Starting download of 0 data blocks...
I20240501 08:14:54.523185 18144 tablet_copy_client.cc:647] T 5daf3bd4682046a682c4bdfc3a144ac5 P 9bb315eae89642a385087b1d14cfaa25: tablet copy: Starting download of 1 WAL segments...
I20240501 08:14:54.526906 18144 tablet_copy_client.cc:523] T 5daf3bd4682046a682c4bdfc3a144ac5 P 9bb315eae89642a385087b1d14cfaa25: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 08:14:54.529549 18144 tablet_bootstrap.cc:492] T 5daf3bd4682046a682c4bdfc3a144ac5 P 9bb315eae89642a385087b1d14cfaa25: Bootstrap starting.
I20240501 08:14:54.588776 18144 log.cc:824] T 5daf3bd4682046a682c4bdfc3a144ac5 P 9bb315eae89642a385087b1d14cfaa25: Log is configured to *not* fsync() on all Append() calls
I20240501 08:14:55.067540 18144 tablet_bootstrap.cc:492] T 5daf3bd4682046a682c4bdfc3a144ac5 P 9bb315eae89642a385087b1d14cfaa25: Bootstrap replayed 1/1 log segments. Stats: ops{read=218 overwritten=0 applied=218 ignored=0} inserts{seen=10850 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:14:55.068010 18144 tablet_bootstrap.cc:492] T 5daf3bd4682046a682c4bdfc3a144ac5 P 9bb315eae89642a385087b1d14cfaa25: Bootstrap complete.
I20240501 08:14:55.068497 18144 ts_tablet_manager.cc:1367] T 5daf3bd4682046a682c4bdfc3a144ac5 P 9bb315eae89642a385087b1d14cfaa25: Time spent bootstrapping tablet: real 0.539s user 0.478s sys 0.060s
I20240501 08:14:55.073204 18144 raft_consensus.cc:348] T 5daf3bd4682046a682c4bdfc3a144ac5 P 9bb315eae89642a385087b1d14cfaa25 [term 1 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e1fd5888b764b14840989aeb4ecc04a" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 44177 } }
I20240501 08:14:55.073524 18144 raft_consensus.cc:729] T 5daf3bd4682046a682c4bdfc3a144ac5 P 9bb315eae89642a385087b1d14cfaa25 [term 1 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 9bb315eae89642a385087b1d14cfaa25, State: Initialized, Role: NON_PARTICIPANT
I20240501 08:14:55.074012 18144 consensus_queue.cc:260] T 5daf3bd4682046a682c4bdfc3a144ac5 P 9bb315eae89642a385087b1d14cfaa25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 218, Last appended: 1.218, Last appended by leader: 218, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e1fd5888b764b14840989aeb4ecc04a" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 44177 } }
I20240501 08:14:55.074936 18139 heartbeater.cc:503] Master 127.14.127.254:33483 was elected leader, sending a full tablet report...
I20240501 08:14:55.075533 18144 ts_tablet_manager.cc:1398] T 5daf3bd4682046a682c4bdfc3a144ac5 P 9bb315eae89642a385087b1d14cfaa25: Time spent starting tablet: real 0.007s user 0.009s sys 0.000s
I20240501 08:14:55.076443 17726 tablet_copy_service.cc:342] P 5e1fd5888b764b14840989aeb4ecc04a: Request end of tablet copy session 9bb315eae89642a385087b1d14cfaa25-5daf3bd4682046a682c4bdfc3a144ac5 received from {username='slave'} at 127.14.127.194:37329
I20240501 08:14:55.076587 17726 tablet_copy_service.cc:433] P 5e1fd5888b764b14840989aeb4ecc04a: ending tablet copy session 9bb315eae89642a385087b1d14cfaa25-5daf3bd4682046a682c4bdfc3a144ac5 on tablet 5daf3bd4682046a682c4bdfc3a144ac5 with peer 9bb315eae89642a385087b1d14cfaa25
I20240501 08:14:55.081838 18074 tablet_service.cc:1514] Processing DeleteTablet for tablet 5daf3bd4682046a682c4bdfc3a144ac5 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:43134
I20240501 08:14:55.082489 18151 tablet_replica.cc:330] T 5daf3bd4682046a682c4bdfc3a144ac5 P 9bb315eae89642a385087b1d14cfaa25: stopping tablet replica
I20240501 08:14:55.082806 18151 raft_consensus.cc:2229] T 5daf3bd4682046a682c4bdfc3a144ac5 P 9bb315eae89642a385087b1d14cfaa25 [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20240501 08:14:55.083019 18151 raft_consensus.cc:2258] T 5daf3bd4682046a682c4bdfc3a144ac5 P 9bb315eae89642a385087b1d14cfaa25 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20240501 08:14:55.084110 18151 ts_tablet_manager.cc:1875] T 5daf3bd4682046a682c4bdfc3a144ac5 P 9bb315eae89642a385087b1d14cfaa25: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 08:14:55.088093 18151 ts_tablet_manager.cc:1888] T 5daf3bd4682046a682c4bdfc3a144ac5 P 9bb315eae89642a385087b1d14cfaa25: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.218
I20240501 08:14:55.088187 18151 log.cc:1196] T 5daf3bd4682046a682c4bdfc3a144ac5 P 9bb315eae89642a385087b1d14cfaa25: Deleting WAL directory at /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714551278873485-14847-0/minicluster-data/ts-1/wal/wals/5daf3bd4682046a682c4bdfc3a144ac5
I20240501 08:14:55.089555 18144 ts_tablet_manager.cc:902] T 5daf3bd4682046a682c4bdfc3a144ac5 P 9bb315eae89642a385087b1d14cfaa25: Initiating tablet copy from peer 5e1fd5888b764b14840989aeb4ecc04a (127.14.127.193:44177)
I20240501 08:14:55.090514 18144 tablet_copy_client.cc:308] T 5daf3bd4682046a682c4bdfc3a144ac5 P 9bb315eae89642a385087b1d14cfaa25: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:44177
I20240501 08:14:55.091024 17726 tablet_copy_service.cc:140] P 5e1fd5888b764b14840989aeb4ecc04a: Received BeginTabletCopySession request for tablet 5daf3bd4682046a682c4bdfc3a144ac5 from peer 9bb315eae89642a385087b1d14cfaa25 ({username='slave'} at 127.14.127.194:37329)
I20240501 08:14:55.091178 17726 tablet_copy_service.cc:161] P 5e1fd5888b764b14840989aeb4ecc04a: Beginning new tablet copy session on tablet 5daf3bd4682046a682c4bdfc3a144ac5 from peer 9bb315eae89642a385087b1d14cfaa25 at {username='slave'} at 127.14.127.194:37329: session id = 9bb315eae89642a385087b1d14cfaa25-5daf3bd4682046a682c4bdfc3a144ac5
I20240501 08:14:55.092830 17726 tablet_copy_source_session.cc:205] T 5daf3bd4682046a682c4bdfc3a144ac5 P 5e1fd5888b764b14840989aeb4ecc04a: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 08:14:55.093472 18144 ts_tablet_manager.cc:1875] T 5daf3bd4682046a682c4bdfc3a144ac5 P 9bb315eae89642a385087b1d14cfaa25: Deleting tablet data with delete state TABLET_DATA_COPYING
I20240501 08:14:55.097170 18144 ts_tablet_manager.cc:1888] T 5daf3bd4682046a682c4bdfc3a144ac5 P 9bb315eae89642a385087b1d14cfaa25: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.218
I20240501 08:14:55.097468 18144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5daf3bd4682046a682c4bdfc3a144ac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:14:55.099443 18144 tablet_copy_client.cc:783] T 5daf3bd4682046a682c4bdfc3a144ac5 P 9bb315eae89642a385087b1d14cfaa25: tablet copy: Starting download of 0 data blocks...
I20240501 08:14:55.099634 18144 tablet_copy_client.cc:647] T 5daf3bd4682046a682c4bdfc3a144ac5 P 9bb315eae89642a385087b1d14cfaa25: tablet copy: Starting download of 1 WAL segments...
I20240501 08:14:55.103031 18144 tablet_copy_client.cc:523] T 5daf3bd4682046a682c4bdfc3a144ac5 P 9bb315eae89642a385087b1d14cfaa25: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 08:14:55.105015 18144 tablet_bootstrap.cc:492] T 5daf3bd4682046a682c4bdfc3a144ac5 P 9bb315eae89642a385087b1d14cfaa25: Bootstrap starting.
I20240501 08:14:55.626581 18144 tablet_bootstrap.cc:492] T 5daf3bd4682046a682c4bdfc3a144ac5 P 9bb315eae89642a385087b1d14cfaa25: Bootstrap replayed 1/1 log segments. Stats: ops{read=218 overwritten=0 applied=218 ignored=0} inserts{seen=10850 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:14:55.626982 18144 tablet_bootstrap.cc:492] T 5daf3bd4682046a682c4bdfc3a144ac5 P 9bb315eae89642a385087b1d14cfaa25: Bootstrap complete.
I20240501 08:14:55.627264 18144 ts_tablet_manager.cc:1367] T 5daf3bd4682046a682c4bdfc3a144ac5 P 9bb315eae89642a385087b1d14cfaa25: Time spent bootstrapping tablet: real 0.522s user 0.491s sys 0.031s
I20240501 08:14:55.627985 18144 raft_consensus.cc:348] T 5daf3bd4682046a682c4bdfc3a144ac5 P 9bb315eae89642a385087b1d14cfaa25 [term 1 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e1fd5888b764b14840989aeb4ecc04a" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 44177 } }
I20240501 08:14:55.628162 18144 raft_consensus.cc:729] T 5daf3bd4682046a682c4bdfc3a144ac5 P 9bb315eae89642a385087b1d14cfaa25 [term 1 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 9bb315eae89642a385087b1d14cfaa25, State: Initialized, Role: NON_PARTICIPANT
I20240501 08:14:55.628340 18144 consensus_queue.cc:260] T 5daf3bd4682046a682c4bdfc3a144ac5 P 9bb315eae89642a385087b1d14cfaa25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 218, Last appended: 1.218, Last appended by leader: 218, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e1fd5888b764b14840989aeb4ecc04a" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 44177 } }
I20240501 08:14:55.628923 18144 ts_tablet_manager.cc:1398] T 5daf3bd4682046a682c4bdfc3a144ac5 P 9bb315eae89642a385087b1d14cfaa25: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240501 08:14:55.629588 17726 tablet_copy_service.cc:342] P 5e1fd5888b764b14840989aeb4ecc04a: Request end of tablet copy session 9bb315eae89642a385087b1d14cfaa25-5daf3bd4682046a682c4bdfc3a144ac5 received from {username='slave'} at 127.14.127.194:37329
I20240501 08:14:55.629725 17726 tablet_copy_service.cc:433] P 5e1fd5888b764b14840989aeb4ecc04a: ending tablet copy session 9bb315eae89642a385087b1d14cfaa25-5daf3bd4682046a682c4bdfc3a144ac5 on tablet 5daf3bd4682046a682c4bdfc3a144ac5 with peer 9bb315eae89642a385087b1d14cfaa25
I20240501 08:14:55.633592 14847 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu pid 17624
I20240501 08:14:55.634418 17746 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 08:14:55.724813 14847 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu with pid 17624
I20240501 08:14:55.742345 14847 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu pid 18012
I20240501 08:14:55.743275 18134 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 08:14:55.851361 14847 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu with pid 18012
I20240501 08:14:55.870457 14847 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu pid 17893
I20240501 08:14:55.871495 17955 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 08:14:55.964514 14847 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu with pid 17893
2024-05-01T08:14:55Z chronyd exiting
[ OK ] TabletCopyClientSessionITest.TestStartTabletCopy (5579 ms)
[ RUN ] TabletCopyClientSessionITest.TestCopyFromCrashedSource
2024-05-01T08:14:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-01T08:14:56Z Disabled control of system clock
I20240501 08:14:56.025055 14847 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
/tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.127.254:38895
--webserver_interface=127.14.127.254
--webserver_port=0
--builtin_ntp_servers=127.14.127.212:36045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.127.254:38895
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240501 08:14:56.320809 18164 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 08:14:56.321041 18164 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 08:14:56.321143 18164 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 08:14:56.327612 18164 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240501 08:14:56.327726 18164 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 08:14:56.327777 18164 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240501 08:14:56.327828 18164 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240501 08:14:56.335769 18164 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.127.212:36045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.14.127.254:38895
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.127.254:38895
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.127.254
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 07:43:24 UTC on efd1337a2aa3
build id 71
ASAN enabled
I20240501 08:14:56.336755 18164 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 08:14:56.338212 18164 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:14:56.347831 18169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:56.348378 18172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:56.348874 18170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:14:56.349483 18164 server_base.cc:1034] running on GCE node
I20240501 08:14:56.350126 18164 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 08:14:56.351279 18164 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 08:14:56.352488 18164 hybrid_clock.cc:648] HybridClock initialized: now 1714551296352437 us; error 26 us; skew 500 ppm
I20240501 08:14:56.352779 18164 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:14:56.358266 18164 webserver.cc:460] Webserver started at http://127.14.127.254:33665/ using document root <none> and password file <none>
I20240501 08:14:56.358879 18164 fs_manager.cc:359] Metadata directory not provided
I20240501 08:14:56.359002 18164 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:14:56.359272 18164 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 08:14:56.361521 18164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/master-0/data/instance:
uuid: "4806c828fe4b45ca868c673af344709e"
format_stamp: "Formatted at 2024-05-01 08:14:56 on dist-test-slave-2bdt"
I20240501 08:14:56.362198 18164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/master-0/wal/instance:
uuid: "4806c828fe4b45ca868c673af344709e"
format_stamp: "Formatted at 2024-05-01 08:14:56 on dist-test-slave-2bdt"
I20240501 08:14:56.366619 18164 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20240501 08:14:56.369489 18178 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:56.370666 18164 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20240501 08:14:56.370812 18164 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/master-0/data,/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/master-0/wal
uuid: "4806c828fe4b45ca868c673af344709e"
format_stamp: "Formatted at 2024-05-01 08:14:56 on dist-test-slave-2bdt"
I20240501 08:14:56.370958 18164 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:14:56.383481 18164 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:14:56.384107 18164 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 08:14:56.384358 18164 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:14:56.400197 18164 rpc_server.cc:307] RPC server started. Bound to: 127.14.127.254:38895
I20240501 08:14:56.400226 18229 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.127.254:38895 every 8 connection(s)
I20240501 08:14:56.401384 18164 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/master-0/data/info.pb
I20240501 08:14:56.404758 18230 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:14:56.409138 14847 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu as pid 18164
I20240501 08:14:56.409359 14847 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/master-0/wal/instance
I20240501 08:14:56.414176 18230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e: Bootstrap starting.
I20240501 08:14:56.416752 18230 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e: Neither blocks nor log segments found. Creating new log.
I20240501 08:14:56.417627 18230 log.cc:824] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e: Log is configured to *not* fsync() on all Append() calls
I20240501 08:14:56.420332 18230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e: No bootstrap required, opened a new log
I20240501 08:14:56.426281 18230 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4806c828fe4b45ca868c673af344709e" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 38895 } }
I20240501 08:14:56.426540 18230 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:14:56.426635 18230 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4806c828fe4b45ca868c673af344709e, State: Initialized, Role: FOLLOWER
I20240501 08:14:56.427168 18230 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4806c828fe4b45ca868c673af344709e" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 38895 } }
I20240501 08:14:56.427343 18230 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:14:56.427488 18230 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:14:56.427616 18230 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:14:56.429417 18230 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4806c828fe4b45ca868c673af344709e" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 38895 } }
I20240501 08:14:56.429874 18230 leader_election.cc:302] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4806c828fe4b45ca868c673af344709e; no voters:
I20240501 08:14:56.430433 18230 leader_election.cc:288] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 08:14:56.430562 18235 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:14:56.431274 18235 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e [term 1 LEADER]: Becoming Leader. State: Replica: 4806c828fe4b45ca868c673af344709e, State: Running, Role: LEADER
I20240501 08:14:56.431921 18235 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4806c828fe4b45ca868c673af344709e" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 38895 } }
I20240501 08:14:56.432294 18230 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e [sys.catalog]: configured and running, proceeding with master startup.
I20240501 08:14:56.434275 18236 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4806c828fe4b45ca868c673af344709e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4806c828fe4b45ca868c673af344709e" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 38895 } } }
I20240501 08:14:56.434587 18236 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e [sys.catalog]: This master's current role is: LEADER
I20240501 08:14:56.436262 18241 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240501 08:14:56.436491 18237 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4806c828fe4b45ca868c673af344709e. Latest consensus state: current_term: 1 leader_uuid: "4806c828fe4b45ca868c673af344709e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4806c828fe4b45ca868c673af344709e" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 38895 } } }
I20240501 08:14:56.436717 18237 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e [sys.catalog]: This master's current role is: LEADER
I20240501 08:14:56.441305 18241 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240501 08:14:56.448268 18241 catalog_manager.cc:1347] Generated new cluster ID: 6d9835f8df0e4c01a4d9ccc2baee14e7
I20240501 08:14:56.448356 18241 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240501 08:14:56.467871 18241 catalog_manager.cc:1370] Generated new certificate authority record
I20240501 08:14:56.468873 18241 catalog_manager.cc:1504] Loading token signing keys...
I20240501 08:14:56.475641 18241 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e: Generated new TSK 0
I20240501 08:14:56.476493 18241 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240501 08:14:56.490367 14847 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
/tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.127.193:0
--local_ip_for_outbound_sockets=127.14.127.193
--webserver_interface=127.14.127.193
--webserver_port=0
--tserver_master_addrs=127.14.127.254:38895
--builtin_ntp_servers=127.14.127.212:36045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240501 08:14:56.790695 18255 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 08:14:56.790930 18255 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 08:14:56.791007 18255 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 08:14:56.797699 18255 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 08:14:56.797832 18255 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.127.193
I20240501 08:14:56.805636 18255 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.127.212:36045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.127.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.127.193
--webserver_port=0
--tserver_master_addrs=127.14.127.254:38895
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.127.193
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 07:43:24 UTC on efd1337a2aa3
build id 71
ASAN enabled
I20240501 08:14:56.806633 18255 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 08:14:56.808130 18255 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:14:56.818779 18263 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:56.819166 18260 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:56.819689 18261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:14:56.820590 18255 server_base.cc:1034] running on GCE node
I20240501 08:14:56.821080 18255 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 08:14:56.821904 18255 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 08:14:56.823091 18255 hybrid_clock.cc:648] HybridClock initialized: now 1714551296823030 us; error 46 us; skew 500 ppm
I20240501 08:14:56.823359 18255 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:14:56.825311 18255 webserver.cc:460] Webserver started at http://127.14.127.193:34625/ using document root <none> and password file <none>
I20240501 08:14:56.826004 18255 fs_manager.cc:359] Metadata directory not provided
I20240501 08:14:56.826125 18255 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:14:56.826395 18255 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 08:14:56.828642 18255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-0/data/instance:
uuid: "166ff1c3134f45b18d3c4cc575d4af4e"
format_stamp: "Formatted at 2024-05-01 08:14:56 on dist-test-slave-2bdt"
I20240501 08:14:56.829330 18255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-0/wal/instance:
uuid: "166ff1c3134f45b18d3c4cc575d4af4e"
format_stamp: "Formatted at 2024-05-01 08:14:56 on dist-test-slave-2bdt"
I20240501 08:14:56.833871 18255 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20240501 08:14:56.836766 18269 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:56.837989 18255 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240501 08:14:56.838124 18255 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-0/data,/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-0/wal
uuid: "166ff1c3134f45b18d3c4cc575d4af4e"
format_stamp: "Formatted at 2024-05-01 08:14:56 on dist-test-slave-2bdt"
I20240501 08:14:56.838296 18255 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:14:56.849413 18255 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:14:56.850098 18255 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 08:14:56.850340 18255 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:14:56.851127 18255 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 08:14:56.852360 18255 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 08:14:56.852424 18255 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:56.852540 18255 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 08:14:56.852586 18255 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:56.883313 18255 rpc_server.cc:307] RPC server started. Bound to: 127.14.127.193:37503
I20240501 08:14:56.883370 18381 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.127.193:37503 every 8 connection(s)
I20240501 08:14:56.884449 18255 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-0/data/info.pb
I20240501 08:14:56.886554 14847 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu as pid 18255
I20240501 08:14:56.886716 14847 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-0/wal/instance
I20240501 08:14:56.889796 14847 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
/tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.127.194:0
--local_ip_for_outbound_sockets=127.14.127.194
--webserver_interface=127.14.127.194
--webserver_port=0
--tserver_master_addrs=127.14.127.254:38895
--builtin_ntp_servers=127.14.127.212:36045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240501 08:14:56.896804 18382 heartbeater.cc:347] Connected to a master server at 127.14.127.254:38895
I20240501 08:14:56.897068 18382 heartbeater.cc:464] Registering TS with master...
I20240501 08:14:56.897856 18382 heartbeater.cc:511] Master 127.14.127.254:38895 requested a full tablet report, sending...
I20240501 08:14:56.900002 18195 ts_manager.cc:194] Registered new tserver with Master: 166ff1c3134f45b18d3c4cc575d4af4e (127.14.127.193:37503)
I20240501 08:14:56.902148 18195 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.127.193:33127
W20240501 08:14:57.189931 18385 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 08:14:57.190171 18385 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 08:14:57.190269 18385 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 08:14:57.197264 18385 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 08:14:57.197422 18385 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.127.194
I20240501 08:14:57.206013 18385 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.127.212:36045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.127.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.127.194
--webserver_port=0
--tserver_master_addrs=127.14.127.254:38895
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.127.194
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 07:43:24 UTC on efd1337a2aa3
build id 71
ASAN enabled
I20240501 08:14:57.207162 18385 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 08:14:57.208709 18385 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:14:57.220114 18391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:57.220645 18390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:57.221215 18393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:14:57.222034 18385 server_base.cc:1034] running on GCE node
I20240501 08:14:57.222550 18385 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 08:14:57.223309 18385 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 08:14:57.224517 18385 hybrid_clock.cc:648] HybridClock initialized: now 1714551297224461 us; error 35 us; skew 500 ppm
I20240501 08:14:57.224773 18385 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:14:57.227054 18385 webserver.cc:460] Webserver started at http://127.14.127.194:37003/ using document root <none> and password file <none>
I20240501 08:14:57.227730 18385 fs_manager.cc:359] Metadata directory not provided
I20240501 08:14:57.227854 18385 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:14:57.228114 18385 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 08:14:57.230450 18385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-1/data/instance:
uuid: "a4e0522862d448bb8e2000e035a3ef6b"
format_stamp: "Formatted at 2024-05-01 08:14:57 on dist-test-slave-2bdt"
I20240501 08:14:57.231097 18385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-1/wal/instance:
uuid: "a4e0522862d448bb8e2000e035a3ef6b"
format_stamp: "Formatted at 2024-05-01 08:14:57 on dist-test-slave-2bdt"
I20240501 08:14:57.235816 18385 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20240501 08:14:57.238996 18399 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:57.240092 18385 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240501 08:14:57.240227 18385 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-1/data,/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-1/wal
uuid: "a4e0522862d448bb8e2000e035a3ef6b"
format_stamp: "Formatted at 2024-05-01 08:14:57 on dist-test-slave-2bdt"
I20240501 08:14:57.240376 18385 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:14:57.264146 18385 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:14:57.264847 18385 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 08:14:57.265086 18385 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:14:57.265921 18385 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 08:14:57.267180 18385 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 08:14:57.267253 18385 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:57.267372 18385 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 08:14:57.267428 18385 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:57.297730 18385 rpc_server.cc:307] RPC server started. Bound to: 127.14.127.194:40013
I20240501 08:14:57.297782 18511 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.127.194:40013 every 8 connection(s)
I20240501 08:14:57.298780 18385 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-1/data/info.pb
I20240501 08:14:57.309077 14847 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu as pid 18385
I20240501 08:14:57.309259 14847 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-1/wal/instance
I20240501 08:14:57.310350 18512 heartbeater.cc:347] Connected to a master server at 127.14.127.254:38895
I20240501 08:14:57.310617 18512 heartbeater.cc:464] Registering TS with master...
I20240501 08:14:57.311475 18512 heartbeater.cc:511] Master 127.14.127.254:38895 requested a full tablet report, sending...
I20240501 08:14:57.312808 18195 ts_manager.cc:194] Registered new tserver with Master: a4e0522862d448bb8e2000e035a3ef6b (127.14.127.194:40013)
I20240501 08:14:57.313547 18195 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.127.194:45575
I20240501 08:14:57.324417 14847 external_mini_cluster.cc:930] 2 TS(s) registered with all masters
I20240501 08:14:57.336575 14847 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu pid 18385
I20240501 08:14:57.343705 18507 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 08:14:57.421226 14847 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu with pid 18385
I20240501 08:14:57.436571 14847 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu pid 18164
I20240501 08:14:57.437666 18225 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 08:14:57.537423 14847 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu with pid 18164
I20240501 08:14:57.556795 14847 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
/tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.127.254:38895
--webserver_interface=127.14.127.254
--webserver_port=33665
--builtin_ntp_servers=127.14.127.212:36045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.127.254:38895
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240501 08:14:57.852643 18524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 08:14:57.852869 18524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 08:14:57.852972 18524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 08:14:57.859711 18524 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240501 08:14:57.859791 18524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 08:14:57.859830 18524 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240501 08:14:57.859876 18524 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240501 08:14:57.867839 18524 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.127.212:36045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.14.127.254:38895
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.127.254:38895
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.127.254
--webserver_port=33665
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 07:43:24 UTC on efd1337a2aa3
build id 71
ASAN enabled
I20240501 08:14:57.868876 18524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 08:14:57.870370 18524 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:14:57.880129 18529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:57.880733 18532 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:57.881337 18530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:14:57.883297 18524 server_base.cc:1034] running on GCE node
I20240501 08:14:57.884126 18524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 08:14:57.885586 18524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 08:14:57.886858 18524 hybrid_clock.cc:648] HybridClock initialized: now 1714551297886792 us; error 52 us; skew 500 ppm
I20240501 08:14:57.887195 18524 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:14:57.889292 18524 webserver.cc:460] Webserver started at http://127.14.127.254:33665/ using document root <none> and password file <none>
I20240501 08:14:57.889887 18524 fs_manager.cc:359] Metadata directory not provided
I20240501 08:14:57.890018 18524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:14:57.894480 18524 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20240501 08:14:57.897096 18538 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:57.898355 18524 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20240501 08:14:57.898511 18524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/master-0/data,/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/master-0/wal
uuid: "4806c828fe4b45ca868c673af344709e"
format_stamp: "Formatted at 2024-05-01 08:14:56 on dist-test-slave-2bdt"
I20240501 08:14:57.899269 18524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:14:57.904985 18382 heartbeater.cc:503] Master 127.14.127.254:38895 was elected leader, sending a full tablet report...
W20240501 08:14:57.906522 18382 heartbeater.cc:644] Failed to heartbeat to 127.14.127.254:38895 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.14.127.254:38895: connect: Connection refused (error 111)
I20240501 08:14:57.922943 18524 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:14:57.923666 18524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 08:14:57.923885 18524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:14:57.941104 18524 rpc_server.cc:307] RPC server started. Bound to: 127.14.127.254:38895
I20240501 08:14:57.941147 18590 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.127.254:38895 every 8 connection(s)
I20240501 08:14:57.942534 18524 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/master-0/data/info.pb
I20240501 08:14:57.944527 14847 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu as pid 18524
I20240501 08:14:57.949499 18591 sys_catalog.cc:263] Verifying existing consensus state
I20240501 08:14:57.953436 18591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e: Bootstrap starting.
I20240501 08:14:57.968258 18591 log.cc:824] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e: Log is configured to *not* fsync() on all Append() calls
I20240501 08:14:57.975466 18591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:14:57.975921 18591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e: Bootstrap complete.
I20240501 08:14:57.982553 18591 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4806c828fe4b45ca868c673af344709e" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 38895 } }
I20240501 08:14:57.983322 18591 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4806c828fe4b45ca868c673af344709e, State: Initialized, Role: FOLLOWER
I20240501 08:14:57.983790 18591 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4806c828fe4b45ca868c673af344709e" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 38895 } }
I20240501 08:14:57.983968 18591 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:14:57.984041 18591 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:14:57.984159 18591 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:14:57.987282 18591 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4806c828fe4b45ca868c673af344709e" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 38895 } }
I20240501 08:14:57.987689 18591 leader_election.cc:302] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4806c828fe4b45ca868c673af344709e; no voters:
I20240501 08:14:57.988176 18591 leader_election.cc:288] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 08:14:57.988313 18596 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:14:57.989245 18596 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e [term 2 LEADER]: Becoming Leader. State: Replica: 4806c828fe4b45ca868c673af344709e, State: Running, Role: LEADER
I20240501 08:14:57.989725 18596 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4806c828fe4b45ca868c673af344709e" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 38895 } }
I20240501 08:14:57.989959 18591 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e [sys.catalog]: configured and running, proceeding with master startup.
I20240501 08:14:57.992100 18597 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "4806c828fe4b45ca868c673af344709e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4806c828fe4b45ca868c673af344709e" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 38895 } } }
I20240501 08:14:57.992352 18598 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4806c828fe4b45ca868c673af344709e. Latest consensus state: current_term: 2 leader_uuid: "4806c828fe4b45ca868c673af344709e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4806c828fe4b45ca868c673af344709e" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 38895 } } }
I20240501 08:14:57.992724 18598 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e [sys.catalog]: This master's current role is: LEADER
I20240501 08:14:57.993618 18597 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e [sys.catalog]: This master's current role is: LEADER
I20240501 08:14:57.994081 18604 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240501 08:14:58.000154 18604 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240501 08:14:58.001545 18604 catalog_manager.cc:1259] Loaded cluster ID: 6d9835f8df0e4c01a4d9ccc2baee14e7
I20240501 08:14:58.001641 18604 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240501 08:14:58.004310 18604 catalog_manager.cc:1504] Loading token signing keys...
I20240501 08:14:58.005319 18604 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4806c828fe4b45ca868c673af344709e: Loaded TSK: 0
I20240501 08:14:58.006697 18604 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240501 08:14:58.912920 18382 heartbeater.cc:347] Connected to a master server at 127.14.127.254:38895
I20240501 08:14:58.913136 18382 heartbeater.cc:503] Master 127.14.127.254:38895 was elected leader, sending a full tablet report...
I20240501 08:14:58.914980 18556 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "166ff1c3134f45b18d3c4cc575d4af4e" instance_seqno: 1714551296874319) as {username='slave'} at 127.14.127.193:33767; Asking this server to re-register.
I20240501 08:14:58.915642 18382 heartbeater.cc:464] Registering TS with master...
I20240501 08:14:58.915846 18382 heartbeater.cc:511] Master 127.14.127.254:38895 requested a full tablet report, sending...
I20240501 08:14:58.916934 18556 ts_manager.cc:194] Registered new tserver with Master: 166ff1c3134f45b18d3c4cc575d4af4e (127.14.127.193:37503)
I20240501 08:14:58.925714 14847 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20240501 08:14:58.925855 14847 test_util.cc:268] Using random seed: 354362639
I20240501 08:14:58.944617 18556 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39332:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20240501 08:14:58.967728 18317 tablet_service.cc:1467] Processing CreateTablet for tablet 5b535dfdaaaf408ab3e08e1eba90caef (DEFAULT_TABLE table=test-workload [id=b63ccb9107664786bdad8e201c6c6785]), partition=RANGE (key) PARTITION UNBOUNDED
I20240501 08:14:58.968921 18317 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b535dfdaaaf408ab3e08e1eba90caef. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:14:58.978397 18626 tablet_bootstrap.cc:492] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e: Bootstrap starting.
I20240501 08:14:58.981287 18626 tablet_bootstrap.cc:654] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e: Neither blocks nor log segments found. Creating new log.
I20240501 08:14:58.982296 18626 log.cc:824] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e: Log is configured to *not* fsync() on all Append() calls
I20240501 08:14:58.984345 18626 tablet_bootstrap.cc:492] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e: No bootstrap required, opened a new log
I20240501 08:14:58.984580 18626 ts_tablet_manager.cc:1367] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.005s
I20240501 08:14:58.990212 18626 raft_consensus.cc:348] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "166ff1c3134f45b18d3c4cc575d4af4e" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 37503 } }
I20240501 08:14:58.990525 18626 raft_consensus.cc:374] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:14:58.990613 18626 raft_consensus.cc:729] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 166ff1c3134f45b18d3c4cc575d4af4e, State: Initialized, Role: FOLLOWER
I20240501 08:14:58.991159 18626 consensus_queue.cc:260] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "166ff1c3134f45b18d3c4cc575d4af4e" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 37503 } }
I20240501 08:14:58.991348 18626 raft_consensus.cc:388] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:14:58.991458 18626 raft_consensus.cc:482] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:14:58.991593 18626 raft_consensus.cc:3037] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:14:58.993408 18626 raft_consensus.cc:504] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "166ff1c3134f45b18d3c4cc575d4af4e" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 37503 } }
I20240501 08:14:58.993850 18626 leader_election.cc:302] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 166ff1c3134f45b18d3c4cc575d4af4e; no voters:
I20240501 08:14:58.994397 18626 leader_election.cc:288] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 08:14:58.994570 18628 raft_consensus.cc:2781] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:14:58.995280 18628 raft_consensus.cc:686] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e [term 1 LEADER]: Becoming Leader. State: Replica: 166ff1c3134f45b18d3c4cc575d4af4e, State: Running, Role: LEADER
I20240501 08:14:58.996006 18626 ts_tablet_manager.cc:1398] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20240501 08:14:58.996251 18628 consensus_queue.cc:237] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "166ff1c3134f45b18d3c4cc575d4af4e" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 37503 } }
I20240501 08:14:59.000875 18556 catalog_manager.cc:5484] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 166ff1c3134f45b18d3c4cc575d4af4e (127.14.127.193). New cstate: current_term: 1 leader_uuid: "166ff1c3134f45b18d3c4cc575d4af4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "166ff1c3134f45b18d3c4cc575d4af4e" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 37503 } health_report { overall_health: HEALTHY } } }
I20240501 08:14:59.583220 14847 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
/tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.127.194:40013
--local_ip_for_outbound_sockets=127.14.127.194
--tserver_master_addrs=127.14.127.254:38895
--webserver_port=37003
--webserver_interface=127.14.127.194
--builtin_ntp_servers=127.14.127.212:36045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240501 08:14:59.878253 18644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 08:14:59.878486 18644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 08:14:59.878608 18644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 08:14:59.885524 18644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 08:14:59.885712 18644 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.127.194
I20240501 08:14:59.894364 18644 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.127.212:36045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.127.194:40013
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.127.194
--webserver_port=37003
--tserver_master_addrs=127.14.127.254:38895
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.127.194
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 07:43:24 UTC on efd1337a2aa3
build id 71
ASAN enabled
I20240501 08:14:59.895530 18644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 08:14:59.897039 18644 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:14:59.908572 18652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:59.909179 18649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:14:59.909776 18650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:14:59.910387 18644 server_base.cc:1034] running on GCE node
I20240501 08:14:59.910864 18644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 08:14:59.911619 18644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 08:14:59.912845 18644 hybrid_clock.cc:648] HybridClock initialized: now 1714551299912794 us; error 29 us; skew 500 ppm
I20240501 08:14:59.913120 18644 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:14:59.915167 18644 webserver.cc:460] Webserver started at http://127.14.127.194:37003/ using document root <none> and password file <none>
I20240501 08:14:59.915797 18644 fs_manager.cc:359] Metadata directory not provided
I20240501 08:14:59.915933 18644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:14:59.920428 18644 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20240501 08:14:59.922848 18658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:59.923977 18644 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240501 08:14:59.924113 18644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-1/data,/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-1/wal
uuid: "a4e0522862d448bb8e2000e035a3ef6b"
format_stamp: "Formatted at 2024-05-01 08:14:57 on dist-test-slave-2bdt"
I20240501 08:14:59.924842 18644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:14:59.950832 18644 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:14:59.951643 18644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 08:14:59.951906 18644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:14:59.952842 18644 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 08:14:59.954536 18644 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 08:14:59.954631 18644 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:59.954720 18644 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 08:14:59.954784 18644 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 08:14:59.983902 18644 rpc_server.cc:307] RPC server started. Bound to: 127.14.127.194:40013
I20240501 08:14:59.983958 18770 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.127.194:40013 every 8 connection(s)
I20240501 08:14:59.985064 18644 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-1/data/info.pb
I20240501 08:14:59.990465 14847 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu as pid 18644
W20240501 08:14:59.994982 18377 generic_service.cc:139] {username='slave'} at 127.0.0.1:44338 forcing change of non-runtime-safe flag fault_crash_on_handle_tc_fetch_data
I20240501 08:14:59.995155 18377 generic_service.cc:175] {username='slave'} at 127.0.0.1:44338 changed flags via RPC: fault_crash_on_handle_tc_fetch_data from '0' to '1.0'
I20240501 08:14:59.997542 18771 heartbeater.cc:347] Connected to a master server at 127.14.127.254:38895
I20240501 08:14:59.997817 18771 heartbeater.cc:464] Registering TS with master...
I20240501 08:14:59.998564 18771 heartbeater.cc:511] Master 127.14.127.254:38895 requested a full tablet report, sending...
I20240501 08:14:59.999768 18552 ts_manager.cc:194] Registered new tserver with Master: a4e0522862d448bb8e2000e035a3ef6b (127.14.127.194:40013)
I20240501 08:15:00.000771 18552 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.127.194:34989
I20240501 08:15:00.003945 18776 ts_tablet_manager.cc:902] T 5b535dfdaaaf408ab3e08e1eba90caef P a4e0522862d448bb8e2000e035a3ef6b: Initiating tablet copy from peer 166ff1c3134f45b18d3c4cc575d4af4e (127.14.127.193:37503)
I20240501 08:15:00.005453 18776 tablet_copy_client.cc:308] T 5b535dfdaaaf408ab3e08e1eba90caef P a4e0522862d448bb8e2000e035a3ef6b: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:37503
I20240501 08:15:00.010394 18357 tablet_copy_service.cc:140] P 166ff1c3134f45b18d3c4cc575d4af4e: Received BeginTabletCopySession request for tablet 5b535dfdaaaf408ab3e08e1eba90caef from peer a4e0522862d448bb8e2000e035a3ef6b ({username='slave'} at 127.14.127.194:55431)
I20240501 08:15:00.010545 18357 tablet_copy_service.cc:161] P 166ff1c3134f45b18d3c4cc575d4af4e: Beginning new tablet copy session on tablet 5b535dfdaaaf408ab3e08e1eba90caef from peer a4e0522862d448bb8e2000e035a3ef6b at {username='slave'} at 127.14.127.194:55431: session id = a4e0522862d448bb8e2000e035a3ef6b-5b535dfdaaaf408ab3e08e1eba90caef
I20240501 08:15:00.012642 18357 tablet_copy_source_session.cc:205] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 08:15:00.015928 18776 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b535dfdaaaf408ab3e08e1eba90caef. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:15:00.024521 18776 tablet_copy_client.cc:783] T 5b535dfdaaaf408ab3e08e1eba90caef P a4e0522862d448bb8e2000e035a3ef6b: tablet copy: Starting download of 0 data blocks...
I20240501 08:15:00.024783 18776 tablet_copy_client.cc:647] T 5b535dfdaaaf408ab3e08e1eba90caef P a4e0522862d448bb8e2000e035a3ef6b: tablet copy: Starting download of 1 WAL segments...
W20240501 08:15:00.026031 18357 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20240501 08:15:00.026137 18357 fault_injection.cc:44] THIS SERVER MAY CRASH!
E20240501 08:15:00.026193 18357 fault_injection.cc:59] injecting fault for kudu (pid 18255): FLAGS_fault_crash_on_handle_tc_fetch_data (process will exit)
W20240501 08:15:00.044833 18776 ts_tablet_manager.cc:980] T 5b535dfdaaaf408ab3e08e1eba90caef P a4e0522862d448bb8e2000e035a3ef6b: Tablet Copy: Unable to fetch data from remote peer 166ff1c3134f45b18d3c4cc575d4af4e (127.14.127.193:37503): Network error: Unable to download WAL segment with seq. number 1: unable to fetch data from remote: recv got EOF from 127.14.127.193:37503 (error 108)
I20240501 08:15:00.044976 18776 tablet_replica.cc:330] T 5b535dfdaaaf408ab3e08e1eba90caef P a4e0522862d448bb8e2000e035a3ef6b: stopping tablet replica
I20240501 08:15:00.045174 18776 raft_consensus.cc:2229] T 5b535dfdaaaf408ab3e08e1eba90caef P a4e0522862d448bb8e2000e035a3ef6b [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20240501 08:15:00.045352 18776 raft_consensus.cc:2258] T 5b535dfdaaaf408ab3e08e1eba90caef P a4e0522862d448bb8e2000e035a3ef6b [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
W20240501 08:15:00.046289 18776 tablet_copy_client.cc:1108] T 5b535dfdaaaf408ab3e08e1eba90caef P a4e0522862d448bb8e2000e035a3ef6b: tablet copy: Unable to close tablet copy session: Network error: failure ending tablet copy session: Client connection negotiation failed: client connection to 127.14.127.193:37503: connect: Connection refused (error 111)
W20240501 08:15:00.046885 18776 tablet_metadata.cc:476] failed to load DataDirGroup from superblock: Already present: tried to load directory group for tablet 5b535dfdaaaf408ab3e08e1eba90caef but one is already registered
I20240501 08:15:00.047078 18776 ts_tablet_manager.cc:1875] T 5b535dfdaaaf408ab3e08e1eba90caef P a4e0522862d448bb8e2000e035a3ef6b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 08:15:00.051301 18776 ts_tablet_manager.cc:1888] T 5b535dfdaaaf408ab3e08e1eba90caef P a4e0522862d448bb8e2000e035a3ef6b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.0
I20240501 08:15:00.051430 18776 log.cc:1196] T 5b535dfdaaaf408ab3e08e1eba90caef P a4e0522862d448bb8e2000e035a3ef6b: Deleting WAL directory at /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-1/wal/wals/5b535dfdaaaf408ab3e08e1eba90caef
I20240501 08:15:00.056285 14847 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
/tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.127.193:37503
--local_ip_for_outbound_sockets=127.14.127.193
--tserver_master_addrs=127.14.127.254:38895
--webserver_port=34625
--webserver_interface=127.14.127.193
--builtin_ntp_servers=127.14.127.212:36045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240501 08:15:00.344754 18781 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 08:15:00.344992 18781 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 08:15:00.345110 18781 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 08:15:00.351975 18781 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 08:15:00.352137 18781 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.127.193
I20240501 08:15:00.360385 18781 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.127.212:36045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.127.193:37503
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.127.193
--webserver_port=34625
--tserver_master_addrs=127.14.127.254:38895
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.127.193
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 07:43:24 UTC on efd1337a2aa3
build id 71
ASAN enabled
I20240501 08:15:00.361507 18781 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 08:15:00.363065 18781 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:15:00.374333 18786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:15:00.374951 18789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:15:00.375520 18787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:15:00.376389 18781 server_base.cc:1034] running on GCE node
I20240501 08:15:00.376904 18781 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 08:15:00.377743 18781 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 08:15:00.378952 18781 hybrid_clock.cc:648] HybridClock initialized: now 1714551300378898 us; error 35 us; skew 500 ppm
I20240501 08:15:00.379204 18781 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:15:00.381206 18781 webserver.cc:460] Webserver started at http://127.14.127.193:34625/ using document root <none> and password file <none>
I20240501 08:15:00.381888 18781 fs_manager.cc:359] Metadata directory not provided
I20240501 08:15:00.382027 18781 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:15:00.386659 18781 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20240501 08:15:00.389101 18795 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:15:00.390269 18781 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20240501 08:15:00.390420 18781 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-0/data,/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-0/wal
uuid: "166ff1c3134f45b18d3c4cc575d4af4e"
format_stamp: "Formatted at 2024-05-01 08:14:56 on dist-test-slave-2bdt"
I20240501 08:15:00.391191 18781 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:15:00.411196 18781 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:15:00.411877 18781 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 08:15:00.412101 18781 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:15:00.412856 18781 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 08:15:00.414515 18802 ts_tablet_manager.cc:522] Loading tablet metadata (0/1 complete)
I20240501 08:15:00.419169 18781 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240501 08:15:00.419301 18781 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.001s
I20240501 08:15:00.419435 18781 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240501 08:15:00.422132 18781 ts_tablet_manager.cc:590] Registered 1 tablets
I20240501 08:15:00.422235 18781 ts_tablet_manager.cc:569] Time spent register tablets: real 0.003s user 0.002s sys 0.001s
I20240501 08:15:00.422515 18802 tablet_bootstrap.cc:492] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e: Bootstrap starting.
I20240501 08:15:00.458091 18781 rpc_server.cc:307] RPC server started. Bound to: 127.14.127.193:37503
I20240501 08:15:00.458139 18909 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.127.193:37503 every 8 connection(s)
I20240501 08:15:00.459503 18781 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714551278873485-14847-0/minicluster-data/ts-0/data/info.pb
I20240501 08:15:00.462843 14847 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu as pid 18781
I20240501 08:15:00.473488 18910 heartbeater.cc:347] Connected to a master server at 127.14.127.254:38895
I20240501 08:15:00.473886 18910 heartbeater.cc:464] Registering TS with master...
I20240501 08:15:00.474849 18910 heartbeater.cc:511] Master 127.14.127.254:38895 requested a full tablet report, sending...
I20240501 08:15:00.477339 18552 ts_manager.cc:194] Re-registered known tserver with Master: 166ff1c3134f45b18d3c4cc575d4af4e (127.14.127.193:37503)
I20240501 08:15:00.478811 18552 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.127.193:33037
I20240501 08:15:00.512722 18802 log.cc:824] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e: Log is configured to *not* fsync() on all Append() calls
I20240501 08:15:00.999064 18802 tablet_bootstrap.cc:492] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e: Bootstrap replayed 1/1 log segments. Stats: ops{read=215 overwritten=0 applied=215 ignored=0} inserts{seen=10700 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:15:00.999536 18802 tablet_bootstrap.cc:492] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e: Bootstrap complete.
I20240501 08:15:01.000661 18802 ts_tablet_manager.cc:1367] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e: Time spent bootstrapping tablet: real 0.578s user 0.518s sys 0.056s
I20240501 08:15:01.003226 18771 heartbeater.cc:503] Master 127.14.127.254:38895 was elected leader, sending a full tablet report...
W20240501 08:15:01.004873 18552 catalog_manager.cc:5397] Tablet 5b535dfdaaaf408ab3e08e1eba90caef (table test-workload [id=b63ccb9107664786bdad8e201c6c6785]) has failed on TS a4e0522862d448bb8e2000e035a3ef6b (127.14.127.194:40013): Network error: Unable to download WAL segment with seq. number 1: unable to fetch data from remote: recv got EOF from 127.14.127.193:37503 (error 108)
I20240501 08:15:01.005759 18802 raft_consensus.cc:348] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "166ff1c3134f45b18d3c4cc575d4af4e" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 37503 } }
I20240501 08:15:01.006484 18802 raft_consensus.cc:729] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 166ff1c3134f45b18d3c4cc575d4af4e, State: Initialized, Role: FOLLOWER
I20240501 08:15:01.007066 18802 consensus_queue.cc:260] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 215, Last appended: 1.215, Last appended by leader: 215, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "166ff1c3134f45b18d3c4cc575d4af4e" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 37503 } }
I20240501 08:15:01.007262 18802 raft_consensus.cc:388] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:01.007369 18802 raft_consensus.cc:482] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:01.007529 18802 raft_consensus.cc:3037] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:15:01.010831 18802 raft_consensus.cc:504] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "166ff1c3134f45b18d3c4cc575d4af4e" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 37503 } }
I20240501 08:15:01.011265 18802 leader_election.cc:302] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 166ff1c3134f45b18d3c4cc575d4af4e; no voters:
I20240501 08:15:01.011734 18802 leader_election.cc:288] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 08:15:01.011860 18915 raft_consensus.cc:2781] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:15:01.012804 18910 heartbeater.cc:503] Master 127.14.127.254:38895 was elected leader, sending a full tablet report...
I20240501 08:15:01.012918 18915 raft_consensus.cc:686] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e [term 2 LEADER]: Becoming Leader. State: Replica: 166ff1c3134f45b18d3c4cc575d4af4e, State: Running, Role: LEADER
I20240501 08:15:01.013104 18802 ts_tablet_manager.cc:1398] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e: Time spent starting tablet: real 0.012s user 0.014s sys 0.000s
I20240501 08:15:01.013360 18915 consensus_queue.cc:237] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 215, Committed index: 215, Last appended: 1.215, Last appended by leader: 215, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "166ff1c3134f45b18d3c4cc575d4af4e" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 37503 } }
I20240501 08:15:01.016652 18920 ts_tablet_manager.cc:902] T 5b535dfdaaaf408ab3e08e1eba90caef P a4e0522862d448bb8e2000e035a3ef6b: Initiating tablet copy from peer 166ff1c3134f45b18d3c4cc575d4af4e (127.14.127.193:37503)
I20240501 08:15:01.016840 18552 catalog_manager.cc:5484] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "166ff1c3134f45b18d3c4cc575d4af4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "166ff1c3134f45b18d3c4cc575d4af4e" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 37503 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:01.019479 18920 tablet_copy_client.cc:308] T 5b535dfdaaaf408ab3e08e1eba90caef P a4e0522862d448bb8e2000e035a3ef6b: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:37503
I20240501 08:15:01.026049 18885 tablet_copy_service.cc:140] P 166ff1c3134f45b18d3c4cc575d4af4e: Received BeginTabletCopySession request for tablet 5b535dfdaaaf408ab3e08e1eba90caef from peer a4e0522862d448bb8e2000e035a3ef6b ({username='slave'} at 127.14.127.194:41073)
I20240501 08:15:01.026262 18885 tablet_copy_service.cc:161] P 166ff1c3134f45b18d3c4cc575d4af4e: Beginning new tablet copy session on tablet 5b535dfdaaaf408ab3e08e1eba90caef from peer a4e0522862d448bb8e2000e035a3ef6b at {username='slave'} at 127.14.127.194:41073: session id = a4e0522862d448bb8e2000e035a3ef6b-5b535dfdaaaf408ab3e08e1eba90caef
I20240501 08:15:01.028734 18885 tablet_copy_source_session.cc:205] T 5b535dfdaaaf408ab3e08e1eba90caef P 166ff1c3134f45b18d3c4cc575d4af4e: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 08:15:01.030031 18920 ts_tablet_manager.cc:1875] T 5b535dfdaaaf408ab3e08e1eba90caef P a4e0522862d448bb8e2000e035a3ef6b: Deleting tablet data with delete state TABLET_DATA_COPYING
I20240501 08:15:01.034245 18920 ts_tablet_manager.cc:1888] T 5b535dfdaaaf408ab3e08e1eba90caef P a4e0522862d448bb8e2000e035a3ef6b: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.0
I20240501 08:15:01.034461 18920 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b535dfdaaaf408ab3e08e1eba90caef. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:15:01.036490 18920 tablet_copy_client.cc:783] T 5b535dfdaaaf408ab3e08e1eba90caef P a4e0522862d448bb8e2000e035a3ef6b: tablet copy: Starting download of 0 data blocks...
I20240501 08:15:01.036675 18920 tablet_copy_client.cc:647] T 5b535dfdaaaf408ab3e08e1eba90caef P a4e0522862d448bb8e2000e035a3ef6b: tablet copy: Starting download of 1 WAL segments...
I20240501 08:15:01.040349 18920 tablet_copy_client.cc:523] T 5b535dfdaaaf408ab3e08e1eba90caef P a4e0522862d448bb8e2000e035a3ef6b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 08:15:01.042721 18920 tablet_bootstrap.cc:492] T 5b535dfdaaaf408ab3e08e1eba90caef P a4e0522862d448bb8e2000e035a3ef6b: Bootstrap starting.
I20240501 08:15:01.099330 18920 log.cc:824] T 5b535dfdaaaf408ab3e08e1eba90caef P a4e0522862d448bb8e2000e035a3ef6b: Log is configured to *not* fsync() on all Append() calls
I20240501 08:15:01.589048 18920 tablet_bootstrap.cc:492] T 5b535dfdaaaf408ab3e08e1eba90caef P a4e0522862d448bb8e2000e035a3ef6b: Bootstrap replayed 1/1 log segments. Stats: ops{read=216 overwritten=0 applied=216 ignored=0} inserts{seen=10700 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:15:01.589488 18920 tablet_bootstrap.cc:492] T 5b535dfdaaaf408ab3e08e1eba90caef P a4e0522862d448bb8e2000e035a3ef6b: Bootstrap complete.
I20240501 08:15:01.589988 18920 ts_tablet_manager.cc:1367] T 5b535dfdaaaf408ab3e08e1eba90caef P a4e0522862d448bb8e2000e035a3ef6b: Time spent bootstrapping tablet: real 0.547s user 0.480s sys 0.068s
I20240501 08:15:01.594179 18920 raft_consensus.cc:348] T 5b535dfdaaaf408ab3e08e1eba90caef P a4e0522862d448bb8e2000e035a3ef6b [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "166ff1c3134f45b18d3c4cc575d4af4e" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 37503 } }
I20240501 08:15:01.594498 18920 raft_consensus.cc:729] T 5b535dfdaaaf408ab3e08e1eba90caef P a4e0522862d448bb8e2000e035a3ef6b [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: a4e0522862d448bb8e2000e035a3ef6b, State: Initialized, Role: NON_PARTICIPANT
I20240501 08:15:01.594980 18920 consensus_queue.cc:260] T 5b535dfdaaaf408ab3e08e1eba90caef P a4e0522862d448bb8e2000e035a3ef6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 216, Last appended: 2.216, Last appended by leader: 216, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "166ff1c3134f45b18d3c4cc575d4af4e" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 37503 } }
I20240501 08:15:01.596424 18920 ts_tablet_manager.cc:1398] T 5b535dfdaaaf408ab3e08e1eba90caef P a4e0522862d448bb8e2000e035a3ef6b: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20240501 08:15:01.597296 18885 tablet_copy_service.cc:342] P 166ff1c3134f45b18d3c4cc575d4af4e: Request end of tablet copy session a4e0522862d448bb8e2000e035a3ef6b-5b535dfdaaaf408ab3e08e1eba90caef received from {username='slave'} at 127.14.127.194:41073
I20240501 08:15:01.597477 18885 tablet_copy_service.cc:433] P 166ff1c3134f45b18d3c4cc575d4af4e: ending tablet copy session a4e0522862d448bb8e2000e035a3ef6b-5b535dfdaaaf408ab3e08e1eba90caef on tablet 5b535dfdaaaf408ab3e08e1eba90caef with peer a4e0522862d448bb8e2000e035a3ef6b
I20240501 08:15:01.600921 14847 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu pid 18781
I20240501 08:15:01.601811 18905 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 08:15:01.697798 14847 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu with pid 18781
I20240501 08:15:01.716323 14847 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu pid 18644
I20240501 08:15:01.717321 18766 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 08:15:01.814985 14847 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu with pid 18644
I20240501 08:15:01.832484 14847 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu pid 18524
I20240501 08:15:01.833482 18586 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 08:15:01.931048 14847 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu with pid 18524
2024-05-01T08:15:01Z chronyd exiting
[ OK ] TabletCopyClientSessionITest.TestCopyFromCrashedSource (5967 ms)
[ RUN ] TabletCopyClientSessionITest.TestTabletCopyWithBusySource
2024-05-01T08:15:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-01T08:15:01Z Disabled control of system clock
I20240501 08:15:01.995906 14847 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
/tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.127.254:34875
--webserver_interface=127.14.127.254
--webserver_port=0
--builtin_ntp_servers=127.14.127.212:37535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.127.254:34875
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240501 08:15:02.303115 18939 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 08:15:02.303361 18939 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 08:15:02.303436 18939 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 08:15:02.310191 18939 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240501 08:15:02.310279 18939 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 08:15:02.310328 18939 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240501 08:15:02.310408 18939 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240501 08:15:02.318672 18939 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.127.212:37535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.14.127.254:34875
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.127.254:34875
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.127.254
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 07:43:24 UTC on efd1337a2aa3
build id 71
ASAN enabled
I20240501 08:15:02.319700 18939 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 08:15:02.321235 18939 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:15:02.330902 18944 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:15:02.331585 18947 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:15:02.332139 18945 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:15:02.332793 18939 server_base.cc:1034] running on GCE node
I20240501 08:15:02.333468 18939 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 08:15:02.334650 18939 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 08:15:02.335860 18939 hybrid_clock.cc:648] HybridClock initialized: now 1714551302335807 us; error 27 us; skew 500 ppm
I20240501 08:15:02.336133 18939 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:15:02.342579 18939 webserver.cc:460] Webserver started at http://127.14.127.254:44737/ using document root <none> and password file <none>
I20240501 08:15:02.343200 18939 fs_manager.cc:359] Metadata directory not provided
I20240501 08:15:02.343341 18939 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:15:02.343608 18939 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 08:15:02.345893 18939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/master-0/data/instance:
uuid: "7ffc8b2792194f30a7296a93dce83c51"
format_stamp: "Formatted at 2024-05-01 08:15:02 on dist-test-slave-2bdt"
I20240501 08:15:02.346632 18939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/master-0/wal/instance:
uuid: "7ffc8b2792194f30a7296a93dce83c51"
format_stamp: "Formatted at 2024-05-01 08:15:02 on dist-test-slave-2bdt"
I20240501 08:15:02.351014 18939 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20240501 08:15:02.353855 18953 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:15:02.354941 18939 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20240501 08:15:02.355086 18939 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/master-0/data,/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/master-0/wal
uuid: "7ffc8b2792194f30a7296a93dce83c51"
format_stamp: "Formatted at 2024-05-01 08:15:02 on dist-test-slave-2bdt"
I20240501 08:15:02.355242 18939 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:15:02.370788 18939 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:15:02.371423 18939 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 08:15:02.371660 18939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:15:02.387986 18939 rpc_server.cc:307] RPC server started. Bound to: 127.14.127.254:34875
I20240501 08:15:02.388010 19004 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.127.254:34875 every 8 connection(s)
I20240501 08:15:02.389142 18939 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/master-0/data/info.pb
I20240501 08:15:02.391768 14847 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu as pid 18939
I20240501 08:15:02.392012 14847 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/master-0/wal/instance
I20240501 08:15:02.392679 19005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:15:02.403483 19005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51: Bootstrap starting.
I20240501 08:15:02.406330 19005 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51: Neither blocks nor log segments found. Creating new log.
I20240501 08:15:02.407166 19005 log.cc:824] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51: Log is configured to *not* fsync() on all Append() calls
I20240501 08:15:02.409401 19005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51: No bootstrap required, opened a new log
I20240501 08:15:02.415102 19005 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ffc8b2792194f30a7296a93dce83c51" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 34875 } }
I20240501 08:15:02.415355 19005 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:15:02.415424 19005 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffc8b2792194f30a7296a93dce83c51, State: Initialized, Role: FOLLOWER
I20240501 08:15:02.416003 19005 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ffc8b2792194f30a7296a93dce83c51" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 34875 } }
I20240501 08:15:02.416239 19005 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:02.416379 19005 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:02.416504 19005 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:15:02.418331 19005 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ffc8b2792194f30a7296a93dce83c51" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 34875 } }
I20240501 08:15:02.418723 19005 leader_election.cc:302] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ffc8b2792194f30a7296a93dce83c51; no voters:
I20240501 08:15:02.419201 19005 leader_election.cc:288] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 08:15:02.419312 19010 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:15:02.419996 19010 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51 [term 1 LEADER]: Becoming Leader. State: Replica: 7ffc8b2792194f30a7296a93dce83c51, State: Running, Role: LEADER
I20240501 08:15:02.420527 19010 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ffc8b2792194f30a7296a93dce83c51" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 34875 } }
I20240501 08:15:02.420940 19005 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51 [sys.catalog]: configured and running, proceeding with master startup.
I20240501 08:15:02.422955 19012 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ffc8b2792194f30a7296a93dce83c51. Latest consensus state: current_term: 1 leader_uuid: "7ffc8b2792194f30a7296a93dce83c51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ffc8b2792194f30a7296a93dce83c51" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 34875 } } }
I20240501 08:15:02.422972 19011 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7ffc8b2792194f30a7296a93dce83c51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ffc8b2792194f30a7296a93dce83c51" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 34875 } } }
I20240501 08:15:02.423316 19011 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51 [sys.catalog]: This master's current role is: LEADER
I20240501 08:15:02.423313 19012 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51 [sys.catalog]: This master's current role is: LEADER
I20240501 08:15:02.424422 19016 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240501 08:15:02.429566 19016 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240501 08:15:02.437238 19016 catalog_manager.cc:1347] Generated new cluster ID: 777bb78e2395434c98b9438380454993
I20240501 08:15:02.437337 19016 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240501 08:15:02.468869 19016 catalog_manager.cc:1370] Generated new certificate authority record
I20240501 08:15:02.470022 19016 catalog_manager.cc:1504] Loading token signing keys...
I20240501 08:15:02.476488 19016 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51: Generated new TSK 0
I20240501 08:15:02.477398 19016 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240501 08:15:02.488983 14847 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
/tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.127.193:0
--local_ip_for_outbound_sockets=127.14.127.193
--webserver_interface=127.14.127.193
--webserver_port=0
--tserver_master_addrs=127.14.127.254:34875
--builtin_ntp_servers=127.14.127.212:37535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=20 with env {}
W20240501 08:15:02.794836 19029 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 08:15:02.795080 19029 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 08:15:02.795213 19029 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 08:15:02.801978 19029 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 08:15:02.802145 19029 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.127.193
I20240501 08:15:02.809974 19029 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.127.212:37535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.127.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.127.193
--webserver_port=0
--tserver_master_addrs=127.14.127.254:34875
--num_tablets_to_copy_simultaneously=20
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.127.193
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 07:43:24 UTC on efd1337a2aa3
build id 71
ASAN enabled
I20240501 08:15:02.810988 19029 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 08:15:02.812469 19029 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:15:02.823341 19034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:15:02.823819 19037 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:15:02.824355 19035 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:15:02.825371 19029 server_base.cc:1034] running on GCE node
I20240501 08:15:02.825940 19029 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 08:15:02.826747 19029 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 08:15:02.827962 19029 hybrid_clock.cc:648] HybridClock initialized: now 1714551302827910 us; error 27 us; skew 500 ppm
I20240501 08:15:02.828209 19029 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:15:02.830307 19029 webserver.cc:460] Webserver started at http://127.14.127.193:43007/ using document root <none> and password file <none>
I20240501 08:15:02.830940 19029 fs_manager.cc:359] Metadata directory not provided
I20240501 08:15:02.831053 19029 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:15:02.831308 19029 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 08:15:02.833529 19029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-0/data/instance:
uuid: "f568ec3ddce14e6898835a3e4f6a5684"
format_stamp: "Formatted at 2024-05-01 08:15:02 on dist-test-slave-2bdt"
I20240501 08:15:02.834214 19029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-0/wal/instance:
uuid: "f568ec3ddce14e6898835a3e4f6a5684"
format_stamp: "Formatted at 2024-05-01 08:15:02 on dist-test-slave-2bdt"
I20240501 08:15:02.838711 19029 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20240501 08:15:02.841964 19043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:15:02.843116 19029 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20240501 08:15:02.843242 19029 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-0/data,/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-0/wal
uuid: "f568ec3ddce14e6898835a3e4f6a5684"
format_stamp: "Formatted at 2024-05-01 08:15:02 on dist-test-slave-2bdt"
I20240501 08:15:02.843374 19029 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:15:02.866209 19029 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:15:02.866895 19029 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 08:15:02.867123 19029 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:15:02.867969 19029 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 08:15:02.869223 19029 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 08:15:02.869294 19029 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 08:15:02.869377 19029 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 08:15:02.869414 19029 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 08:15:02.901858 19029 rpc_server.cc:307] RPC server started. Bound to: 127.14.127.193:35041
I20240501 08:15:02.901893 19155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.127.193:35041 every 8 connection(s)
I20240501 08:15:02.902984 19029 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-0/data/info.pb
I20240501 08:15:02.906579 14847 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu as pid 19029
I20240501 08:15:02.906770 14847 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-0/wal/instance
I20240501 08:15:02.910144 14847 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
/tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.127.194:0
--local_ip_for_outbound_sockets=127.14.127.194
--webserver_interface=127.14.127.194
--webserver_port=0
--tserver_master_addrs=127.14.127.254:34875
--builtin_ntp_servers=127.14.127.212:37535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=20 with env {}
I20240501 08:15:02.915740 19156 heartbeater.cc:347] Connected to a master server at 127.14.127.254:34875
I20240501 08:15:02.915992 19156 heartbeater.cc:464] Registering TS with master...
I20240501 08:15:02.916718 19156 heartbeater.cc:511] Master 127.14.127.254:34875 requested a full tablet report, sending...
I20240501 08:15:02.918531 18970 ts_manager.cc:194] Registered new tserver with Master: f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193:35041)
I20240501 08:15:02.919842 18970 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.127.193:57993
W20240501 08:15:03.210630 19160 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 08:15:03.210897 19160 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 08:15:03.211040 19160 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 08:15:03.217903 19160 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 08:15:03.218079 19160 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.127.194
I20240501 08:15:03.225858 19160 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.127.212:37535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.127.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.127.194
--webserver_port=0
--tserver_master_addrs=127.14.127.254:34875
--num_tablets_to_copy_simultaneously=20
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.127.194
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 07:43:24 UTC on efd1337a2aa3
build id 71
ASAN enabled
I20240501 08:15:03.226933 19160 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 08:15:03.228493 19160 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:15:03.239547 19165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:15:03.240075 19168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:15:03.240612 19166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:15:03.241493 19160 server_base.cc:1034] running on GCE node
I20240501 08:15:03.242026 19160 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 08:15:03.242806 19160 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 08:15:03.244021 19160 hybrid_clock.cc:648] HybridClock initialized: now 1714551303243964 us; error 39 us; skew 500 ppm
I20240501 08:15:03.244313 19160 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:15:03.246326 19160 webserver.cc:460] Webserver started at http://127.14.127.194:34693/ using document root <none> and password file <none>
I20240501 08:15:03.246971 19160 fs_manager.cc:359] Metadata directory not provided
I20240501 08:15:03.247087 19160 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:15:03.247356 19160 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 08:15:03.249698 19160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-1/data/instance:
uuid: "5a08cd9e624b416b99b4b0747ea41244"
format_stamp: "Formatted at 2024-05-01 08:15:03 on dist-test-slave-2bdt"
I20240501 08:15:03.250383 19160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-1/wal/instance:
uuid: "5a08cd9e624b416b99b4b0747ea41244"
format_stamp: "Formatted at 2024-05-01 08:15:03 on dist-test-slave-2bdt"
I20240501 08:15:03.255060 19160 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20240501 08:15:03.257995 19174 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:15:03.259171 19160 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.002s
I20240501 08:15:03.259316 19160 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-1/data,/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-1/wal
uuid: "5a08cd9e624b416b99b4b0747ea41244"
format_stamp: "Formatted at 2024-05-01 08:15:03 on dist-test-slave-2bdt"
I20240501 08:15:03.259498 19160 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:15:03.277994 19160 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:15:03.278649 19160 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 08:15:03.278863 19160 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:15:03.279733 19160 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 08:15:03.281416 19160 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 08:15:03.281518 19160 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 08:15:03.281649 19160 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 08:15:03.281726 19160 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20240501 08:15:03.311365 19160 rpc_server.cc:307] RPC server started. Bound to: 127.14.127.194:45405
I20240501 08:15:03.311395 19286 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.127.194:45405 every 8 connection(s)
I20240501 08:15:03.312472 19160 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-1/data/info.pb
I20240501 08:15:03.318837 14847 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu as pid 19160
I20240501 08:15:03.319005 14847 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-1/wal/instance
I20240501 08:15:03.324049 19287 heartbeater.cc:347] Connected to a master server at 127.14.127.254:34875
I20240501 08:15:03.324275 19287 heartbeater.cc:464] Registering TS with master...
I20240501 08:15:03.324955 19287 heartbeater.cc:511] Master 127.14.127.254:34875 requested a full tablet report, sending...
I20240501 08:15:03.326073 18970 ts_manager.cc:194] Registered new tserver with Master: 5a08cd9e624b416b99b4b0747ea41244 (127.14.127.194:45405)
I20240501 08:15:03.326792 18970 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.127.194:42997
I20240501 08:15:03.333784 14847 external_mini_cluster.cc:930] 2 TS(s) registered with all masters
I20240501 08:15:03.345717 14847 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu pid 19160
I20240501 08:15:03.352795 19282 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 08:15:03.431036 14847 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu with pid 19160
I20240501 08:15:03.446187 14847 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu pid 18939
I20240501 08:15:03.447188 19000 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 08:15:03.541594 14847 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu with pid 18939
I20240501 08:15:03.561661 14847 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
/tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.127.254:34875
--webserver_interface=127.14.127.254
--webserver_port=44737
--builtin_ntp_servers=127.14.127.212:37535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.127.254:34875
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240501 08:15:03.855003 19299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 08:15:03.855253 19299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 08:15:03.855374 19299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 08:15:03.862198 19299 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240501 08:15:03.862305 19299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 08:15:03.862368 19299 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240501 08:15:03.862455 19299 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240501 08:15:03.870493 19299 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.127.212:37535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.14.127.254:34875
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.127.254:34875
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.127.254
--webserver_port=44737
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 07:43:24 UTC on efd1337a2aa3
build id 71
ASAN enabled
I20240501 08:15:03.871601 19299 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 08:15:03.873160 19299 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:15:03.883168 19304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:15:03.883823 19305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:15:03.884449 19307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:15:03.885103 19299 server_base.cc:1034] running on GCE node
I20240501 08:15:03.885726 19299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 08:15:03.886838 19299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 08:15:03.888037 19299 hybrid_clock.cc:648] HybridClock initialized: now 1714551303887979 us; error 36 us; skew 500 ppm
I20240501 08:15:03.888312 19299 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:15:03.890349 19299 webserver.cc:460] Webserver started at http://127.14.127.254:44737/ using document root <none> and password file <none>
I20240501 08:15:03.891247 19299 fs_manager.cc:359] Metadata directory not provided
I20240501 08:15:03.891386 19299 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:15:03.895866 19299 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.003s
I20240501 08:15:03.898384 19313 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:15:03.899518 19299 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240501 08:15:03.899662 19299 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/master-0/data,/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/master-0/wal
uuid: "7ffc8b2792194f30a7296a93dce83c51"
format_stamp: "Formatted at 2024-05-01 08:15:02 on dist-test-slave-2bdt"
I20240501 08:15:03.900337 19299 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:15:03.914753 19299 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:15:03.915383 19299 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 08:15:03.915655 19299 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:15:03.922387 19156 heartbeater.cc:503] Master 127.14.127.254:34875 was elected leader, sending a full tablet report...
W20240501 08:15:03.923950 19156 heartbeater.cc:644] Failed to heartbeat to 127.14.127.254:34875 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.14.127.254:34875: connect: Connection refused (error 111)
I20240501 08:15:03.932792 19299 rpc_server.cc:307] RPC server started. Bound to: 127.14.127.254:34875
I20240501 08:15:03.932823 19365 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.127.254:34875 every 8 connection(s)
I20240501 08:15:03.934094 19299 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/master-0/data/info.pb
I20240501 08:15:03.938514 14847 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu as pid 19299
I20240501 08:15:03.939815 19366 sys_catalog.cc:263] Verifying existing consensus state
I20240501 08:15:03.942991 19366 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51: Bootstrap starting.
I20240501 08:15:03.958636 19366 log.cc:824] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51: Log is configured to *not* fsync() on all Append() calls
I20240501 08:15:03.965507 19366 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:15:03.965960 19366 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51: Bootstrap complete.
I20240501 08:15:03.971822 19366 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ffc8b2792194f30a7296a93dce83c51" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 34875 } }
I20240501 08:15:03.972432 19366 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffc8b2792194f30a7296a93dce83c51, State: Initialized, Role: FOLLOWER
I20240501 08:15:03.972925 19366 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ffc8b2792194f30a7296a93dce83c51" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 34875 } }
I20240501 08:15:03.973124 19366 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:03.973218 19366 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:03.973383 19366 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:15:03.976876 19366 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ffc8b2792194f30a7296a93dce83c51" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 34875 } }
I20240501 08:15:03.977300 19366 leader_election.cc:302] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ffc8b2792194f30a7296a93dce83c51; no voters:
I20240501 08:15:03.978011 19366 leader_election.cc:288] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 08:15:03.978140 19371 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:15:03.978756 19371 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51 [term 2 LEADER]: Becoming Leader. State: Replica: 7ffc8b2792194f30a7296a93dce83c51, State: Running, Role: LEADER
I20240501 08:15:03.979183 19371 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ffc8b2792194f30a7296a93dce83c51" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 34875 } }
I20240501 08:15:03.979660 19366 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51 [sys.catalog]: configured and running, proceeding with master startup.
I20240501 08:15:03.981540 19372 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "7ffc8b2792194f30a7296a93dce83c51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ffc8b2792194f30a7296a93dce83c51" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 34875 } } }
I20240501 08:15:03.981588 19373 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ffc8b2792194f30a7296a93dce83c51. Latest consensus state: current_term: 2 leader_uuid: "7ffc8b2792194f30a7296a93dce83c51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ffc8b2792194f30a7296a93dce83c51" member_type: VOTER last_known_addr { host: "127.14.127.254" port: 34875 } } }
I20240501 08:15:03.981833 19372 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51 [sys.catalog]: This master's current role is: LEADER
I20240501 08:15:03.981914 19373 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51 [sys.catalog]: This master's current role is: LEADER
I20240501 08:15:03.983173 19378 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240501 08:15:03.988195 19378 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240501 08:15:03.989418 19378 catalog_manager.cc:1259] Loaded cluster ID: 777bb78e2395434c98b9438380454993
I20240501 08:15:03.989516 19378 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240501 08:15:03.993191 19378 catalog_manager.cc:1504] Loading token signing keys...
I20240501 08:15:03.994585 19378 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7ffc8b2792194f30a7296a93dce83c51: Loaded TSK: 0
I20240501 08:15:03.995999 19378 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240501 08:15:04.930888 19156 heartbeater.cc:347] Connected to a master server at 127.14.127.254:34875
I20240501 08:15:04.931082 19156 heartbeater.cc:503] Master 127.14.127.254:34875 was elected leader, sending a full tablet report...
I20240501 08:15:04.932973 19330 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" instance_seqno: 1714551302894839) as {username='slave'} at 127.14.127.193:36893; Asking this server to re-register.
I20240501 08:15:04.933704 19156 heartbeater.cc:464] Registering TS with master...
I20240501 08:15:04.934029 19156 heartbeater.cc:511] Master 127.14.127.254:34875 requested a full tablet report, sending...
I20240501 08:15:04.935217 19330 ts_manager.cc:194] Registered new tserver with Master: f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193:35041)
I20240501 08:15:04.939656 14847 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20240501 08:15:04.939831 14847 test_util.cc:268] Using random seed: 360376610
I20240501 08:15:04.961824 19330 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54162:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "<redacted>""\004\001\000fff\006\004\001\000\314\314\314\014\004\001\000233\023\004\001\000\230\231\231\031\004\001\000\376\377\377\037\004\001\000dff&\004\001\000\312\314\314,\004\001\0000333\004\001\000\226\231\2319\004\001\000\374\377\377?\004\001\000bffF\004\001\000\310\314\314L\004\001\000.33S\004\001\000\224\231\231Y\004\001\000\372\377\377_\004\001\000`fff\004\001\000\306\314\314l\004\001\000,33s\004\001\000\222\231\231y"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20240501 08:15:04.992503 19088 tablet_service.cc:1467] Processing CreateTablet for tablet 9713fe5b67374e0baf8d05c9b1ce6859 (DEFAULT_TABLE table=test-workload [id=4f2af7c188a44e1b957fe6abeef0d1c4]), partition=RANGE (key) PARTITION 322122546 <= VALUES < 429496728
I20240501 08:15:04.993440 19081 tablet_service.cc:1467] Processing CreateTablet for tablet 1d18e347333a4d28b6a51c6576078bcc (DEFAULT_TABLE table=test-workload [id=4f2af7c188a44e1b957fe6abeef0d1c4]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1181116002
I20240501 08:15:04.994115 19075 tablet_service.cc:1467] Processing CreateTablet for tablet ed45e30dbcc243ecb6aeb6a94e49054a (DEFAULT_TABLE table=test-workload [id=4f2af7c188a44e1b957fe6abeef0d1c4]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1825361094
I20240501 08:15:04.994319 19073 tablet_service.cc:1467] Processing CreateTablet for tablet 38c4ffa6eef24b99919b7b39461491d9 (DEFAULT_TABLE table=test-workload [id=4f2af7c188a44e1b957fe6abeef0d1c4]), partition=RANGE (key) PARTITION 1932735276 <= VALUES < 2040109458
I20240501 08:15:04.994505 19074 tablet_service.cc:1467] Processing CreateTablet for tablet fe12bf494be94b6682c0b144b4e2b9f4 (DEFAULT_TABLE table=test-workload [id=4f2af7c188a44e1b957fe6abeef0d1c4]), partition=RANGE (key) PARTITION 1825361094 <= VALUES < 1932735276
I20240501 08:15:04.994848 19083 tablet_service.cc:1467] Processing CreateTablet for tablet a8c6a68ee86b4a239bfac6b52a8a45ca (DEFAULT_TABLE table=test-workload [id=4f2af7c188a44e1b957fe6abeef0d1c4]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 966367638
I20240501 08:15:04.993008 19078 tablet_service.cc:1467] Processing CreateTablet for tablet cdc2ef08b47542779ad7aabc3627e520 (DEFAULT_TABLE table=test-workload [id=4f2af7c188a44e1b957fe6abeef0d1c4]), partition=RANGE (key) PARTITION 1395864366 <= VALUES < 1503238548
I20240501 08:15:04.995319 19072 tablet_service.cc:1467] Processing CreateTablet for tablet b4d3311e1aa24d3281104e3c35c97201 (DEFAULT_TABLE table=test-workload [id=4f2af7c188a44e1b957fe6abeef0d1c4]), partition=RANGE (key) PARTITION 2040109458 <= VALUES
I20240501 08:15:04.995432 19084 tablet_service.cc:1467] Processing CreateTablet for tablet e9355d74bad144239e08cc19a88bd423 (DEFAULT_TABLE table=test-workload [id=4f2af7c188a44e1b957fe6abeef0d1c4]), partition=RANGE (key) PARTITION 751619274 <= VALUES < 858993456
I20240501 08:15:04.995644 19076 tablet_service.cc:1467] Processing CreateTablet for tablet 4825c2e7956549ac8b66b56cd39124c2 (DEFAULT_TABLE table=test-workload [id=4f2af7c188a44e1b957fe6abeef0d1c4]), partition=RANGE (key) PARTITION 1610612730 <= VALUES < 1717986912
I20240501 08:15:04.993130 19077 tablet_service.cc:1467] Processing CreateTablet for tablet 970b2447a00f4987a437d043f0b08e79 (DEFAULT_TABLE table=test-workload [id=4f2af7c188a44e1b957fe6abeef0d1c4]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1610612730
I20240501 08:15:04.993239 19085 tablet_service.cc:1467] Processing CreateTablet for tablet bbac70eeb1734e0cbe84782c26e4e6a0 (DEFAULT_TABLE table=test-workload [id=4f2af7c188a44e1b957fe6abeef0d1c4]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 751619274
I20240501 08:15:04.996197 19082 tablet_service.cc:1467] Processing CreateTablet for tablet 23e9428bde004d21983951faa393e708 (DEFAULT_TABLE table=test-workload [id=4f2af7c188a44e1b957fe6abeef0d1c4]), partition=RANGE (key) PARTITION 966367638 <= VALUES < 1073741820
I20240501 08:15:04.992594 19086 tablet_service.cc:1467] Processing CreateTablet for tablet 31e3c5f7189d4cfe954218333cfb965f (DEFAULT_TABLE table=test-workload [id=4f2af7c188a44e1b957fe6abeef0d1c4]), partition=RANGE (key) PARTITION 536870910 <= VALUES < 644245092
I20240501 08:15:04.996589 19079 tablet_service.cc:1467] Processing CreateTablet for tablet 677435a8c28549a69a6c82bb53c472f1 (DEFAULT_TABLE table=test-workload [id=4f2af7c188a44e1b957fe6abeef0d1c4]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1395864366
I20240501 08:15:04.996721 19087 tablet_service.cc:1467] Processing CreateTablet for tablet 51e5cf7b08b84c5081ea8e9ee0b03503 (DEFAULT_TABLE table=test-workload [id=4f2af7c188a44e1b957fe6abeef0d1c4]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 536870910
I20240501 08:15:04.996595 19080 tablet_service.cc:1467] Processing CreateTablet for tablet aa68554abfef4c2589ffd80c4245eb6e (DEFAULT_TABLE table=test-workload [id=4f2af7c188a44e1b957fe6abeef0d1c4]), partition=RANGE (key) PARTITION 1181116002 <= VALUES < 1288490184
I20240501 08:15:04.992573 19089 tablet_service.cc:1467] Processing CreateTablet for tablet b7228c892fc640f4ab585a67b77f5f12 (DEFAULT_TABLE table=test-workload [id=4f2af7c188a44e1b957fe6abeef0d1c4]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 322122546
I20240501 08:15:04.997381 19091 tablet_service.cc:1467] Processing CreateTablet for tablet 27c99ac0f0d1428a86642e228f8bc5c9 (DEFAULT_TABLE table=test-workload [id=4f2af7c188a44e1b957fe6abeef0d1c4]), partition=RANGE (key) PARTITION VALUES < 107374182
I20240501 08:15:04.994505 19088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9713fe5b67374e0baf8d05c9b1ce6859. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:15:04.997736 19090 tablet_service.cc:1467] Processing CreateTablet for tablet 655207067b554cf5b240476a3592e4e9 (DEFAULT_TABLE table=test-workload [id=4f2af7c188a44e1b957fe6abeef0d1c4]), partition=RANGE (key) PARTITION 107374182 <= VALUES < 214748364
I20240501 08:15:04.998324 19083 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8c6a68ee86b4a239bfac6b52a8a45ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:15:04.998574 19084 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9355d74bad144239e08cc19a88bd423. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:15:04.998821 19078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdc2ef08b47542779ad7aabc3627e520. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:15:04.999034 19072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4d3311e1aa24d3281104e3c35c97201. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:15:04.999583 19086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31e3c5f7189d4cfe954218333cfb965f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:15:04.999830 19074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe12bf494be94b6682c0b144b4e2b9f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:15:05.000044 19075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed45e30dbcc243ecb6aeb6a94e49054a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:15:05.000315 19081 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d18e347333a4d28b6a51c6576078bcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:15:05.000566 19087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51e5cf7b08b84c5081ea8e9ee0b03503. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:15:05.000769 19073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38c4ffa6eef24b99919b7b39461491d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:15:05.001422 19091 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27c99ac0f0d1428a86642e228f8bc5c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:15:05.001753 19080 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa68554abfef4c2589ffd80c4245eb6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:15:05.002506 19085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbac70eeb1734e0cbe84782c26e4e6a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:15:05.003114 19077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 970b2447a00f4987a437d043f0b08e79. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:15:05.003609 19076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4825c2e7956549ac8b66b56cd39124c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:15:05.004065 19082 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23e9428bde004d21983951faa393e708. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:15:05.004617 19079 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 677435a8c28549a69a6c82bb53c472f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:15:05.005055 19089 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7228c892fc640f4ab585a67b77f5f12. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:15:05.005518 19090 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 655207067b554cf5b240476a3592e4e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:15:05.042510 19401 tablet_bootstrap.cc:492] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:05.059207 19401 tablet_bootstrap.cc:654] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684: Neither blocks nor log segments found. Creating new log.
I20240501 08:15:05.060285 19401 log.cc:824] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684: Log is configured to *not* fsync() on all Append() calls
I20240501 08:15:05.062498 19401 tablet_bootstrap.cc:492] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684: No bootstrap required, opened a new log
I20240501 08:15:05.062691 19401 ts_tablet_manager.cc:1367] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.031s user 0.005s sys 0.003s
I20240501 08:15:05.068197 19401 raft_consensus.cc:348] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.068467 19401 raft_consensus.cc:374] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:15:05.068536 19401 raft_consensus.cc:729] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:05.069011 19401 consensus_queue.cc:260] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.069171 19401 raft_consensus.cc:388] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:05.069274 19401 raft_consensus.cc:482] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:05.069380 19401 raft_consensus.cc:3037] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:15:05.071162 19401 raft_consensus.cc:504] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.071554 19401 leader_election.cc:302] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:05.072041 19401 leader_election.cc:288] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 08:15:05.072166 19403 raft_consensus.cc:2781] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:15:05.072723 19403 raft_consensus.cc:686] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:05.073204 19403 consensus_queue.cc:237] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.073468 19401 ts_tablet_manager.cc:1398] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.011s user 0.007s sys 0.004s
I20240501 08:15:05.073796 19401 tablet_bootstrap.cc:492] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:05.075325 19401 tablet_bootstrap.cc:654] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684: Neither blocks nor log segments found. Creating new log.
I20240501 08:15:05.077579 19401 tablet_bootstrap.cc:492] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684: No bootstrap required, opened a new log
I20240501 08:15:05.077739 19401 ts_tablet_manager.cc:1367] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s
I20240501 08:15:05.078161 19330 catalog_manager.cc:5484] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 0 to 1, leader changed from <none> to f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193). New cstate: current_term: 1 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:05.078370 19401 raft_consensus.cc:348] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.078496 19401 raft_consensus.cc:374] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:15:05.078589 19401 raft_consensus.cc:729] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:05.078778 19401 consensus_queue.cc:260] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.078922 19401 raft_consensus.cc:388] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:05.078995 19401 raft_consensus.cc:482] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:05.079092 19401 raft_consensus.cc:3037] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:15:05.081328 19401 raft_consensus.cc:504] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.081597 19401 leader_election.cc:302] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:05.081809 19401 leader_election.cc:288] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 08:15:05.081874 19403 raft_consensus.cc:2781] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:15:05.082073 19403 raft_consensus.cc:686] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:05.082274 19401 ts_tablet_manager.cc:1398] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240501 08:15:05.082327 19403 consensus_queue.cc:237] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.082640 19401 tablet_bootstrap.cc:492] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:05.084108 19401 tablet_bootstrap.cc:654] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684: Neither blocks nor log segments found. Creating new log.
I20240501 08:15:05.085968 19401 tablet_bootstrap.cc:492] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684: No bootstrap required, opened a new log
I20240501 08:15:05.085870 19330 catalog_manager.cc:5484] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 0 to 1, leader changed from <none> to f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193). New cstate: current_term: 1 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:05.086105 19401 ts_tablet_manager.cc:1367] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240501 08:15:05.086687 19401 raft_consensus.cc:348] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.086817 19401 raft_consensus.cc:374] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:15:05.086881 19401 raft_consensus.cc:729] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:05.087061 19401 consensus_queue.cc:260] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.087199 19401 raft_consensus.cc:388] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:05.087293 19401 raft_consensus.cc:482] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:05.087397 19401 raft_consensus.cc:3037] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:15:05.089157 19401 raft_consensus.cc:504] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.089327 19401 leader_election.cc:302] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:05.089484 19401 leader_election.cc:288] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 08:15:05.089573 19403 raft_consensus.cc:2781] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:15:05.089763 19403 raft_consensus.cc:686] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684 [term 1 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:05.090023 19401 ts_tablet_manager.cc:1398] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240501 08:15:05.089978 19403 consensus_queue.cc:237] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.090291 19401 tablet_bootstrap.cc:492] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:05.091722 19401 tablet_bootstrap.cc:654] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684: Neither blocks nor log segments found. Creating new log.
I20240501 08:15:05.091800 19330 catalog_manager.cc:5484] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 0 to 1, leader changed from <none> to f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193). New cstate: current_term: 1 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:05.093147 19401 tablet_bootstrap.cc:492] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684: No bootstrap required, opened a new log
I20240501 08:15:05.093271 19401 ts_tablet_manager.cc:1367] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 08:15:05.093901 19401 raft_consensus.cc:348] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.094066 19401 raft_consensus.cc:374] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:15:05.094166 19401 raft_consensus.cc:729] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:05.094372 19401 consensus_queue.cc:260] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.094578 19401 raft_consensus.cc:388] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:05.094667 19401 raft_consensus.cc:482] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:05.094771 19401 raft_consensus.cc:3037] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:15:05.096534 19401 raft_consensus.cc:504] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.096716 19401 leader_election.cc:302] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:05.096884 19401 leader_election.cc:288] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 08:15:05.096951 19403 raft_consensus.cc:2781] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:15:05.097108 19403 raft_consensus.cc:686] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:05.097291 19401 ts_tablet_manager.cc:1398] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20240501 08:15:05.097319 19403 consensus_queue.cc:237] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.097520 19401 tablet_bootstrap.cc:492] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:05.098882 19401 tablet_bootstrap.cc:654] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684: Neither blocks nor log segments found. Creating new log.
I20240501 08:15:05.099052 19330 catalog_manager.cc:5484] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 0 to 1, leader changed from <none> to f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193). New cstate: current_term: 1 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:05.101042 19401 tablet_bootstrap.cc:492] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684: No bootstrap required, opened a new log
I20240501 08:15:05.101158 19401 ts_tablet_manager.cc:1367] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240501 08:15:05.101766 19401 raft_consensus.cc:348] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.101922 19401 raft_consensus.cc:374] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:15:05.101994 19401 raft_consensus.cc:729] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:05.102216 19401 consensus_queue.cc:260] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.102365 19401 raft_consensus.cc:388] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:05.102456 19401 raft_consensus.cc:482] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:05.102543 19401 raft_consensus.cc:3037] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:15:05.104197 19401 raft_consensus.cc:504] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.104372 19401 leader_election.cc:302] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:05.104565 19401 leader_election.cc:288] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 08:15:05.104604 19403 raft_consensus.cc:2781] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:15:05.104769 19403 raft_consensus.cc:686] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:05.105031 19401 ts_tablet_manager.cc:1398] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240501 08:15:05.104990 19403 consensus_queue.cc:237] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.105295 19401 tablet_bootstrap.cc:492] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:05.106700 19401 tablet_bootstrap.cc:654] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684: Neither blocks nor log segments found. Creating new log.
I20240501 08:15:05.106822 19330 catalog_manager.cc:5484] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 0 to 1, leader changed from <none> to f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193). New cstate: current_term: 1 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:05.108142 19401 tablet_bootstrap.cc:492] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684: No bootstrap required, opened a new log
I20240501 08:15:05.108258 19401 ts_tablet_manager.cc:1367] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 08:15:05.108867 19401 raft_consensus.cc:348] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.109011 19401 raft_consensus.cc:374] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:15:05.109099 19401 raft_consensus.cc:729] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:05.109253 19401 consensus_queue.cc:260] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.109398 19401 raft_consensus.cc:388] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:05.109459 19401 raft_consensus.cc:482] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:05.109531 19401 raft_consensus.cc:3037] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:15:05.111460 19401 raft_consensus.cc:504] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.111644 19401 leader_election.cc:302] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:05.111761 19401 leader_election.cc:288] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 08:15:05.111821 19403 raft_consensus.cc:2781] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:15:05.111980 19403 raft_consensus.cc:686] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:05.112195 19401 ts_tablet_manager.cc:1398] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20240501 08:15:05.112190 19403 consensus_queue.cc:237] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.112421 19401 tablet_bootstrap.cc:492] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:05.113909 19401 tablet_bootstrap.cc:654] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684: Neither blocks nor log segments found. Creating new log.
I20240501 08:15:05.114192 19330 catalog_manager.cc:5484] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 0 to 1, leader changed from <none> to f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193). New cstate: current_term: 1 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:05.115466 19401 tablet_bootstrap.cc:492] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684: No bootstrap required, opened a new log
I20240501 08:15:05.115589 19401 ts_tablet_manager.cc:1367] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 08:15:05.116147 19401 raft_consensus.cc:348] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.116348 19401 raft_consensus.cc:374] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:15:05.116428 19401 raft_consensus.cc:729] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:05.116650 19401 consensus_queue.cc:260] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.116771 19401 raft_consensus.cc:388] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:05.116895 19401 raft_consensus.cc:482] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:05.116982 19401 raft_consensus.cc:3037] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:15:05.118981 19401 raft_consensus.cc:504] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.119136 19401 leader_election.cc:302] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:05.119309 19401 leader_election.cc:288] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 08:15:05.119385 19403 raft_consensus.cc:2781] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:15:05.119534 19403 raft_consensus.cc:686] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:05.119696 19401 ts_tablet_manager.cc:1398] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240501 08:15:05.119740 19403 consensus_queue.cc:237] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.119936 19401 tablet_bootstrap.cc:492] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:05.121387 19401 tablet_bootstrap.cc:654] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684: Neither blocks nor log segments found. Creating new log.
I20240501 08:15:05.121676 19330 catalog_manager.cc:5484] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 0 to 1, leader changed from <none> to f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193). New cstate: current_term: 1 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:05.122828 19401 tablet_bootstrap.cc:492] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684: No bootstrap required, opened a new log
I20240501 08:15:05.122941 19401 ts_tablet_manager.cc:1367] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240501 08:15:05.123517 19401 raft_consensus.cc:348] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.123631 19401 raft_consensus.cc:374] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:15:05.123730 19401 raft_consensus.cc:729] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:05.123893 19401 consensus_queue.cc:260] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.124068 19401 raft_consensus.cc:388] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:05.124166 19401 raft_consensus.cc:482] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:05.124271 19401 raft_consensus.cc:3037] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:15:05.126233 19401 raft_consensus.cc:504] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.126401 19401 leader_election.cc:302] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:05.126540 19401 leader_election.cc:288] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 08:15:05.126621 19403 raft_consensus.cc:2781] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:15:05.126829 19403 raft_consensus.cc:686] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:05.126955 19401 ts_tablet_manager.cc:1398] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20240501 08:15:05.127048 19403 consensus_queue.cc:237] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.127169 19401 tablet_bootstrap.cc:492] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:05.128506 19401 tablet_bootstrap.cc:654] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684: Neither blocks nor log segments found. Creating new log.
I20240501 08:15:05.128906 19330 catalog_manager.cc:5484] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 0 to 1, leader changed from <none> to f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193). New cstate: current_term: 1 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:05.130091 19401 tablet_bootstrap.cc:492] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684: No bootstrap required, opened a new log
I20240501 08:15:05.130213 19401 ts_tablet_manager.cc:1367] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20240501 08:15:05.130729 19401 raft_consensus.cc:348] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.130905 19401 raft_consensus.cc:374] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:15:05.130987 19401 raft_consensus.cc:729] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:05.131218 19401 consensus_queue.cc:260] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.131362 19401 raft_consensus.cc:388] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:05.131458 19401 raft_consensus.cc:482] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:05.131541 19401 raft_consensus.cc:3037] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:15:05.133208 19401 raft_consensus.cc:504] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.133402 19401 leader_election.cc:302] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:05.133559 19401 leader_election.cc:288] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 08:15:05.133667 19403 raft_consensus.cc:2781] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:15:05.133809 19403 raft_consensus.cc:686] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684 [term 1 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:05.133966 19401 ts_tablet_manager.cc:1398] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240501 08:15:05.134030 19403 consensus_queue.cc:237] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.134202 19401 tablet_bootstrap.cc:492] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:05.135345 19401 tablet_bootstrap.cc:654] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684: Neither blocks nor log segments found. Creating new log.
I20240501 08:15:05.135922 19330 catalog_manager.cc:5484] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 0 to 1, leader changed from <none> to f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193). New cstate: current_term: 1 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:05.136996 19401 tablet_bootstrap.cc:492] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684: No bootstrap required, opened a new log
I20240501 08:15:05.137128 19401 ts_tablet_manager.cc:1367] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 08:15:05.137817 19401 raft_consensus.cc:348] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.137954 19401 raft_consensus.cc:374] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:15:05.138041 19401 raft_consensus.cc:729] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:05.138258 19401 consensus_queue.cc:260] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.138450 19401 raft_consensus.cc:388] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:05.138536 19401 raft_consensus.cc:482] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:05.138626 19401 raft_consensus.cc:3037] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:15:05.140427 19401 raft_consensus.cc:504] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.140628 19401 leader_election.cc:302] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:05.140774 19401 leader_election.cc:288] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 08:15:05.140838 19403 raft_consensus.cc:2781] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:15:05.141047 19403 raft_consensus.cc:686] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:05.141147 19401 ts_tablet_manager.cc:1398] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20240501 08:15:05.141342 19401 tablet_bootstrap.cc:492] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:05.141295 19403 consensus_queue.cc:237] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.142658 19401 tablet_bootstrap.cc:654] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684: Neither blocks nor log segments found. Creating new log.
I20240501 08:15:05.143376 19329 catalog_manager.cc:5484] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 0 to 1, leader changed from <none> to f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193). New cstate: current_term: 1 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:05.144109 19401 tablet_bootstrap.cc:492] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684: No bootstrap required, opened a new log
I20240501 08:15:05.144270 19401 ts_tablet_manager.cc:1367] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240501 08:15:05.144850 19401 raft_consensus.cc:348] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.144981 19401 raft_consensus.cc:374] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:15:05.145058 19401 raft_consensus.cc:729] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:05.145301 19401 consensus_queue.cc:260] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.145459 19401 raft_consensus.cc:388] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:05.145538 19401 raft_consensus.cc:482] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:05.145592 19401 raft_consensus.cc:3037] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:15:05.147670 19401 raft_consensus.cc:504] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.147903 19401 leader_election.cc:302] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:05.148064 19401 leader_election.cc:288] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 08:15:05.148123 19403 raft_consensus.cc:2781] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:15:05.148365 19403 raft_consensus.cc:686] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:05.148444 19401 ts_tablet_manager.cc:1398] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20240501 08:15:05.148666 19401 tablet_bootstrap.cc:492] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:05.148615 19403 consensus_queue.cc:237] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.149960 19401 tablet_bootstrap.cc:654] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684: Neither blocks nor log segments found. Creating new log.
I20240501 08:15:05.150609 19329 catalog_manager.cc:5484] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 0 to 1, leader changed from <none> to f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193). New cstate: current_term: 1 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:05.151532 19401 tablet_bootstrap.cc:492] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684: No bootstrap required, opened a new log
I20240501 08:15:05.151626 19401 ts_tablet_manager.cc:1367] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 08:15:05.152208 19401 raft_consensus.cc:348] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.152380 19401 raft_consensus.cc:374] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:15:05.152487 19401 raft_consensus.cc:729] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:05.152684 19401 consensus_queue.cc:260] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.152860 19401 raft_consensus.cc:388] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:05.152944 19401 raft_consensus.cc:482] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:05.153057 19401 raft_consensus.cc:3037] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:15:05.155228 19401 raft_consensus.cc:504] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.155413 19401 leader_election.cc:302] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:05.155593 19401 leader_election.cc:288] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 08:15:05.155668 19403 raft_consensus.cc:2781] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:15:05.155864 19403 raft_consensus.cc:686] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:05.155957 19401 ts_tablet_manager.cc:1398] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20240501 08:15:05.156054 19403 consensus_queue.cc:237] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.156165 19401 tablet_bootstrap.cc:492] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:05.157727 19401 tablet_bootstrap.cc:654] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684: Neither blocks nor log segments found. Creating new log.
I20240501 08:15:05.158182 19329 catalog_manager.cc:5484] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 0 to 1, leader changed from <none> to f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193). New cstate: current_term: 1 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:05.159191 19401 tablet_bootstrap.cc:492] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684: No bootstrap required, opened a new log
I20240501 08:15:05.159322 19401 ts_tablet_manager.cc:1367] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.003s
I20240501 08:15:05.159893 19401 raft_consensus.cc:348] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.160053 19401 raft_consensus.cc:374] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:15:05.160127 19401 raft_consensus.cc:729] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:05.160315 19401 consensus_queue.cc:260] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.160499 19401 raft_consensus.cc:388] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:05.160589 19401 raft_consensus.cc:482] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:05.160661 19401 raft_consensus.cc:3037] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:15:05.162349 19401 raft_consensus.cc:504] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.162542 19401 leader_election.cc:302] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:05.162698 19401 leader_election.cc:288] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 08:15:05.162757 19404 raft_consensus.cc:2781] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:15:05.162879 19404 raft_consensus.cc:686] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684 [term 1 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:05.163131 19401 ts_tablet_manager.cc:1398] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20240501 08:15:05.163175 19404 consensus_queue.cc:237] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.163383 19401 tablet_bootstrap.cc:492] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:05.164760 19401 tablet_bootstrap.cc:654] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684: Neither blocks nor log segments found. Creating new log.
I20240501 08:15:05.165647 19329 catalog_manager.cc:5484] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 0 to 1, leader changed from <none> to f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193). New cstate: current_term: 1 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:05.166281 19401 tablet_bootstrap.cc:492] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684: No bootstrap required, opened a new log
I20240501 08:15:05.166396 19401 ts_tablet_manager.cc:1367] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20240501 08:15:05.167047 19401 raft_consensus.cc:348] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.167198 19401 raft_consensus.cc:374] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:15:05.167330 19401 raft_consensus.cc:729] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:05.167532 19401 consensus_queue.cc:260] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.167696 19401 raft_consensus.cc:388] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:05.167788 19401 raft_consensus.cc:482] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:05.167899 19401 raft_consensus.cc:3037] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:15:05.170111 19401 raft_consensus.cc:504] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.170310 19401 leader_election.cc:302] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:05.170428 19401 leader_election.cc:288] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 08:15:05.170511 19404 raft_consensus.cc:2781] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:15:05.170666 19404 raft_consensus.cc:686] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:05.170851 19401 ts_tablet_manager.cc:1398] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240501 08:15:05.170874 19404 consensus_queue.cc:237] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.171090 19401 tablet_bootstrap.cc:492] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:05.172369 19401 tablet_bootstrap.cc:654] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684: Neither blocks nor log segments found. Creating new log.
I20240501 08:15:05.173099 19329 catalog_manager.cc:5484] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 0 to 1, leader changed from <none> to f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193). New cstate: current_term: 1 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:05.174556 19401 tablet_bootstrap.cc:492] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684: No bootstrap required, opened a new log
I20240501 08:15:05.174695 19401 ts_tablet_manager.cc:1367] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240501 08:15:05.175331 19401 raft_consensus.cc:348] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.175504 19401 raft_consensus.cc:374] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:15:05.175585 19401 raft_consensus.cc:729] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:05.175786 19401 consensus_queue.cc:260] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.175905 19401 raft_consensus.cc:388] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:05.176007 19401 raft_consensus.cc:482] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:05.176093 19401 raft_consensus.cc:3037] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:15:05.178120 19401 raft_consensus.cc:504] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.178297 19401 leader_election.cc:302] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:05.178474 19401 leader_election.cc:288] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 08:15:05.178546 19404 raft_consensus.cc:2781] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:15:05.178665 19404 raft_consensus.cc:686] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:05.178880 19401 ts_tablet_manager.cc:1398] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240501 08:15:05.178882 19404 consensus_queue.cc:237] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.179134 19401 tablet_bootstrap.cc:492] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:05.180549 19401 tablet_bootstrap.cc:654] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684: Neither blocks nor log segments found. Creating new log.
I20240501 08:15:05.181200 19329 catalog_manager.cc:5484] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 0 to 1, leader changed from <none> to f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193). New cstate: current_term: 1 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:05.182852 19401 tablet_bootstrap.cc:492] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684: No bootstrap required, opened a new log
I20240501 08:15:05.183001 19401 ts_tablet_manager.cc:1367] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.002s
I20240501 08:15:05.183545 19401 raft_consensus.cc:348] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.183712 19401 raft_consensus.cc:374] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:15:05.183799 19401 raft_consensus.cc:729] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:05.183997 19401 consensus_queue.cc:260] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.184170 19401 raft_consensus.cc:388] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:05.184274 19401 raft_consensus.cc:482] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:05.184381 19401 raft_consensus.cc:3037] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:15:05.186515 19401 raft_consensus.cc:504] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.186677 19401 leader_election.cc:302] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:05.186797 19401 leader_election.cc:288] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 08:15:05.186936 19404 raft_consensus.cc:2781] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:15:05.187095 19404 raft_consensus.cc:686] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:05.187163 19401 ts_tablet_manager.cc:1398] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20240501 08:15:05.187304 19404 consensus_queue.cc:237] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.187379 19401 tablet_bootstrap.cc:492] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:05.189383 19329 catalog_manager.cc:5484] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 0 to 1, leader changed from <none> to f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193). New cstate: current_term: 1 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:05.209748 19401 tablet_bootstrap.cc:654] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684: Neither blocks nor log segments found. Creating new log.
I20240501 08:15:05.211144 19401 tablet_bootstrap.cc:492] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684: No bootstrap required, opened a new log
I20240501 08:15:05.211299 19401 ts_tablet_manager.cc:1367] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.001s
I20240501 08:15:05.211792 19401 raft_consensus.cc:348] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.211920 19401 raft_consensus.cc:374] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:15:05.211992 19401 raft_consensus.cc:729] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:05.212213 19401 consensus_queue.cc:260] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.212337 19401 raft_consensus.cc:388] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:05.212430 19401 raft_consensus.cc:482] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:05.212502 19401 raft_consensus.cc:3037] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:15:05.214145 19401 raft_consensus.cc:504] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.214329 19401 leader_election.cc:302] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:05.214493 19401 leader_election.cc:288] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 08:15:05.214718 19405 raft_consensus.cc:2781] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:15:05.214834 19405 raft_consensus.cc:686] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684 [term 1 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:05.214907 19401 ts_tablet_manager.cc:1398] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20240501 08:15:05.215158 19401 tablet_bootstrap.cc:492] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:05.215093 19405 consensus_queue.cc:237] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.216675 19401 tablet_bootstrap.cc:654] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684: Neither blocks nor log segments found. Creating new log.
I20240501 08:15:05.217386 19329 catalog_manager.cc:5484] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 0 to 1, leader changed from <none> to f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193). New cstate: current_term: 1 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:05.218194 19401 tablet_bootstrap.cc:492] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684: No bootstrap required, opened a new log
I20240501 08:15:05.218326 19401 ts_tablet_manager.cc:1367] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20240501 08:15:05.218904 19401 raft_consensus.cc:348] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.219062 19401 raft_consensus.cc:374] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:15:05.219134 19401 raft_consensus.cc:729] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:05.219303 19401 consensus_queue.cc:260] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.219448 19401 raft_consensus.cc:388] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:05.219537 19401 raft_consensus.cc:482] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:05.219645 19401 raft_consensus.cc:3037] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:15:05.221416 19401 raft_consensus.cc:504] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.221582 19401 leader_election.cc:302] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:05.221761 19401 leader_election.cc:288] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 08:15:05.221827 19405 raft_consensus.cc:2781] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:15:05.221963 19405 raft_consensus.cc:686] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684 [term 1 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:05.222173 19401 ts_tablet_manager.cc:1398] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240501 08:15:05.222170 19405 consensus_queue.cc:237] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.222450 19401 tablet_bootstrap.cc:492] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:05.223685 19401 tablet_bootstrap.cc:654] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684: Neither blocks nor log segments found. Creating new log.
I20240501 08:15:05.224534 19329 catalog_manager.cc:5484] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 0 to 1, leader changed from <none> to f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193). New cstate: current_term: 1 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:05.225278 19401 tablet_bootstrap.cc:492] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684: No bootstrap required, opened a new log
I20240501 08:15:05.225415 19401 ts_tablet_manager.cc:1367] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20240501 08:15:05.225999 19401 raft_consensus.cc:348] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.226130 19401 raft_consensus.cc:374] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:15:05.226197 19401 raft_consensus.cc:729] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:05.226416 19401 consensus_queue.cc:260] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.226527 19401 raft_consensus.cc:388] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:05.226610 19401 raft_consensus.cc:482] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:05.226686 19401 raft_consensus.cc:3037] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:15:05.228333 19401 raft_consensus.cc:504] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.228513 19401 leader_election.cc:302] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:05.228670 19401 leader_election.cc:288] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 08:15:05.228725 19405 raft_consensus.cc:2781] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:15:05.228888 19405 raft_consensus.cc:686] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:05.229041 19401 ts_tablet_manager.cc:1398] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20240501 08:15:05.229076 19405 consensus_queue.cc:237] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.229290 19401 tablet_bootstrap.cc:492] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:05.230796 19401 tablet_bootstrap.cc:654] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684: Neither blocks nor log segments found. Creating new log.
I20240501 08:15:05.231007 19329 catalog_manager.cc:5484] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 0 to 1, leader changed from <none> to f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193). New cstate: current_term: 1 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:05.232285 19401 tablet_bootstrap.cc:492] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684: No bootstrap required, opened a new log
I20240501 08:15:05.232398 19401 ts_tablet_manager.cc:1367] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 08:15:05.232929 19401 raft_consensus.cc:348] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.233054 19401 raft_consensus.cc:374] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:15:05.233145 19401 raft_consensus.cc:729] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:05.233346 19401 consensus_queue.cc:260] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.233493 19401 raft_consensus.cc:388] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:05.233579 19401 raft_consensus.cc:482] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:05.233708 19401 raft_consensus.cc:3037] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:15:05.235297 19401 raft_consensus.cc:504] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.235496 19401 leader_election.cc:302] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:05.235644 19401 leader_election.cc:288] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 08:15:05.235704 19405 raft_consensus.cc:2781] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:15:05.235881 19405 raft_consensus.cc:686] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:05.235986 19401 ts_tablet_manager.cc:1398] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240501 08:15:05.236076 19405 consensus_queue.cc:237] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:05.237890 19329 catalog_manager.cc:5484] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 0 to 1, leader changed from <none> to f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193). New cstate: current_term: 1 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:08.591984 14847 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
/tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.127.194:45405
--local_ip_for_outbound_sockets=127.14.127.194
--tserver_master_addrs=127.14.127.254:34875
--webserver_port=34693
--webserver_interface=127.14.127.194
--builtin_ntp_servers=127.14.127.212:37535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=20 with env {}
W20240501 08:15:08.900802 19512 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 08:15:08.901033 19512 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 08:15:08.901151 19512 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 08:15:08.908140 19512 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 08:15:08.908329 19512 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.127.194
I20240501 08:15:08.916704 19512 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.127.212:37535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.127.194:45405
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.127.194
--webserver_port=34693
--tserver_master_addrs=127.14.127.254:34875
--num_tablets_to_copy_simultaneously=20
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.127.194
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 07:43:24 UTC on efd1337a2aa3
build id 71
ASAN enabled
I20240501 08:15:08.917840 19512 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 08:15:08.919382 19512 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:15:08.932021 19517 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:15:08.932644 19520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:15:08.933184 19518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:15:08.933900 19512 server_base.cc:1034] running on GCE node
I20240501 08:15:08.934554 19512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 08:15:08.935588 19512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 08:15:08.936825 19512 hybrid_clock.cc:648] HybridClock initialized: now 1714551308936758 us; error 39 us; skew 500 ppm
I20240501 08:15:08.937139 19512 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:15:08.939581 19512 webserver.cc:460] Webserver started at http://127.14.127.194:34693/ using document root <none> and password file <none>
I20240501 08:15:08.940393 19512 fs_manager.cc:359] Metadata directory not provided
I20240501 08:15:08.940528 19512 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:15:08.945864 19512 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20240501 08:15:08.948436 19526 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:15:08.949668 19512 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240501 08:15:08.949829 19512 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-1/data,/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-1/wal
uuid: "5a08cd9e624b416b99b4b0747ea41244"
format_stamp: "Formatted at 2024-05-01 08:15:03 on dist-test-slave-2bdt"
I20240501 08:15:08.950614 19512 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:15:08.969725 19512 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:15:08.970405 19512 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 08:15:08.970638 19512 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:15:08.971427 19512 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 08:15:08.972754 19512 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 08:15:08.972848 19512 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 08:15:08.972959 19512 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 08:15:08.973029 19512 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 08:15:09.006111 19512 rpc_server.cc:307] RPC server started. Bound to: 127.14.127.194:45405
I20240501 08:15:09.006192 19638 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.127.194:45405 every 8 connection(s)
I20240501 08:15:09.007391 19512 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-1/data/info.pb
I20240501 08:15:09.011168 14847 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu as pid 19512
I20240501 08:15:09.012603 14847 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu pid 19029
I20240501 08:15:09.013913 19151 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 08:15:09.023334 19639 heartbeater.cc:347] Connected to a master server at 127.14.127.254:34875
I20240501 08:15:09.023597 19639 heartbeater.cc:464] Registering TS with master...
I20240501 08:15:09.024340 19639 heartbeater.cc:511] Master 127.14.127.254:34875 requested a full tablet report, sending...
I20240501 08:15:09.025810 19323 ts_manager.cc:194] Registered new tserver with Master: 5a08cd9e624b416b99b4b0747ea41244 (127.14.127.194:45405)
I20240501 08:15:09.026904 19323 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.127.194:57753
I20240501 08:15:09.216394 14847 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu with pid 19029
I20240501 08:15:09.242640 14847 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
/tmp/dist-test-taskg9LclQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.127.193:35041
--local_ip_for_outbound_sockets=127.14.127.193
--tserver_master_addrs=127.14.127.254:34875
--webserver_port=43007
--webserver_interface=127.14.127.193
--builtin_ntp_servers=127.14.127.212:37535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=20
--rpc_service_queue_length=1
--rpc_num_service_threads=1 with env {}
W20240501 08:15:09.542794 19644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 08:15:09.543063 19644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 08:15:09.543215 19644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 08:15:09.550238 19644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 08:15:09.550436 19644 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.127.193
I20240501 08:15:09.558583 19644 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.127.212:37535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.127.193:35041
--rpc_num_service_threads=1
--rpc_server_allow_ephemeral_ports=true
--rpc_service_queue_length=1
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.127.193
--webserver_port=43007
--tserver_master_addrs=127.14.127.254:34875
--num_tablets_to_copy_simultaneously=20
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.127.193
--log_dir=/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 07:43:24 UTC on efd1337a2aa3
build id 71
ASAN enabled
I20240501 08:15:09.559698 19644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 08:15:09.561259 19644 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:15:09.572819 19649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:15:09.573361 19650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:15:09.574043 19652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:15:09.574693 19644 server_base.cc:1034] running on GCE node
I20240501 08:15:09.575263 19644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 08:15:09.576216 19644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 08:15:09.577512 19644 hybrid_clock.cc:648] HybridClock initialized: now 1714551309577444 us; error 29 us; skew 500 ppm
I20240501 08:15:09.577827 19644 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:15:09.580080 19644 webserver.cc:460] Webserver started at http://127.14.127.193:43007/ using document root <none> and password file <none>
I20240501 08:15:09.580801 19644 fs_manager.cc:359] Metadata directory not provided
I20240501 08:15:09.580945 19644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:15:09.586050 19644 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20240501 08:15:09.590566 19658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:15:09.591830 19644 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20240501 08:15:09.591975 19644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-0/data,/tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-0/wal
uuid: "f568ec3ddce14e6898835a3e4f6a5684"
format_stamp: "Formatted at 2024-05-01 08:15:02 on dist-test-slave-2bdt"
I20240501 08:15:09.592823 19644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:15:09.623248 19644 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:15:09.624020 19644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 08:15:09.624289 19644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:15:09.625171 19644 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 08:15:09.627316 19665 ts_tablet_manager.cc:522] Loading tablet metadata (0/20 complete)
I20240501 08:15:09.664745 19644 ts_tablet_manager.cc:559] Loaded tablet metadata (20 total tablets, 20 live tablets)
I20240501 08:15:09.664883 19644 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.038s user 0.000s sys 0.002s
I20240501 08:15:09.665011 19644 ts_tablet_manager.cc:574] Registering tablets (0/20 complete)
I20240501 08:15:09.668196 19665 tablet_bootstrap.cc:492] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:09.696949 19644 ts_tablet_manager.cc:590] Registered 20 tablets
I20240501 08:15:09.697033 19644 ts_tablet_manager.cc:569] Time spent register tablets: real 0.032s user 0.017s sys 0.012s
I20240501 08:15:09.705042 19644 rpc_server.cc:307] RPC server started. Bound to: 127.14.127.193:35041
I20240501 08:15:09.705065 19676 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.127.193:35041 every 8 connection(s)
I20240501 08:15:09.706416 19644 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskg9LclQ/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714551278873485-14847-0/minicluster-data/ts-0/data/info.pb
I20240501 08:15:09.707983 19665 log.cc:824] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684: Log is configured to *not* fsync() on all Append() calls
I20240501 08:15:09.711418 14847 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskg9LclQ/build/asan/bin/kudu as pid 19644
I20240501 08:15:09.723274 19677 heartbeater.cc:347] Connected to a master server at 127.14.127.254:34875
I20240501 08:15:09.723611 19677 heartbeater.cc:464] Registering TS with master...
I20240501 08:15:09.724761 19677 heartbeater.cc:511] Master 127.14.127.254:34875 requested a full tablet report, sending...
I20240501 08:15:09.728765 19323 ts_manager.cc:194] Re-registered known tserver with Master: f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193:35041)
I20240501 08:15:09.734180 19323 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.127.193:46759
I20240501 08:15:09.866155 19665 tablet_bootstrap.cc:492] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap replayed 1/1 log segments. Stats: ops{read=192 overwritten=0 applied=192 ignored=0} inserts{seen=556 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:15:09.866667 19665 tablet_bootstrap.cc:492] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap complete.
I20240501 08:15:09.867718 19665 ts_tablet_manager.cc:1367] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.200s user 0.154s sys 0.043s
I20240501 08:15:09.871673 19665 raft_consensus.cc:348] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:09.872426 19665 raft_consensus.cc:729] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:09.873111 19665 consensus_queue.cc:260] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 192, Last appended: 1.192, Last appended by leader: 192, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:09.873387 19665 raft_consensus.cc:388] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:09.873509 19665 raft_consensus.cc:482] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:09.873713 19665 raft_consensus.cc:3037] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:15:09.877048 19665 raft_consensus.cc:504] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:09.877502 19665 leader_election.cc:302] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:09.878032 19665 leader_election.cc:288] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 08:15:09.878178 19684 raft_consensus.cc:2781] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:15:09.879065 19677 heartbeater.cc:503] Master 127.14.127.254:34875 was elected leader, sending a full tablet report...
I20240501 08:15:09.879195 19684 raft_consensus.cc:686] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:09.879500 19665 ts_tablet_manager.cc:1398] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.012s user 0.013s sys 0.000s
I20240501 08:15:09.879693 19684 consensus_queue.cc:237] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 192, Committed index: 192, Last appended: 1.192, Last appended by leader: 192, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:09.879830 19665 tablet_bootstrap.cc:492] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:09.886366 19323 catalog_manager.cc:5484] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:10.029201 19639 heartbeater.cc:503] Master 127.14.127.254:34875 was elected leader, sending a full tablet report...
I20240501 08:15:10.049386 19665 tablet_bootstrap.cc:492] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap replayed 1/1 log segments. Stats: ops{read=186 overwritten=0 applied=186 ignored=0} inserts{seen=500 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:15:10.049949 19665 tablet_bootstrap.cc:492] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap complete.
I20240501 08:15:10.050877 19665 ts_tablet_manager.cc:1367] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.171s user 0.146s sys 0.023s
I20240501 08:15:10.051625 19665 raft_consensus.cc:348] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:10.051767 19665 raft_consensus.cc:729] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:10.052009 19665 consensus_queue.cc:260] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 186, Last appended: 1.186, Last appended by leader: 186, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:10.052135 19665 raft_consensus.cc:388] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:10.052227 19665 raft_consensus.cc:482] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:10.052305 19665 raft_consensus.cc:3037] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:15:10.054090 19665 raft_consensus.cc:504] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:10.054268 19665 leader_election.cc:302] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:10.054675 19665 leader_election.cc:288] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 08:15:10.054728 19684 raft_consensus.cc:2781] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:15:10.054895 19684 raft_consensus.cc:686] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:10.055127 19665 ts_tablet_manager.cc:1398] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240501 08:15:10.055122 19684 consensus_queue.cc:237] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 186, Committed index: 186, Last appended: 1.186, Last appended by leader: 186, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:10.055408 19665 tablet_bootstrap.cc:492] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:10.057089 19323 catalog_manager.cc:5484] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:10.212481 19665 tablet_bootstrap.cc:492] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap replayed 1/1 log segments. Stats: ops{read=183 overwritten=0 applied=183 ignored=0} inserts{seen=498 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:15:10.212898 19665 tablet_bootstrap.cc:492] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap complete.
I20240501 08:15:10.213925 19665 ts_tablet_manager.cc:1367] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.159s user 0.138s sys 0.020s
I20240501 08:15:10.214545 19665 raft_consensus.cc:348] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:10.214726 19665 raft_consensus.cc:729] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:10.214972 19665 consensus_queue.cc:260] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 183, Last appended: 1.183, Last appended by leader: 183, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:10.215118 19665 raft_consensus.cc:388] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:10.215188 19665 raft_consensus.cc:482] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:10.215283 19665 raft_consensus.cc:3037] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:15:10.216913 19665 raft_consensus.cc:504] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:10.217108 19665 leader_election.cc:302] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:10.217267 19665 leader_election.cc:288] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 08:15:10.217355 19684 raft_consensus.cc:2781] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:15:10.217530 19684 raft_consensus.cc:686] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:10.217728 19665 ts_tablet_manager.cc:1398] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240501 08:15:10.217767 19684 consensus_queue.cc:237] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 183, Committed index: 183, Last appended: 1.183, Last appended by leader: 183, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:10.217942 19665 tablet_bootstrap.cc:492] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:10.219646 19323 catalog_manager.cc:5484] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:10.372671 19665 tablet_bootstrap.cc:492] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap replayed 1/1 log segments. Stats: ops{read=186 overwritten=0 applied=186 ignored=0} inserts{seen=494 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:15:10.373103 19665 tablet_bootstrap.cc:492] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap complete.
I20240501 08:15:10.373996 19665 ts_tablet_manager.cc:1367] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.156s user 0.140s sys 0.016s
I20240501 08:15:10.374567 19665 raft_consensus.cc:348] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:10.374728 19665 raft_consensus.cc:729] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:10.374961 19665 consensus_queue.cc:260] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 186, Last appended: 1.186, Last appended by leader: 186, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:10.375104 19665 raft_consensus.cc:388] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:10.375202 19665 raft_consensus.cc:482] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:10.375288 19665 raft_consensus.cc:3037] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:15:10.376854 19665 raft_consensus.cc:504] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:10.377051 19665 leader_election.cc:302] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:10.377214 19665 leader_election.cc:288] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 08:15:10.377331 19684 raft_consensus.cc:2781] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:15:10.377496 19684 raft_consensus.cc:686] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:10.377584 19665 ts_tablet_manager.cc:1398] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20240501 08:15:10.377717 19684 consensus_queue.cc:237] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 186, Committed index: 186, Last appended: 1.186, Last appended by leader: 186, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:10.377822 19665 tablet_bootstrap.cc:492] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:10.379875 19323 catalog_manager.cc:5484] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:10.541424 19665 tablet_bootstrap.cc:492] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap replayed 1/1 log segments. Stats: ops{read=195 overwritten=0 applied=195 ignored=0} inserts{seen=501 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:15:10.541841 19665 tablet_bootstrap.cc:492] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap complete.
I20240501 08:15:10.542748 19665 ts_tablet_manager.cc:1367] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.165s user 0.148s sys 0.016s
I20240501 08:15:10.543310 19665 raft_consensus.cc:348] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:10.543493 19665 raft_consensus.cc:729] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:10.543676 19665 consensus_queue.cc:260] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:10.543805 19665 raft_consensus.cc:388] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:10.543853 19665 raft_consensus.cc:482] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:10.543922 19665 raft_consensus.cc:3037] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:15:10.545588 19665 raft_consensus.cc:504] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:10.545814 19665 leader_election.cc:302] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:10.545955 19665 leader_election.cc:288] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 08:15:10.546047 19684 raft_consensus.cc:2781] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:15:10.546308 19684 raft_consensus.cc:686] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:10.546438 19665 ts_tablet_manager.cc:1398] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240501 08:15:10.546665 19665 tablet_bootstrap.cc:492] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:10.546639 19684 consensus_queue.cc:237] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 195, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:10.549011 19323 catalog_manager.cc:5484] T fe12bf494be94b6682c0b144b4e2b9f4 P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:10.719101 19665 tablet_bootstrap.cc:492] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap replayed 1/1 log segments. Stats: ops{read=188 overwritten=0 applied=188 ignored=0} inserts{seen=524 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:15:10.719575 19665 tablet_bootstrap.cc:492] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap complete.
I20240501 08:15:10.720547 19665 ts_tablet_manager.cc:1367] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.174s user 0.159s sys 0.012s
I20240501 08:15:10.721128 19665 raft_consensus.cc:348] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:10.721282 19665 raft_consensus.cc:729] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:10.721526 19665 consensus_queue.cc:260] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 188, Last appended: 1.188, Last appended by leader: 188, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:10.721717 19665 raft_consensus.cc:388] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:10.721845 19665 raft_consensus.cc:482] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:10.721931 19665 raft_consensus.cc:3037] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:15:10.723757 19665 raft_consensus.cc:504] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:10.723933 19665 leader_election.cc:302] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:10.724124 19665 leader_election.cc:288] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 08:15:10.724177 19684 raft_consensus.cc:2781] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:15:10.724507 19665 ts_tablet_manager.cc:1398] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240501 08:15:10.724705 19665 tablet_bootstrap.cc:492] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:10.730011 19684 raft_consensus.cc:686] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:10.730242 19684 consensus_queue.cc:237] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 188, Committed index: 188, Last appended: 1.188, Last appended by leader: 188, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:10.735627 19323 catalog_manager.cc:5484] T 51e5cf7b08b84c5081ea8e9ee0b03503 P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:10.893260 19665 tablet_bootstrap.cc:492] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap replayed 1/1 log segments. Stats: ops{read=193 overwritten=0 applied=193 ignored=0} inserts{seen=541 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:15:10.893769 19665 tablet_bootstrap.cc:492] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap complete.
I20240501 08:15:10.894793 19665 ts_tablet_manager.cc:1367] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.170s user 0.157s sys 0.012s
I20240501 08:15:10.895370 19665 raft_consensus.cc:348] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:10.895529 19665 raft_consensus.cc:729] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:10.895733 19665 consensus_queue.cc:260] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 193, Last appended: 1.193, Last appended by leader: 193, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:10.895876 19665 raft_consensus.cc:388] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:10.895941 19665 raft_consensus.cc:482] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:10.896039 19665 raft_consensus.cc:3037] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:15:10.897854 19665 raft_consensus.cc:504] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:10.898087 19665 leader_election.cc:302] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:10.898281 19665 leader_election.cc:288] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 08:15:10.898396 19684 raft_consensus.cc:2781] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:15:10.898698 19684 raft_consensus.cc:686] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684 [term 2 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:10.899461 19665 ts_tablet_manager.cc:1398] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20240501 08:15:10.899984 19665 tablet_bootstrap.cc:492] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:10.899977 19684 consensus_queue.cc:237] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 193, Committed index: 193, Last appended: 1.193, Last appended by leader: 193, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:10.902717 19323 catalog_manager.cc:5484] T ed45e30dbcc243ecb6aeb6a94e49054a P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:11.067597 19665 tablet_bootstrap.cc:492] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap replayed 1/1 log segments. Stats: ops{read=186 overwritten=0 applied=186 ignored=0} inserts{seen=507 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:15:11.068006 19665 tablet_bootstrap.cc:492] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap complete.
I20240501 08:15:11.068851 19665 ts_tablet_manager.cc:1367] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.169s user 0.146s sys 0.020s
I20240501 08:15:11.069439 19665 raft_consensus.cc:348] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:11.069566 19665 raft_consensus.cc:729] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:11.069794 19665 consensus_queue.cc:260] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 186, Last appended: 1.186, Last appended by leader: 186, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:11.069913 19665 raft_consensus.cc:388] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:11.069974 19665 raft_consensus.cc:482] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:11.070036 19665 raft_consensus.cc:3037] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:15:11.071681 19665 raft_consensus.cc:504] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:11.071858 19665 leader_election.cc:302] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:11.072016 19665 leader_election.cc:288] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 08:15:11.072073 19684 raft_consensus.cc:2781] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:15:11.072266 19684 raft_consensus.cc:686] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:11.072521 19665 ts_tablet_manager.cc:1398] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20240501 08:15:11.072523 19684 consensus_queue.cc:237] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 186, Committed index: 186, Last appended: 1.186, Last appended by leader: 186, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:11.072794 19665 tablet_bootstrap.cc:492] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:11.074950 19323 catalog_manager.cc:5484] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:11.231673 19665 tablet_bootstrap.cc:492] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap replayed 1/1 log segments. Stats: ops{read=184 overwritten=0 applied=184 ignored=0} inserts{seen=460 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:15:11.232193 19665 tablet_bootstrap.cc:492] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap complete.
I20240501 08:15:11.233449 19665 ts_tablet_manager.cc:1367] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.161s user 0.145s sys 0.012s
I20240501 08:15:11.234059 19665 raft_consensus.cc:348] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:11.234246 19665 raft_consensus.cc:729] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:11.234447 19665 consensus_queue.cc:260] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 184, Last appended: 1.184, Last appended by leader: 184, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:11.234619 19665 raft_consensus.cc:388] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:11.234692 19665 raft_consensus.cc:482] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:11.234763 19665 raft_consensus.cc:3037] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:15:11.236429 19665 raft_consensus.cc:504] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:11.236634 19665 leader_election.cc:302] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:11.236815 19665 leader_election.cc:288] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 08:15:11.236930 19684 raft_consensus.cc:2781] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:15:11.237112 19684 raft_consensus.cc:686] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684 [term 2 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:11.237315 19665 ts_tablet_manager.cc:1398] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240501 08:15:11.237360 19684 consensus_queue.cc:237] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 184, Committed index: 184, Last appended: 1.184, Last appended by leader: 184, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:11.237545 19665 tablet_bootstrap.cc:492] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:11.239534 19323 catalog_manager.cc:5484] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:11.406340 19665 tablet_bootstrap.cc:492] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap replayed 1/1 log segments. Stats: ops{read=192 overwritten=0 applied=192 ignored=0} inserts{seen=517 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:15:11.406949 19665 tablet_bootstrap.cc:492] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap complete.
I20240501 08:15:11.408185 19665 ts_tablet_manager.cc:1367] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.171s user 0.156s sys 0.012s
I20240501 08:15:11.408959 19665 raft_consensus.cc:348] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:11.409106 19665 raft_consensus.cc:729] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:11.409308 19665 consensus_queue.cc:260] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 192, Last appended: 1.192, Last appended by leader: 192, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:11.409436 19665 raft_consensus.cc:388] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:11.409524 19665 raft_consensus.cc:482] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:11.409598 19665 raft_consensus.cc:3037] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:15:11.411276 19665 raft_consensus.cc:504] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:11.411448 19665 leader_election.cc:302] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:11.411638 19665 leader_election.cc:288] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 08:15:11.411684 19684 raft_consensus.cc:2781] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:15:11.411861 19684 raft_consensus.cc:686] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:11.412097 19665 ts_tablet_manager.cc:1398] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20240501 08:15:11.412096 19684 consensus_queue.cc:237] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 192, Committed index: 192, Last appended: 1.192, Last appended by leader: 192, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:11.412395 19665 tablet_bootstrap.cc:492] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:11.414426 19323 catalog_manager.cc:5484] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:11.572789 19665 tablet_bootstrap.cc:492] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap replayed 1/1 log segments. Stats: ops{read=190 overwritten=0 applied=190 ignored=0} inserts{seen=506 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:15:11.573187 19665 tablet_bootstrap.cc:492] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap complete.
I20240501 08:15:11.574245 19665 ts_tablet_manager.cc:1367] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.162s user 0.125s sys 0.036s
I20240501 08:15:11.574941 19665 raft_consensus.cc:348] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:11.575112 19665 raft_consensus.cc:729] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:11.575318 19665 consensus_queue.cc:260] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 190, Last appended: 1.190, Last appended by leader: 190, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:11.575464 19665 raft_consensus.cc:388] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:11.575536 19665 raft_consensus.cc:482] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:11.575634 19665 raft_consensus.cc:3037] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:15:11.577271 19665 raft_consensus.cc:504] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:11.577479 19665 leader_election.cc:302] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:11.577661 19665 leader_election.cc:288] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 08:15:11.577739 19684 raft_consensus.cc:2781] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:15:11.577862 19684 raft_consensus.cc:686] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:11.578164 19665 ts_tablet_manager.cc:1398] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240501 08:15:11.578092 19684 consensus_queue.cc:237] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 190, Committed index: 190, Last appended: 1.190, Last appended by leader: 190, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:11.578388 19665 tablet_bootstrap.cc:492] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:11.580248 19323 catalog_manager.cc:5484] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:11.741398 19665 tablet_bootstrap.cc:492] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap replayed 1/1 log segments. Stats: ops{read=195 overwritten=0 applied=195 ignored=0} inserts{seen=506 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:15:11.741889 19665 tablet_bootstrap.cc:492] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap complete.
I20240501 08:15:11.743086 19665 ts_tablet_manager.cc:1367] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.165s user 0.139s sys 0.024s
I20240501 08:15:11.743628 19665 raft_consensus.cc:348] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:11.743768 19665 raft_consensus.cc:729] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:11.743954 19665 consensus_queue.cc:260] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:11.744066 19665 raft_consensus.cc:388] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:11.744149 19665 raft_consensus.cc:482] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:11.744223 19665 raft_consensus.cc:3037] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:15:11.745926 19665 raft_consensus.cc:504] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:11.746098 19665 leader_election.cc:302] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:11.746253 19665 leader_election.cc:288] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 08:15:11.746296 19684 raft_consensus.cc:2781] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:15:11.746469 19684 raft_consensus.cc:686] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:11.746693 19665 ts_tablet_manager.cc:1398] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240501 08:15:11.746690 19684 consensus_queue.cc:237] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 195, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:11.746956 19665 tablet_bootstrap.cc:492] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:11.748970 19323 catalog_manager.cc:5484] T 9713fe5b67374e0baf8d05c9b1ce6859 P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:11.902323 19665 tablet_bootstrap.cc:492] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap replayed 1/1 log segments. Stats: ops{read=184 overwritten=0 applied=184 ignored=0} inserts{seen=513 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:15:11.902717 19665 tablet_bootstrap.cc:492] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap complete.
I20240501 08:15:11.903586 19665 ts_tablet_manager.cc:1367] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.157s user 0.143s sys 0.012s
I20240501 08:15:11.904110 19665 raft_consensus.cc:348] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:11.904265 19665 raft_consensus.cc:729] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:11.904448 19665 consensus_queue.cc:260] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 184, Last appended: 1.184, Last appended by leader: 184, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:11.904584 19665 raft_consensus.cc:388] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:11.904655 19665 raft_consensus.cc:482] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:11.904740 19665 raft_consensus.cc:3037] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:15:11.906330 19665 raft_consensus.cc:504] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:11.906522 19665 leader_election.cc:302] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:11.906669 19665 leader_election.cc:288] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 08:15:11.906746 19684 raft_consensus.cc:2781] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:15:11.906904 19684 raft_consensus.cc:686] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:11.907063 19665 ts_tablet_manager.cc:1398] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20240501 08:15:11.907131 19684 consensus_queue.cc:237] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 184, Committed index: 184, Last appended: 1.184, Last appended by leader: 184, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:11.907263 19665 tablet_bootstrap.cc:492] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:11.909348 19323 catalog_manager.cc:5484] T 27c99ac0f0d1428a86642e228f8bc5c9 P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:12.074514 19665 tablet_bootstrap.cc:492] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap replayed 1/1 log segments. Stats: ops{read=193 overwritten=0 applied=193 ignored=0} inserts{seen=502 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:15:12.075091 19665 tablet_bootstrap.cc:492] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap complete.
I20240501 08:15:12.076192 19665 ts_tablet_manager.cc:1367] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.169s user 0.138s sys 0.028s
I20240501 08:15:12.076843 19665 raft_consensus.cc:348] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:12.076973 19665 raft_consensus.cc:729] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:12.077144 19665 consensus_queue.cc:260] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 193, Last appended: 1.193, Last appended by leader: 193, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:12.077252 19665 raft_consensus.cc:388] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:12.077309 19665 raft_consensus.cc:482] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:12.077363 19665 raft_consensus.cc:3037] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:15:12.078922 19665 raft_consensus.cc:504] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:12.079070 19665 leader_election.cc:302] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:12.079202 19665 leader_election.cc:288] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 08:15:12.079259 19684 raft_consensus.cc:2781] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:15:12.079474 19684 raft_consensus.cc:686] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:12.079664 19665 ts_tablet_manager.cc:1398] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20240501 08:15:12.079697 19684 consensus_queue.cc:237] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 193, Committed index: 193, Last appended: 1.193, Last appended by leader: 193, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:12.079916 19665 tablet_bootstrap.cc:492] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:12.081954 19323 catalog_manager.cc:5484] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:12.251931 19665 tablet_bootstrap.cc:492] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap replayed 1/1 log segments. Stats: ops{read=197 overwritten=0 applied=197 ignored=0} inserts{seen=523 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:15:12.252382 19665 tablet_bootstrap.cc:492] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap complete.
I20240501 08:15:12.253324 19665 ts_tablet_manager.cc:1367] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.173s user 0.154s sys 0.016s
I20240501 08:15:12.253947 19665 raft_consensus.cc:348] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:12.254120 19665 raft_consensus.cc:729] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:12.254326 19665 consensus_queue.cc:260] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 197, Last appended: 1.197, Last appended by leader: 197, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:12.254477 19665 raft_consensus.cc:388] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:12.254559 19665 raft_consensus.cc:482] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:12.254663 19665 raft_consensus.cc:3037] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:15:12.256386 19665 raft_consensus.cc:504] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:12.256583 19665 leader_election.cc:302] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:12.256737 19665 leader_election.cc:288] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 08:15:12.256820 19684 raft_consensus.cc:2781] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:15:12.256992 19684 raft_consensus.cc:686] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:12.257164 19665 ts_tablet_manager.cc:1398] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240501 08:15:12.257216 19684 consensus_queue.cc:237] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 197, Committed index: 197, Last appended: 1.197, Last appended by leader: 197, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:12.257385 19665 tablet_bootstrap.cc:492] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:12.259601 19323 catalog_manager.cc:5484] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:12.439997 19665 tablet_bootstrap.cc:492] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap replayed 1/1 log segments. Stats: ops{read=189 overwritten=0 applied=189 ignored=0} inserts{seen=522 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:15:12.440426 19665 tablet_bootstrap.cc:492] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap complete.
I20240501 08:15:12.441323 19665 ts_tablet_manager.cc:1367] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.184s user 0.147s sys 0.020s
I20240501 08:15:12.441947 19665 raft_consensus.cc:348] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:12.442086 19665 raft_consensus.cc:729] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:12.442305 19665 consensus_queue.cc:260] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 189, Last appended: 1.189, Last appended by leader: 189, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:12.442454 19665 raft_consensus.cc:388] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:12.442548 19665 raft_consensus.cc:482] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:12.442627 19665 raft_consensus.cc:3037] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:15:12.444372 19665 raft_consensus.cc:504] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:12.444537 19665 leader_election.cc:302] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:12.444715 19665 leader_election.cc:288] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 08:15:12.444768 19684 raft_consensus.cc:2781] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:15:12.444975 19684 raft_consensus.cc:686] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684 [term 2 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:12.445168 19665 ts_tablet_manager.cc:1398] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240501 08:15:12.445219 19684 consensus_queue.cc:237] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 189, Committed index: 189, Last appended: 1.189, Last appended by leader: 189, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:12.445399 19665 tablet_bootstrap.cc:492] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:12.447504 19323 catalog_manager.cc:5484] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:12.608403 19665 tablet_bootstrap.cc:492] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap replayed 1/1 log segments. Stats: ops{read=188 overwritten=0 applied=188 ignored=0} inserts{seen=529 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:15:12.608808 19665 tablet_bootstrap.cc:492] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap complete.
I20240501 08:15:12.609899 19665 ts_tablet_manager.cc:1367] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.165s user 0.141s sys 0.023s
I20240501 08:15:12.610735 19665 raft_consensus.cc:348] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:12.610945 19665 raft_consensus.cc:729] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:12.611166 19665 consensus_queue.cc:260] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 188, Last appended: 1.188, Last appended by leader: 188, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:12.611325 19665 raft_consensus.cc:388] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:12.611393 19665 raft_consensus.cc:482] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:12.611500 19665 raft_consensus.cc:3037] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:15:12.613102 19665 raft_consensus.cc:504] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:12.613293 19665 leader_election.cc:302] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:12.613440 19665 leader_election.cc:288] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 08:15:12.613576 19684 raft_consensus.cc:2781] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:15:12.613796 19684 raft_consensus.cc:686] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:12.613912 19665 ts_tablet_manager.cc:1398] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240501 08:15:12.614135 19665 tablet_bootstrap.cc:492] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:12.614063 19684 consensus_queue.cc:237] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 188, Committed index: 188, Last appended: 1.188, Last appended by leader: 188, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:12.616178 19323 catalog_manager.cc:5484] T bbac70eeb1734e0cbe84782c26e4e6a0 P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:12.783529 19665 tablet_bootstrap.cc:492] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap replayed 1/1 log segments. Stats: ops{read=194 overwritten=0 applied=194 ignored=0} inserts{seen=522 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:15:12.784121 19665 tablet_bootstrap.cc:492] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap complete.
I20240501 08:15:12.785391 19665 ts_tablet_manager.cc:1367] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.171s user 0.131s sys 0.036s
I20240501 08:15:12.786175 19665 raft_consensus.cc:348] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:12.786377 19665 raft_consensus.cc:729] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:12.786612 19665 consensus_queue.cc:260] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 194, Last appended: 1.194, Last appended by leader: 194, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:12.786787 19665 raft_consensus.cc:388] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:12.786899 19665 raft_consensus.cc:482] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:12.786988 19665 raft_consensus.cc:3037] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:15:12.788707 19665 raft_consensus.cc:504] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:12.788901 19665 leader_election.cc:302] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:12.789086 19665 leader_election.cc:288] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 08:15:12.789151 19684 raft_consensus.cc:2781] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:15:12.789518 19665 ts_tablet_manager.cc:1398] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20240501 08:15:12.789779 19665 tablet_bootstrap.cc:492] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:12.789860 19684 raft_consensus.cc:686] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684 [term 2 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:12.790086 19684 consensus_queue.cc:237] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 194, Committed index: 194, Last appended: 1.194, Last appended by leader: 194, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:12.792455 19323 catalog_manager.cc:5484] T 31e3c5f7189d4cfe954218333cfb965f P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:12.961755 19665 tablet_bootstrap.cc:492] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap replayed 1/1 log segments. Stats: ops{read=195 overwritten=0 applied=195 ignored=0} inserts{seen=556 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:15:12.962186 19665 tablet_bootstrap.cc:492] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap complete.
I20240501 08:15:12.963096 19665 ts_tablet_manager.cc:1367] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.173s user 0.156s sys 0.016s
I20240501 08:15:12.963660 19665 raft_consensus.cc:348] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:12.963824 19665 raft_consensus.cc:729] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:12.964066 19665 consensus_queue.cc:260] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:12.964212 19665 raft_consensus.cc:388] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:12.964289 19665 raft_consensus.cc:482] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:12.964417 19665 raft_consensus.cc:3037] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:15:12.966120 19665 raft_consensus.cc:504] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:12.966331 19665 leader_election.cc:302] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:12.966502 19665 leader_election.cc:288] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 08:15:12.966560 19684 raft_consensus.cc:2781] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:15:12.966743 19684 raft_consensus.cc:686] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684 [term 2 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:12.966890 19665 ts_tablet_manager.cc:1398] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240501 08:15:12.966980 19684 consensus_queue.cc:237] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 195, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:12.967103 19665 tablet_bootstrap.cc:492] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap starting.
I20240501 08:15:12.969151 19323 catalog_manager.cc:5484] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:13.134817 19665 tablet_bootstrap.cc:492] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap replayed 1/1 log segments. Stats: ops{read=195 overwritten=0 applied=195 ignored=0} inserts{seen=523 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:15:13.135288 19665 tablet_bootstrap.cc:492] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684: Bootstrap complete.
I20240501 08:15:13.136128 19665 ts_tablet_manager.cc:1367] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684: Time spent bootstrapping tablet: real 0.169s user 0.143s sys 0.024s
I20240501 08:15:13.136709 19665 raft_consensus.cc:348] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:13.136873 19665 raft_consensus.cc:729] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Initialized, Role: FOLLOWER
I20240501 08:15:13.137075 19665 consensus_queue.cc:260] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:13.137202 19665 raft_consensus.cc:388] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:15:13.137329 19665 raft_consensus.cc:482] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:15:13.137430 19665 raft_consensus.cc:3037] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:15:13.139132 19665 raft_consensus.cc:504] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:13.139321 19665 leader_election.cc:302] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f568ec3ddce14e6898835a3e4f6a5684; no voters:
I20240501 08:15:13.139503 19665 leader_election.cc:288] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 08:15:13.139546 19684 raft_consensus.cc:2781] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:15:13.139689 19684 raft_consensus.cc:686] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684 [term 2 LEADER]: Becoming Leader. State: Replica: f568ec3ddce14e6898835a3e4f6a5684, State: Running, Role: LEADER
I20240501 08:15:13.139981 19665 ts_tablet_manager.cc:1398] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684: Time spent starting tablet: real 0.004s user 0.002s sys 0.004s
I20240501 08:15:13.139940 19684 consensus_queue.cc:237] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 195, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } }
I20240501 08:15:13.141949 19323 catalog_manager.cc:5484] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "f568ec3ddce14e6898835a3e4f6a5684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f568ec3ddce14e6898835a3e4f6a5684" member_type: VOTER last_known_addr { host: "127.14.127.193" port: 35041 } health_report { overall_health: HEALTHY } } }
I20240501 08:15:13.165515 19765 ts_tablet_manager.cc:902] T bbac70eeb1734e0cbe84782c26e4e6a0 P 5a08cd9e624b416b99b4b0747ea41244: Initiating tablet copy from peer f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193:35041)
I20240501 08:15:13.171121 19760 ts_tablet_manager.cc:902] T aa68554abfef4c2589ffd80c4245eb6e P 5a08cd9e624b416b99b4b0747ea41244: Initiating tablet copy from peer f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193:35041)
I20240501 08:15:13.171802 19762 ts_tablet_manager.cc:902] T 970b2447a00f4987a437d043f0b08e79 P 5a08cd9e624b416b99b4b0747ea41244: Initiating tablet copy from peer f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193:35041)
I20240501 08:15:13.172304 19763 ts_tablet_manager.cc:902] T 1d18e347333a4d28b6a51c6576078bcc P 5a08cd9e624b416b99b4b0747ea41244: Initiating tablet copy from peer f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193:35041)
I20240501 08:15:13.172785 19764 ts_tablet_manager.cc:902] T 23e9428bde004d21983951faa393e708 P 5a08cd9e624b416b99b4b0747ea41244: Initiating tablet copy from peer f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193:35041)
I20240501 08:15:13.173588 19758 ts_tablet_manager.cc:902] T e9355d74bad144239e08cc19a88bd423 P 5a08cd9e624b416b99b4b0747ea41244: Initiating tablet copy from peer f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193:35041)
I20240501 08:15:13.183219 19764 tablet_copy_client.cc:308] T 23e9428bde004d21983951faa393e708 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:35041
I20240501 08:15:13.183517 19763 tablet_copy_client.cc:308] T 1d18e347333a4d28b6a51c6576078bcc P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:35041
I20240501 08:15:13.184768 19762 tablet_copy_client.cc:308] T 970b2447a00f4987a437d043f0b08e79 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:35041
I20240501 08:15:13.186017 19760 tablet_copy_client.cc:308] T aa68554abfef4c2589ffd80c4245eb6e P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:35041
I20240501 08:15:13.186205 19758 tablet_copy_client.cc:308] T e9355d74bad144239e08cc19a88bd423 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:35041
I20240501 08:15:13.201403 19757 ts_tablet_manager.cc:902] T b4d3311e1aa24d3281104e3c35c97201 P 5a08cd9e624b416b99b4b0747ea41244: Initiating tablet copy from peer f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193:35041)
I20240501 08:15:13.217983 19756 ts_tablet_manager.cc:902] T 4825c2e7956549ac8b66b56cd39124c2 P 5a08cd9e624b416b99b4b0747ea41244: Initiating tablet copy from peer f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193:35041)
I20240501 08:15:13.239751 19769 ts_tablet_manager.cc:902] T 677435a8c28549a69a6c82bb53c472f1 P 5a08cd9e624b416b99b4b0747ea41244: Initiating tablet copy from peer f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193:35041)
I20240501 08:15:13.240825 19761 ts_tablet_manager.cc:902] T cdc2ef08b47542779ad7aabc3627e520 P 5a08cd9e624b416b99b4b0747ea41244: Initiating tablet copy from peer f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193:35041)
I20240501 08:15:13.244097 19774 ts_tablet_manager.cc:902] T ed45e30dbcc243ecb6aeb6a94e49054a P 5a08cd9e624b416b99b4b0747ea41244: Initiating tablet copy from peer f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193:35041)
I20240501 08:15:13.249399 19771 ts_tablet_manager.cc:902] T a8c6a68ee86b4a239bfac6b52a8a45ca P 5a08cd9e624b416b99b4b0747ea41244: Initiating tablet copy from peer f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193:35041)
I20240501 08:15:13.251060 19772 ts_tablet_manager.cc:902] T 38c4ffa6eef24b99919b7b39461491d9 P 5a08cd9e624b416b99b4b0747ea41244: Initiating tablet copy from peer f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193:35041)
I20240501 08:15:13.252210 19767 ts_tablet_manager.cc:902] T 655207067b554cf5b240476a3592e4e9 P 5a08cd9e624b416b99b4b0747ea41244: Initiating tablet copy from peer f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193:35041)
I20240501 08:15:13.256328 19770 ts_tablet_manager.cc:902] T b7228c892fc640f4ab585a67b77f5f12 P 5a08cd9e624b416b99b4b0747ea41244: Initiating tablet copy from peer f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193:35041)
I20240501 08:15:13.257403 19768 ts_tablet_manager.cc:902] T 51e5cf7b08b84c5081ea8e9ee0b03503 P 5a08cd9e624b416b99b4b0747ea41244: Initiating tablet copy from peer f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193:35041)
I20240501 08:15:13.258538 19773 ts_tablet_manager.cc:902] T 27c99ac0f0d1428a86642e228f8bc5c9 P 5a08cd9e624b416b99b4b0747ea41244: Initiating tablet copy from peer f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193:35041)
F20240501 08:15:13.259076 19773 trace_metrics.cc:68] Check failed: g_intern_map->size() < 100 (100 vs. 100) Too many interned strings: (MaintenanceMgr.queue_time_us, MaintenanceMgr.queue_time_us) (MaintenanceMgr.run_cpu_time_us, MaintenanceMgr.run_cpu_time_us) (MaintenanceMgr.run_wall_time_us, MaintenanceMgr.run_wall_time_us) (apply.queue_time_us, apply.queue_time_us) (apply.run_cpu_time_us, apply.run_cpu_time_us) (apply.run_wall_time_us, apply.run_wall_time_us) (client-negotiator.queue_time_us, client-negotiator.queue_time_us) (client-negotiator.run_cpu_time_us, client-negotiator.run_cpu_time_us) (client-negotiator.run_wall_time_us, client-negotiator.run_wall_time_us) (compiler_manager_pool.queue_time_us, compiler_manager_pool.queue_time_us) (compiler_manager_pool.run_cpu_time_us, compiler_manager_pool.run_cpu_time_us) (compiler_manager_pool.run_wall_time_us, compiler_manager_pool.run_wall_time_us) (dirs.queue_time_us, dirs.queue_time_us) (dirs.run_cpu_time_us, dirs.run_cpu_time_us) (dirs.run_wall_time_us, dirs.run_wall_time_us) (dns-resolver.queue_time_us, dns-resolver.queue_time_us) (dns-resolver.run_cpu_time_us, dns-resolver.run_cpu_time_us) (dns-resolver.run_wall_time_us, dns-resolver.run_wall_time_us) (prepare.queue_time_us, prepare.queue_time_us) (prepare.run_cpu_time_us, prepare.run_cpu_time_us) (prepare.run_wall_time_us, prepare.run_wall_time_us) (raft.queue_time_us, raft.queue_time_us) (raft.run_cpu_time_us, raft.run_cpu_time_us) (raft.run_wall_time_us, raft.run_wall_time_us) (repair_pool.queue_time_us, repair_pool.queue_time_us) (repair_pool.run_cpu_time_us, repair_pool.run_cpu_time_us) (repair_pool.run_wall_time_us, repair_pool.run_wall_time_us) (server-negotiator.queue_time_us, server-negotiator.queue_time_us) (server-negotiator.run_cpu_time_us, server-negotiator.run_cpu_time_us) (server-negotiator.run_wall_time_us, server-negotiator.run_wall_time_us) (tablet-copy.queue_time_us, tablet-copy.queue_time_us) (tablet-copy.run_cpu_time_us, tablet-copy.run_cpu_time_us) (tablet-copy.run_wall_time_us, tablet-copy.run_wall_time_us) (tablet-delete.queue_time_us, tablet-delete.queue_time_us) (tablet-delete.run_cpu_time_us, tablet-delete.run_cpu_time_us) (tablet-delete.run_wall_time_us, tablet-delete.run_wall_time_us) (tablet-download-pool-1d18e347333a4d28b6a51c6576078bcc.queue_time_us, tablet-download-pool-1d18e347333a4d28b6a51c6576078bcc.queue_time_us) (tablet-download-pool-1d18e347333a4d28b6a51c6576078bcc.run_cpu_time_us, tablet-download-pool-1d18e347333a4d28b6a51c6576078bcc.run_cpu_time_us) (tablet-download-pool-1d18e347333a4d28b6a51c6576078bcc.run_wall_time_us, tablet-download-pool-1d18e347333a4d28b6a51c6576078bcc.run_wall_time_us) (tablet-download-pool-23e9428bde004d21983951faa393e708.queue_time_us, tablet-download-pool-23e9428bde004d21983951faa393e708.queue_time_us) (tablet-download-pool-23e9428bde004d21983951faa393e708.run_cpu_time_us, tablet-download-pool-23e9428bde004d21983951faa393e708.run_cpu_time_us) (tablet-download-pool-23e9428bde004d21983951faa393e708.run_wall_time_us, tablet-download-pool-23e9428bde004d21983951faa393e708.run_wall_time_us) (tablet-download-pool-27c99ac0f0d1428a86642e228f8bc5c9.queue_time_us, tablet-download-pool-27c99ac0f0d1428a86642e228f8bc5c9.queue_time_us) (tablet-download-pool-38c4ffa6eef24b99919b7b39461491d9.queue_time_us, tablet-download-pool-38c4ffa6eef24b99919b7b39461491d9.queue_time_us) (tablet-download-pool-38c4ffa6eef24b99919b7b39461491d9.run_cpu_time_us, tablet-download-pool-38c4ffa6eef24b99919b7b39461491d9.run_cpu_time_us) (tablet-download-pool-38c4ffa6eef24b99919b7b39461491d9.run_wall_time_us, tablet-download-pool-38c4ffa6eef24b99919b7b39461491d9.run_wall_time_us) (tablet-download-pool-4825c2e7956549ac8b66b56cd39124c2.queue_time_us, tablet-download-pool-4825c2e7956549ac8b66b56cd39124c2.queue_time_us) (tablet-download-pool-4825c2e7956549ac8b66b56cd39124c2.run_cpu_time_us, tablet-download-pool-4825c2e7956549ac8b66b56cd39124c2.run_cpu_time_us) (tablet-download-pool-4825c2e7956549ac8b66b56cd39124c2.run_wall_time_us, tablet-download-pool-4825c2e7956549ac8b66b56cd39124c2.run_wall_time_us) (tablet-download-pool-51e5cf7b08b84c5081ea8e9ee0b03503.queue_time_us, tablet-download-pool-51e5cf7b08b84c5081ea8e9ee0b03503.queue_time_us) (tablet-download-pool-51e5cf7b08b84c5081ea8e9ee0b03503.run_cpu_time_us, tablet-download-pool-51e5cf7b08b84c5081ea8e9ee0b03503.run_cpu_time_us) (tablet-download-pool-51e5cf7b08b84c5081ea8e9ee0b03503.run_wall_time_us, tablet-download-pool-51e5cf7b08b84c5081ea8e9ee0b03503.run_wall_time_us) (tablet-download-pool-655207067b554cf5b240476a3592e4e9.queue_time_us, tablet-download-pool-655207067b554cf5b240476a3592e4e9.queue_time_us) (tablet-download-pool-655207067b554cf5b240476a3592e4e9.run_cpu_time_us, tablet-download-pool-655207067b554cf5b240476a3592e4e9.run_cpu_time_us) (tablet-download-pool-655207067b554cf5b240476a3592e4e9.run_wall_time_us, tablet-download-pool-655207067b554cf5b240476a3592e4e9.run_wall_time_us) (tablet-download-pool-677435a8c28549a69a6c82bb53c472f1.queue_time_us, tablet-download-pool-677435a8c28549a69a6c82bb53c472f1.queue_time_us) (tablet-download-pool-677435a8c28549a69a6c82bb53c472f1.run_cpu_time_us, tablet-download-pool-677435a8c28549a69a6c82bb53c472f1.run_cpu_time_us) (tablet-download-pool-677435a8c28549a69a6c82bb53c472f1.run_wall_time_us, tablet-download-pool-677435a8c28549a69a6c82bb53c472f1.run_wall_time_us) (tablet-download-pool-970b2447a00f4987a437d043f0b08e79.queue_time_us, tablet-download-pool-970b2447a00f4987a437d043f0b08e79.queue_time_us) (tablet-download-pool-970b2447a00f4987a437d043f0b08e79.run_cpu_time_us, tablet-download-pool-970b2447a00f4987a437d043f0b08e79.run_cpu_time_us) (tablet-download-pool-970b2447a00f4987a437d043f0b08e79.run_wall_time_us, tablet-download-pool-970b2447a00f4987a437d043f0b08e79.run_wall_time_us) (tablet-download-pool-a8c6a68ee86b4a239bfac6b52a8a45ca.queue_time_us, tablet-download-pool-a8c6a68ee86b4a239bfac6b52a8a45ca.queue_time_us) (tablet-download-pool-a8c6a68ee86b4a239bfac6b52a8a45ca.run_cpu_time_us, tablet-download-pool-a8c6a68ee86b4a239bfac6b52a8a45ca.run_cpu_time_us) (tablet-download-pool-a8c6a68ee86b4a239bfac6b52a8a45ca.run_wall_time_us, tablet-download-pool-a8c6a68ee86b4a239bfac6b52a8a45ca.run_wall_time_us) (tablet-download-pool-aa68554abfef4c2589ffd80c4245eb6e.queue_time_us, tablet-download-pool-aa68554abfef4c2589ffd80c4245eb6e.queue_time_us) (tablet-download-pool-aa68554abfef4c2589ffd80c4245eb6e.run_cpu_time_us, tablet-download-pool-aa68554abfef4c2589ffd80c4245eb6e.run_cpu_time_us) (tablet-download-pool-aa68554abfef4c2589ffd80c4245eb6e.run_wall_time_us, tablet-download-pool-aa68554abfef4c2589ffd80c4245eb6e.run_wall_time_us) (tablet-download-pool-b4d3311e1aa24d3281104e3c35c97201.queue_time_us, tablet-download-pool-b4d3311e1aa24d3281104e3c35c97201.queue_time_us) (tablet-download-pool-b4d3311e1aa24d3281104e3c35c97201.run_cpu_time_us, tablet-download-pool-b4d3311e1aa24d3281104e3c35c97201.run_cpu_time_us) (tablet-download-pool-b4d3311e1aa24d3281104e3c35c97201.run_wall_time_us, tablet-download-pool-b4d3311e1aa24d3281104e3c35c97201.run_wall_time_us) (tablet-download-pool-b7228c892fc640f4ab585a67b77f5f12.queue_time_us, tablet-download-pool-b7228c892fc640f4ab585a67b77f5f12.queue_time_us) (tablet-download-pool-b7228c892fc640f4ab585a67b77f5f12.run_cpu_time_us, tablet-download-pool-b7228c892fc640f4ab585a67b77f5f12.run_cpu_time_us) (tablet-download-pool-b7228c892fc640f4ab585a67b77f5f12.run_wall_time_us, tablet-download-pool-b7228c892fc640f4ab585a67b77f5f12.run_wall_time_us) (tablet-download-pool-bbac70eeb1734e0cbe84782c26e4e6a0.queue_time_us, tablet-download-pool-bbac70eeb1734e0cbe84782c26e4e6a0.queue_time_us) (tablet-download-pool-bbac70eeb1734e0cbe84782c26e4e6a0.run_cpu_time_us, tablet-download-pool-bbac70eeb1734e0cbe84782c26e4e6a0.run_cpu_time_us) (tablet-download-pool-bbac70eeb1734e0cbe84782c26e4e6a0.run_wall_time_us, tablet-download-pool-bbac70eeb1734e0cbe84782c26e4e6a0.run_wall_time_us) (tablet-download-pool-cdc2ef08b47542779ad7aabc3627e520.queue_time_us, tablet-download-pool-cdc2ef08b47542779ad7aabc3627e520.queue_time_us) (tablet-download-pool-cdc2ef08b47542779ad7aabc3627e520.run_cpu_time_us, tablet-download-pool-cdc2ef08b47542779ad7aabc3627e520.run_cpu_time_us) (tablet-download-pool-cdc2ef08b47542779ad7aabc3627e520.run_wall_time_us, tablet-download-pool-cdc2ef08b47542779ad7aabc3627e520.run_wall_time_us) (tablet-download-pool-e9355d74bad144239e08cc19a88bd423.queue_time_us, tablet-download-pool-e9355d74bad144239e08cc19a88bd423.queue_time_us) (tablet-download-pool-e9355d74bad144239e08cc19a88bd423.run_cpu_time_us, tablet-download-pool-e9355d74bad144239e08cc19a88bd423.run_cpu_time_us) (tablet-download-pool-e9355d74bad144239e08cc19a88bd423.run_wall_time_us, tablet-download-pool-e9355d74bad144239e08cc19a88bd423.run_wall_time_us) (tablet-download-pool-ed45e30dbcc243ecb6aeb6a94e49054a.queue_time_us, tablet-download-pool-ed45e30dbcc243ecb6aeb6a94e49054a.queue_time_us) (tablet-download-pool-ed45e30dbcc243ecb6aeb6a94e49054a.run_cpu_time_us, tablet-download-pool-ed45e30dbcc243ecb6aeb6a94e49054a.run_cpu_time_us) (tablet-download-pool-ed45e30dbcc243ecb6aeb6a94e49054a.run_wall_time_us, tablet-download-pool-ed45e30dbcc243ecb6aeb6a94e49054a.run_wall_time_us) (tablet-open.queue_time_us, tablet-open.queue_time_us) (tablet-open.run_cpu_time_us, tablet-open.run_cpu_time_us) (tablet-open.run_wall_time_us, tablet-open.run_wall_time_us) (txn-commit.queue_time_us, txn-commit.queue_time_us) (txn-commit.run_cpu_time_us, txn-commit.run_cpu_time_us) (txn-commit.run_wall_time_us, txn-commit.run_wall_time_us) (txn-participant-registration.queue_time_us, txn-participant-registration.queue_time_us) (txn-participant-registration.run_cpu_time_us, txn-participant-registration.run_cpu_time_us) (txn-participant-registration.run_wall_time_us, txn-participant-registration.run_wall_time_us) (txn-status-manager.queue_time_us, txn-status-manager.queue_time_us) (txn-status-manager.run_cpu_time_us, txn-status-manager.run_cpu_time_us) (txn-status-manager.run_wall_time_us, txn-status-manager.run_wall_time_us) (txn-status-tablet-reload.queue_time_us, txn-status-tablet-reload.queue_time_us) (txn-status-tablet-reload.run_cpu_time_us, txn-status-tablet-reload.run_cpu_time_us) (txn-status-tablet-reload.run_wall_time_us, txn-status-tablet-reload.run_wall_time_us)
*** Check failure stack trace: ***
I20240501 08:15:13.279273 19759 ts_tablet_manager.cc:902] T 31e3c5f7189d4cfe954218333cfb965f P 5a08cd9e624b416b99b4b0747ea41244: Initiating tablet copy from peer f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193:35041)
I20240501 08:15:13.283048 19766 ts_tablet_manager.cc:902] T 9713fe5b67374e0baf8d05c9b1ce6859 P 5a08cd9e624b416b99b4b0747ea41244: Initiating tablet copy from peer f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193:35041)
@ 0x7f9374dcadcd google::LogMessage::Fail() at ??:0
I20240501 08:15:13.293430 19755 ts_tablet_manager.cc:902] T fe12bf494be94b6682c0b144b4e2b9f4 P 5a08cd9e624b416b99b4b0747ea41244: Initiating tablet copy from peer f568ec3ddce14e6898835a3e4f6a5684 (127.14.127.193:35041)
@ 0x7f9374dceb93 google::LogMessage::SendToLog() at ??:0
@ 0x7f9374dca7cc google::LogMessage::Flush() at ??:0
I20240501 08:15:13.301534 19671 tablet_copy_service.cc:140] P f568ec3ddce14e6898835a3e4f6a5684: Received BeginTabletCopySession request for tablet 23e9428bde004d21983951faa393e708 from peer 5a08cd9e624b416b99b4b0747ea41244 ({username='slave'} at 127.14.127.194:39371)
I20240501 08:15:13.301862 19671 tablet_copy_service.cc:161] P f568ec3ddce14e6898835a3e4f6a5684: Beginning new tablet copy session on tablet 23e9428bde004d21983951faa393e708 from peer 5a08cd9e624b416b99b4b0747ea41244 at {username='slave'} at 127.14.127.194:39371: session id = 5a08cd9e624b416b99b4b0747ea41244-23e9428bde004d21983951faa393e708
I20240501 08:15:13.302600 19756 tablet_copy_client.cc:308] T 4825c2e7956549ac8b66b56cd39124c2 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:35041
@ 0x7f9374dcbf59 google::LogMessageFatal::~LogMessageFatal() at ??:0
W20240501 08:15:13.306294 19662 service_pool.cc:135] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items.
I20240501 08:15:13.306684 19662 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 1)
@ 0x7f9377b0b742 kudu::TraceMetrics::InternName() at ??:0
I20240501 08:15:13.317342 19662 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 1)
I20240501 08:15:13.317679 19662 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 1)
I20240501 08:15:13.317975 19662 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 1)
I20240501 08:15:13.320514 19671 tablet_copy_source_session.cc:205] T 23e9428bde004d21983951faa393e708 P f568ec3ddce14e6898835a3e4f6a5684: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 08:15:13.321064 19772 tablet_copy_client.cc:308] T 38c4ffa6eef24b99919b7b39461491d9 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:35041
I20240501 08:15:13.321805 19671 tablet_copy_service.cc:140] P f568ec3ddce14e6898835a3e4f6a5684: Received BeginTabletCopySession request for tablet 1d18e347333a4d28b6a51c6576078bcc from peer 5a08cd9e624b416b99b4b0747ea41244 ({username='slave'} at 127.14.127.194:39371)
I20240501 08:15:13.321998 19671 tablet_copy_service.cc:161] P f568ec3ddce14e6898835a3e4f6a5684: Beginning new tablet copy session on tablet 1d18e347333a4d28b6a51c6576078bcc from peer 5a08cd9e624b416b99b4b0747ea41244 at {username='slave'} at 127.14.127.194:39371: session id = 5a08cd9e624b416b99b4b0747ea41244-1d18e347333a4d28b6a51c6576078bcc
I20240501 08:15:13.323060 19757 tablet_copy_client.cc:308] T b4d3311e1aa24d3281104e3c35c97201 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:35041
@ 0x7f9377ad7f8b kudu::ThreadPool::ThreadPool() at ??:0
I20240501 08:15:13.326305 19671 tablet_copy_source_session.cc:205] T 1d18e347333a4d28b6a51c6576078bcc P f568ec3ddce14e6898835a3e4f6a5684: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 08:15:13.321830 19662 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
I20240501 08:15:13.327692 19662 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 9)
I20240501 08:15:13.328152 19662 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 10)
@ 0x7f9377ad1cd6 kudu::ThreadPoolBuilder::Build() at ??:0
I20240501 08:15:13.331696 19764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23e9428bde004d21983951faa393e708. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:15:13.333585 19763 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d18e347333a4d28b6a51c6576078bcc. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f9386f248de kudu::tserver::TabletCopyClient::TabletCopyClient() at ??:0
@ 0x7f9386f3cdaf kudu::tserver::RemoteTabletCopyClient::RemoteTabletCopyClient() at ??:0
@ 0x7f9387067480 kudu::tserver::TSTabletManager::RunTabletCopy() at ??:0
I20240501 08:15:13.348739 19662 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 10)
I20240501 08:15:13.349336 19671 tablet_copy_service.cc:140] P f568ec3ddce14e6898835a3e4f6a5684: Received BeginTabletCopySession request for tablet b4d3311e1aa24d3281104e3c35c97201 from peer 5a08cd9e624b416b99b4b0747ea41244 ({username='slave'} at 127.14.127.194:39371)
I20240501 08:15:13.349527 19671 tablet_copy_service.cc:161] P f568ec3ddce14e6898835a3e4f6a5684: Beginning new tablet copy session on tablet b4d3311e1aa24d3281104e3c35c97201 from peer 5a08cd9e624b416b99b4b0747ea41244 at {username='slave'} at 127.14.127.194:39371: session id = 5a08cd9e624b416b99b4b0747ea41244-b4d3311e1aa24d3281104e3c35c97201
I20240501 08:15:13.350050 19662 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 10)
I20240501 08:15:13.353272 19671 tablet_copy_source_session.cc:205] T b4d3311e1aa24d3281104e3c35c97201 P f568ec3ddce14e6898835a3e4f6a5684: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 08:15:13.353984 19671 tablet_copy_service.cc:140] P f568ec3ddce14e6898835a3e4f6a5684: Received BeginTabletCopySession request for tablet 970b2447a00f4987a437d043f0b08e79 from peer 5a08cd9e624b416b99b4b0747ea41244 ({username='slave'} at 127.14.127.194:39371)
I20240501 08:15:13.354157 19671 tablet_copy_service.cc:161] P f568ec3ddce14e6898835a3e4f6a5684: Beginning new tablet copy session on tablet 970b2447a00f4987a437d043f0b08e79 from peer 5a08cd9e624b416b99b4b0747ea41244 at {username='slave'} at 127.14.127.194:39371: session id = 5a08cd9e624b416b99b4b0747ea41244-970b2447a00f4987a437d043f0b08e79
I20240501 08:15:13.358108 19671 tablet_copy_source_session.cc:205] T 970b2447a00f4987a437d043f0b08e79 P f568ec3ddce14e6898835a3e4f6a5684: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 08:15:13.358099 19761 tablet_copy_client.cc:308] T cdc2ef08b47542779ad7aabc3627e520 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:35041
I20240501 08:15:13.365299 19671 tablet_copy_service.cc:140] P f568ec3ddce14e6898835a3e4f6a5684: Received BeginTabletCopySession request for tablet aa68554abfef4c2589ffd80c4245eb6e from peer 5a08cd9e624b416b99b4b0747ea41244 ({username='slave'} at 127.14.127.194:39371)
I20240501 08:15:13.365453 19671 tablet_copy_service.cc:161] P f568ec3ddce14e6898835a3e4f6a5684: Beginning new tablet copy session on tablet aa68554abfef4c2589ffd80c4245eb6e from peer 5a08cd9e624b416b99b4b0747ea41244 at {username='slave'} at 127.14.127.194:39371: session id = 5a08cd9e624b416b99b4b0747ea41244-aa68554abfef4c2589ffd80c4245eb6e
I20240501 08:15:13.368954 19671 tablet_copy_source_session.cc:205] T aa68554abfef4c2589ffd80c4245eb6e P f568ec3ddce14e6898835a3e4f6a5684: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 08:15:13.375188 19662 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 15)
I20240501 08:15:13.376236 19671 tablet_copy_service.cc:140] P f568ec3ddce14e6898835a3e4f6a5684: Received BeginTabletCopySession request for tablet cdc2ef08b47542779ad7aabc3627e520 from peer 5a08cd9e624b416b99b4b0747ea41244 ({username='slave'} at 127.14.127.194:39371)
I20240501 08:15:13.376411 19671 tablet_copy_service.cc:161] P f568ec3ddce14e6898835a3e4f6a5684: Beginning new tablet copy session on tablet cdc2ef08b47542779ad7aabc3627e520 from peer 5a08cd9e624b416b99b4b0747ea41244 at {username='slave'} at 127.14.127.194:39371: session id = 5a08cd9e624b416b99b4b0747ea41244-cdc2ef08b47542779ad7aabc3627e520
I20240501 08:15:13.381222 19671 tablet_copy_source_session.cc:205] T cdc2ef08b47542779ad7aabc3627e520 P f568ec3ddce14e6898835a3e4f6a5684: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 08:15:13.383008 19662 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 15)
I20240501 08:15:13.384189 19757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4d3311e1aa24d3281104e3c35c97201. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:15:13.384882 19761 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdc2ef08b47542779ad7aabc3627e520. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:15:13.385126 19760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa68554abfef4c2589ffd80c4245eb6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:15:13.389809 19762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 970b2447a00f4987a437d043f0b08e79. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:15:13.397544 19767 tablet_copy_client.cc:308] T 655207067b554cf5b240476a3592e4e9 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:35041
I20240501 08:15:13.400772 19671 tablet_copy_service.cc:140] P f568ec3ddce14e6898835a3e4f6a5684: Received BeginTabletCopySession request for tablet e9355d74bad144239e08cc19a88bd423 from peer 5a08cd9e624b416b99b4b0747ea41244 ({username='slave'} at 127.14.127.194:39371)
I20240501 08:15:13.400940 19671 tablet_copy_service.cc:161] P f568ec3ddce14e6898835a3e4f6a5684: Beginning new tablet copy session on tablet e9355d74bad144239e08cc19a88bd423 from peer 5a08cd9e624b416b99b4b0747ea41244 at {username='slave'} at 127.14.127.194:39371: session id = 5a08cd9e624b416b99b4b0747ea41244-e9355d74bad144239e08cc19a88bd423
I20240501 08:15:13.403761 19757 tablet_copy_client.cc:783] T b4d3311e1aa24d3281104e3c35c97201 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Starting download of 0 data blocks...
I20240501 08:15:13.404052 19757 tablet_copy_client.cc:647] T b4d3311e1aa24d3281104e3c35c97201 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Starting download of 1 WAL segments...
I20240501 08:15:13.404572 19761 tablet_copy_client.cc:783] T cdc2ef08b47542779ad7aabc3627e520 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Starting download of 0 data blocks...
I20240501 08:15:13.404688 19671 tablet_copy_source_session.cc:205] T e9355d74bad144239e08cc19a88bd423 P f568ec3ddce14e6898835a3e4f6a5684: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 08:15:13.404788 19761 tablet_copy_client.cc:647] T cdc2ef08b47542779ad7aabc3627e520 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Starting download of 1 WAL segments...
I20240501 08:15:13.405304 19763 tablet_copy_client.cc:783] T 1d18e347333a4d28b6a51c6576078bcc P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Starting download of 0 data blocks...
I20240501 08:15:13.405563 19763 tablet_copy_client.cc:647] T 1d18e347333a4d28b6a51c6576078bcc P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Starting download of 1 WAL segments...
I20240501 08:15:13.405998 19764 tablet_copy_client.cc:783] T 23e9428bde004d21983951faa393e708 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Starting download of 0 data blocks...
I20240501 08:15:13.406087 19662 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 18)
I20240501 08:15:13.406235 19764 tablet_copy_client.cc:647] T 23e9428bde004d21983951faa393e708 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Starting download of 1 WAL segments...
I20240501 08:15:13.406407 19662 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 18)
I20240501 08:15:13.406469 19771 tablet_copy_client.cc:308] T a8c6a68ee86b4a239bfac6b52a8a45ca P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:35041
I20240501 08:15:13.408150 19760 tablet_copy_client.cc:783] T aa68554abfef4c2589ffd80c4245eb6e P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Starting download of 0 data blocks...
I20240501 08:15:13.408432 19760 tablet_copy_client.cc:647] T aa68554abfef4c2589ffd80c4245eb6e P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Starting download of 1 WAL segments...
I20240501 08:15:13.408489 19662 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 18)
I20240501 08:15:13.408792 19662 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 18)
I20240501 08:15:13.409098 19662 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 18)
I20240501 08:15:13.410761 19662 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 18)
I20240501 08:15:13.412377 19762 tablet_copy_client.cc:783] T 970b2447a00f4987a437d043f0b08e79 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Starting download of 0 data blocks...
I20240501 08:15:13.413775 19765 tablet_copy_client.cc:308] T bbac70eeb1734e0cbe84782c26e4e6a0 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:35041
I20240501 08:15:13.413890 19662 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 18)
I20240501 08:15:13.415710 19662 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 18)
I20240501 08:15:13.416996 19770 tablet_copy_client.cc:308] T b7228c892fc640f4ab585a67b77f5f12 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:35041
I20240501 08:15:13.417368 19768 tablet_copy_client.cc:308] T 51e5cf7b08b84c5081ea8e9ee0b03503 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:35041
I20240501 08:15:13.417372 19774 tablet_copy_client.cc:308] T ed45e30dbcc243ecb6aeb6a94e49054a P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:35041
I20240501 08:15:13.417768 19662 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 18)
I20240501 08:15:13.417778 19762 tablet_copy_client.cc:647] T 970b2447a00f4987a437d043f0b08e79 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Starting download of 1 WAL segments...
I20240501 08:15:13.418612 19662 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 18)
I20240501 08:15:13.419085 19662 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 18)
I20240501 08:15:13.419370 19662 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
I20240501 08:15:13.419451 19671 tablet_copy_service.cc:140] P f568ec3ddce14e6898835a3e4f6a5684: Received BeginTabletCopySession request for tablet 655207067b554cf5b240476a3592e4e9 from peer 5a08cd9e624b416b99b4b0747ea41244 ({username='slave'} at 127.14.127.194:39371)
I20240501 08:15:13.419600 19671 tablet_copy_service.cc:161] P f568ec3ddce14e6898835a3e4f6a5684: Beginning new tablet copy session on tablet 655207067b554cf5b240476a3592e4e9 from peer 5a08cd9e624b416b99b4b0747ea41244 at {username='slave'} at 127.14.127.194:39371: session id = 5a08cd9e624b416b99b4b0747ea41244-655207067b554cf5b240476a3592e4e9
I20240501 08:15:13.419916 19662 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.14.127.194:39371 (request call id 32)
I20240501 08:15:13.420231 19662 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.14.127.194:39371 (request call id 32)
I20240501 08:15:13.420696 19662 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.14.127.194:39371 (request call id 34)
I20240501 08:15:13.421873 19758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9355d74bad144239e08cc19a88bd423. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:15:13.421959 19662 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 35)
I20240501 08:15:13.429260 19662 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 35)
I20240501 08:15:13.429693 19662 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 35)
I20240501 08:15:13.429955 19662 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 35)
I20240501 08:15:13.430174 19662 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 35)
I20240501 08:15:13.430498 19671 tablet_copy_source_session.cc:205] T 655207067b554cf5b240476a3592e4e9 P f568ec3ddce14e6898835a3e4f6a5684: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 08:15:13.431166 19758 tablet_copy_client.cc:783] T e9355d74bad144239e08cc19a88bd423 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Starting download of 0 data blocks...
I20240501 08:15:13.431627 19767 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 655207067b554cf5b240476a3592e4e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:15:13.431771 19758 tablet_copy_client.cc:647] T e9355d74bad144239e08cc19a88bd423 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Starting download of 1 WAL segments...
I20240501 08:15:13.434324 19662 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 35)
I20240501 08:15:13.434619 19662 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 41)
I20240501 08:15:13.434917 19662 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 41)
@ 0x7f938709fa8d kudu::tserver::TabletCopyRunnable::Run() at ??:0
I20240501 08:15:13.439055 19769 tablet_copy_client.cc:308] T 677435a8c28549a69a6c82bb53c472f1 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Beginning tablet copy session from remote peer at address 127.14.127.193:35041
I20240501 08:15:13.439159 19671 tablet_copy_service.cc:140] P f568ec3ddce14e6898835a3e4f6a5684: Received BeginTabletCopySession request for tablet 38c4ffa6eef24b99919b7b39461491d9 from peer 5a08cd9e624b416b99b4b0747ea41244 ({username='slave'} at 127.14.127.194:39371)
I20240501 08:15:13.439283 19671 tablet_copy_service.cc:161] P f568ec3ddce14e6898835a3e4f6a5684: Beginning new tablet copy session on tablet 38c4ffa6eef24b99919b7b39461491d9 from peer 5a08cd9e624b416b99b4b0747ea41244 at {username='slave'} at 127.14.127.194:39371: session id = 5a08cd9e624b416b99b4b0747ea41244-38c4ffa6eef24b99919b7b39461491d9
I20240501 08:15:13.440138 19767 tablet_copy_client.cc:783] T 655207067b554cf5b240476a3592e4e9 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Starting download of 0 data blocks...
I20240501 08:15:13.440368 19767 tablet_copy_client.cc:647] T 655207067b554cf5b240476a3592e4e9 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Starting download of 1 WAL segments...
I20240501 08:15:13.441479 19671 tablet_copy_source_session.cc:205] T 38c4ffa6eef24b99919b7b39461491d9 P f568ec3ddce14e6898835a3e4f6a5684: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 08:15:13.442660 19662 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 43)
I20240501 08:15:13.442888 19772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38c4ffa6eef24b99919b7b39461491d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:15:13.444993 19662 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 43)
I20240501 08:15:13.446813 19662 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 43)
I20240501 08:15:13.447126 19772 tablet_copy_client.cc:783] T 38c4ffa6eef24b99919b7b39461491d9 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Starting download of 0 data blocks...
I20240501 08:15:13.447330 19772 tablet_copy_client.cc:647] T 38c4ffa6eef24b99919b7b39461491d9 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Starting download of 1 WAL segments...
I20240501 08:15:13.448406 19662 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 43)
I20240501 08:15:13.449988 19662 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 43)
@ 0x7f9387082981 kudu::tserver::TSTabletManager::StartTabletCopy()::$_12::operator()() at ??:0
I20240501 08:15:13.452555 19662 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 43)
I20240501 08:15:13.455332 19662 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
I20240501 08:15:13.455406 19671 tablet_copy_service.cc:140] P f568ec3ddce14e6898835a3e4f6a5684: Received BeginTabletCopySession request for tablet 677435a8c28549a69a6c82bb53c472f1 from peer 5a08cd9e624b416b99b4b0747ea41244 ({username='slave'} at 127.14.127.194:39371)
I20240501 08:15:13.455570 19671 tablet_copy_service.cc:161] P f568ec3ddce14e6898835a3e4f6a5684: Beginning new tablet copy session on tablet 677435a8c28549a69a6c82bb53c472f1 from peer 5a08cd9e624b416b99b4b0747ea41244 at {username='slave'} at 127.14.127.194:39371: session id = 5a08cd9e624b416b99b4b0747ea41244-677435a8c28549a69a6c82bb53c472f1
I20240501 08:15:13.458411 19671 tablet_copy_source_session.cc:205] T 677435a8c28549a69a6c82bb53c472f1 P f568ec3ddce14e6898835a3e4f6a5684: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 08:15:13.459326 19662 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 52)
I20240501 08:15:13.459627 19662 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 54)
@ 0x7f938708270e std::_Function_handler<>::_M_invoke() at ??:0
I20240501 08:15:13.462392 19769 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 677435a8c28549a69a6c82bb53c472f1. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0xa60bcd std::function<>::operator()() at ??:?
@ 0x7f9377adbb75 kudu::ThreadPool::DispatchThread() at ??:0
I20240501 08:15:13.469722 19662 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 55)
I20240501 08:15:13.469820 19769 tablet_copy_client.cc:783] T 677435a8c28549a69a6c82bb53c472f1 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Starting download of 0 data blocks...
I20240501 08:15:13.470062 19769 tablet_copy_client.cc:647] T 677435a8c28549a69a6c82bb53c472f1 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Starting download of 1 WAL segments...
I20240501 08:15:13.470268 19662 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 55)
I20240501 08:15:13.471077 19662 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 55)
I20240501 08:15:13.471344 19662 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 55)
I20240501 08:15:13.471596 19662 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 55)
I20240501 08:15:13.471817 19671 tablet_copy_service.cc:140] P f568ec3ddce14e6898835a3e4f6a5684: Received BeginTabletCopySession request for tablet 4825c2e7956549ac8b66b56cd39124c2 from peer 5a08cd9e624b416b99b4b0747ea41244 ({username='slave'} at 127.14.127.194:39371)
I20240501 08:15:13.471904 19671 tablet_copy_service.cc:161] P f568ec3ddce14e6898835a3e4f6a5684: Beginning new tablet copy session on tablet 4825c2e7956549ac8b66b56cd39124c2 from peer 5a08cd9e624b416b99b4b0747ea41244 at {username='slave'} at 127.14.127.194:39371: session id = 5a08cd9e624b416b99b4b0747ea41244-4825c2e7956549ac8b66b56cd39124c2
I20240501 08:15:13.473480 19762 tablet_copy_client.cc:523] T 970b2447a00f4987a437d043f0b08e79 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 08:15:13.474099 19662 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 55)
I20240501 08:15:13.474210 19671 tablet_copy_source_session.cc:205] T 4825c2e7956549ac8b66b56cd39124c2 P f568ec3ddce14e6898835a3e4f6a5684: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 08:15:13.474802 19662 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
I20240501 08:15:13.474570 19671 tablet_copy_service.cc:140] P f568ec3ddce14e6898835a3e4f6a5684: Received BeginTabletCopySession request for tablet b7228c892fc640f4ab585a67b77f5f12 from peer 5a08cd9e624b416b99b4b0747ea41244 ({username='slave'} at 127.14.127.194:39371)
I20240501 08:15:13.475836 19671 tablet_copy_service.cc:161] P f568ec3ddce14e6898835a3e4f6a5684: Beginning new tablet copy session on tablet b7228c892fc640f4ab585a67b77f5f12 from peer 5a08cd9e624b416b99b4b0747ea41244 at {username='slave'} at 127.14.127.194:39371: session id = 5a08cd9e624b416b99b4b0747ea41244-b7228c892fc640f4ab585a67b77f5f12
I20240501 08:15:13.477449 19762 tablet_bootstrap.cc:492] T 970b2447a00f4987a437d043f0b08e79 P 5a08cd9e624b416b99b4b0747ea41244: Bootstrap starting.
I20240501 08:15:13.479585 19756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4825c2e7956549ac8b66b56cd39124c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:15:13.485128 19756 tablet_copy_client.cc:783] T 4825c2e7956549ac8b66b56cd39124c2 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Starting download of 0 data blocks...
I20240501 08:15:13.485334 19756 tablet_copy_client.cc:647] T 4825c2e7956549ac8b66b56cd39124c2 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Starting download of 1 WAL segments...
I20240501 08:15:13.486320 19662 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.14.127.194:39371 (request call id 63)
I20240501 08:15:13.488817 19662 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.14.127.194:39371 (request call id 65)
I20240501 08:15:13.489099 19671 tablet_copy_source_session.cc:205] T b7228c892fc640f4ab585a67b77f5f12 P f568ec3ddce14e6898835a3e4f6a5684: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 08:15:13.490890 19770 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7228c892fc640f4ab585a67b77f5f12. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:15:13.490898 19767 tablet_copy_client.cc:523] T 655207067b554cf5b240476a3592e4e9 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Tablet Copy complete. Replacing tablet superblock.
@ 0x7f9377adf19c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
I20240501 08:15:13.494390 19767 tablet_bootstrap.cc:492] T 655207067b554cf5b240476a3592e4e9 P 5a08cd9e624b416b99b4b0747ea41244: Bootstrap starting.
I20240501 08:15:13.495564 19756 tablet_copy_client.cc:523] T 4825c2e7956549ac8b66b56cd39124c2 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Tablet Copy complete. Replacing tablet superblock.
@ 0x7f9377adf019 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xa60bcd std::function<>::operator()() at ??:?
I20240501 08:15:13.503643 19770 tablet_copy_client.cc:783] T b7228c892fc640f4ab585a67b77f5f12 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Starting download of 0 data blocks...
I20240501 08:15:13.504331 19770 tablet_copy_client.cc:647] T b7228c892fc640f4ab585a67b77f5f12 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Starting download of 1 WAL segments...
I20240501 08:15:13.505095 19756 tablet_bootstrap.cc:492] T 4825c2e7956549ac8b66b56cd39124c2 P 5a08cd9e624b416b99b4b0747ea41244: Bootstrap starting.
I20240501 08:15:13.527951 19662 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.14.127.194:39371 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.14.127.194:39371 (request call id 72)
I20240501 08:15:13.527983 19772 tablet_copy_client.cc:523] T 38c4ffa6eef24b99919b7b39461491d9 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 08:15:13.528311 19757 tablet_copy_client.cc:523] T b4d3311e1aa24d3281104e3c35c97201 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 08:15:13.528784 19671 tablet_copy_service.cc:140] P f568ec3ddce14e6898835a3e4f6a5684: Received BeginTabletCopySession request for tablet a8c6a68ee86b4a239bfac6b52a8a45ca from peer 5a08cd9e624b416b99b4b0747ea41244 ({username='slave'} at 127.14.127.194:39371)
I20240501 08:15:13.528934 19671 tablet_copy_service.cc:161] P f568ec3ddce14e6898835a3e4f6a5684: Beginning new tablet copy session on tablet a8c6a68ee86b4a239bfac6b52a8a45ca from peer 5a08cd9e624b416b99b4b0747ea41244 at {username='slave'} at 127.14.127.194:39371: session id = 5a08cd9e624b416b99b4b0747ea41244-a8c6a68ee86b4a239bfac6b52a8a45ca
I20240501 08:15:13.531450 19757 tablet_bootstrap.cc:492] T b4d3311e1aa24d3281104e3c35c97201 P 5a08cd9e624b416b99b4b0747ea41244: Bootstrap starting.
I20240501 08:15:13.531524 19772 tablet_bootstrap.cc:492] T 38c4ffa6eef24b99919b7b39461491d9 P 5a08cd9e624b416b99b4b0747ea41244: Bootstrap starting.
I20240501 08:15:13.534207 19671 tablet_copy_source_session.cc:205] T a8c6a68ee86b4a239bfac6b52a8a45ca P f568ec3ddce14e6898835a3e4f6a5684: Tablet Copy: opened 0 blocks and 1 log segments
@ 0x7f9377aba01e kudu::Thread::SuperviseThread() at ??:0
I20240501 08:15:13.536620 19770 tablet_copy_client.cc:523] T b7228c892fc640f4ab585a67b77f5f12 P 5a08cd9e624b416b99b4b0747ea41244: tablet copy: Tablet Copy complete. Replacing tablet superblock.
@ 0x7f937ae3f6db start_thread at ??:0
I20240501 08:15:13.539832 19770 tablet_bootstrap.cc:492] T b7228c892fc640f4ab585a67b77f5f12 P 5a08cd9e624b416b99b4b0747ea41244: Bootstrap starting.
@ 0x7f9373c7d71f clone at ??:0
W20240501 08:15:13.775606 19662 connection.cc:535] server connection from 127.14.127.194:39371 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20240501 08:15:13.776033 18936 connection.cc:535] client connection to 127.14.127.194:45405 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
F20240501 08:15:13.776607 19754 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
F20240501 08:15:13.776690 19734 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240501 08:15:13.776870 19735 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240501 08:15:13.776964 19753 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: F202405Networ15error: recv error from unknown peer: Transport endpoint is not connected (error 107) :13.777052 19751 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240501 08:15:13.777149 19736 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240501 08:15:13.777292 19748 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
*** Check failure stack trace: ***
F20240501 08:15:13.776690 19734 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240501 08:15:13.776870 19735 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240501 08:15:13.776964 19753 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: F202405Networ15error: recv error from unknown peer: Transport endpoint is not connected (error 107) :13.777052 19751 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240501 08:15:13.777149 19736 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240501 08:15:13.777292 19748 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
*** Aborted at 1714551313 (unix time) try "date -d @1714551313" if you are using GNU date ***
F20240501 08:15:13.776690 19734 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240501 08:15:13.776870 19735 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240501 08:15:13.776964 19753 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: F202405Networ15error: recv error from unknown peer: Transport endpoint is not connected (error 107) :13.777052 19751 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240501 08:15:13.777149 19736 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240501 08:15:13.777292 19748 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
*** Check failure stack trace: ***
*** Check failure stack trace: ***
*** Check failure stack trace: ***
F20240501 08:15:13.776690 19734 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240501 08:15:13.776870 19735 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240501 08:15:13.776964 19753 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: F202405Networ15error: recv error from unknown peer: Transport endpoint is not connected (error 107) :13.777052 19751 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240501 08:15:13.777149 19736 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240501 08:15:13.777292 19748 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240501 08:15:13.777441 19750 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e8000039ff) received by PID 14847 (TID 0x7f7dc9ea3700) from PID 14847; stack trace: ***
@ 0x7f7ddcf3a980 (unknown) at ??:0
@ 0x7f7dd5fe5fb7 gsignal at ??:0
@ 0x7f7dd5fe7921 abort at ??:0
@ 0x7f7dd8d0edcd google::LogMessage::Fail() at ??:0
@ 0x7f7dd8d12b93 google::LogMessage::SendToLog() at ??:0
@ 0x7f7dd8d0e7cc google::LogMessage::Flush() at ??:0
@ 0x7f7dd8d0ff59 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x3b9874 kudu::TabletCopyClientSessionITest_TestTabletCopyWithBusySource_Test::TestBody()::$_3::operator()() at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/tablet_copy_client_session-itest.cc:313
@ 0x3b926e std::__invoke_impl<>() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/invoke.h:60
@ 0x3b91ee std::__invoke<>() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/invoke.h:95
@ 0x3b91b3 _ZNSt6thread8_InvokerISt5tupleIJZN4kudu62TabletCopyClientSessionITest_TestTabletCopyWithBusySource_Test8TestBodyEvE3$_3EEE9_M_invokeIJLm0EEEEDTclsr3stdE8__invokespcl10_S_declvalIXT_EEEEESt12_Index_tupleIJXspT_EEE at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:234
@ 0x3b917e std::thread::_Invoker<>::operator()() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:243
@ 0x3b9069 std::thread::_State_impl<>::_M_run() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:186
@ 0x7f7dd666f6df (unknown) at ??:0
@ 0x7f7ddcf2f6db start_thread at ??:0
@ 0x7f7dd60c871f clone at ??:0