[==========] Running 5 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 5 tests from TabletCopyClientSessionITest
[ RUN ] TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping
2024-05-01T14:03:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-01T14:03:44Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20240501 14:03:44.639072 30620 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
/tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.231.62:36819
--webserver_interface=127.29.231.62
--webserver_port=0
--builtin_ntp_servers=127.29.231.20:34843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.231.62:36819
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240501 14:03:44.964298 30628 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 14:03:44.964632 30628 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 14:03:44.964776 30628 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 14:03:44.972317 30628 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240501 14:03:44.972438 30628 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 14:03:44.972520 30628 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240501 14:03:44.972608 30628 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240501 14:03:44.981931 30628 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.231.20:34843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.29.231.62:36819
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.231.62:36819
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.231.62
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 13:43:20 UTC on efd1337a2aa3
build id 75
ASAN enabled
I20240501 14:03:44.983374 30628 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 14:03:44.985160 30628 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:03:44.996738 30633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:03:44.997156 30634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:03:44.997642 30636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:03:44.998334 30628 server_base.cc:1034] running on GCE node
I20240501 14:03:44.999104 30628 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 14:03:45.000613 30628 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 14:03:45.001830 30628 hybrid_clock.cc:648] HybridClock initialized: now 1714572225001773 us; error 32 us; skew 500 ppm
I20240501 14:03:45.002171 30628 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:03:45.007850 30628 webserver.cc:460] Webserver started at http://127.29.231.62:40707/ using document root <none> and password file <none>
I20240501 14:03:45.008683 30628 fs_manager.cc:359] Metadata directory not provided
I20240501 14:03:45.008827 30628 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:03:45.009146 30628 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 14:03:45.011793 30628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/master-0/data/instance:
uuid: "7dd9f8218862431683fdb2c6110df2f3"
format_stamp: "Formatted at 2024-05-01 14:03:45 on dist-test-slave-4827"
I20240501 14:03:45.012605 30628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/master-0/wal/instance:
uuid: "7dd9f8218862431683fdb2c6110df2f3"
format_stamp: "Formatted at 2024-05-01 14:03:45 on dist-test-slave-4827"
I20240501 14:03:45.017817 30628 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20240501 14:03:45.021162 30642 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:03:45.022441 30628 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20240501 14:03:45.022601 30628 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/master-0/data,/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/master-0/wal
uuid: "7dd9f8218862431683fdb2c6110df2f3"
format_stamp: "Formatted at 2024-05-01 14:03:45 on dist-test-slave-4827"
I20240501 14:03:45.022774 30628 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:03:45.045387 30628 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:03:45.046244 30628 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 14:03:45.046531 30628 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:03:45.064041 30628 rpc_server.cc:307] RPC server started. Bound to: 127.29.231.62:36819
I20240501 14:03:45.064072 30693 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.231.62:36819 every 8 connection(s)
I20240501 14:03:45.065510 30628 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/master-0/data/info.pb
I20240501 14:03:45.069211 30694 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:03:45.074642 30620 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu as pid 30628
I20240501 14:03:45.074891 30620 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/master-0/wal/instance
I20240501 14:03:45.078297 30694 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3: Bootstrap starting.
I20240501 14:03:45.082315 30694 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3: Neither blocks nor log segments found. Creating new log.
I20240501 14:03:45.083317 30694 log.cc:824] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3: Log is configured to *not* fsync() on all Append() calls
I20240501 14:03:45.085830 30694 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3: No bootstrap required, opened a new log
I20240501 14:03:45.092605 30694 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dd9f8218862431683fdb2c6110df2f3" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 36819 } }
I20240501 14:03:45.092989 30694 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:03:45.093142 30694 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dd9f8218862431683fdb2c6110df2f3, State: Initialized, Role: FOLLOWER
I20240501 14:03:45.093760 30694 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dd9f8218862431683fdb2c6110df2f3" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 36819 } }
I20240501 14:03:45.093964 30694 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:03:45.094084 30694 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:03:45.094233 30694 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:03:45.097263 30694 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dd9f8218862431683fdb2c6110df2f3" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 36819 } }
I20240501 14:03:45.097723 30694 leader_election.cc:302] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7dd9f8218862431683fdb2c6110df2f3; no voters:
I20240501 14:03:45.098471 30694 leader_election.cc:288] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 14:03:45.098722 30699 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:03:45.100431 30699 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3 [term 1 LEADER]: Becoming Leader. State: Replica: 7dd9f8218862431683fdb2c6110df2f3, State: Running, Role: LEADER
I20240501 14:03:45.100688 30694 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3 [sys.catalog]: configured and running, proceeding with master startup.
I20240501 14:03:45.100998 30699 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dd9f8218862431683fdb2c6110df2f3" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 36819 } }
I20240501 14:03:45.104750 30700 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7dd9f8218862431683fdb2c6110df2f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dd9f8218862431683fdb2c6110df2f3" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 36819 } } }
I20240501 14:03:45.105087 30700 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3 [sys.catalog]: This master's current role is: LEADER
I20240501 14:03:45.105489 30701 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7dd9f8218862431683fdb2c6110df2f3. Latest consensus state: current_term: 1 leader_uuid: "7dd9f8218862431683fdb2c6110df2f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dd9f8218862431683fdb2c6110df2f3" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 36819 } } }
I20240501 14:03:45.105767 30701 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3 [sys.catalog]: This master's current role is: LEADER
I20240501 14:03:45.109916 30705 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240501 14:03:45.117434 30705 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240501 14:03:45.127383 30705 catalog_manager.cc:1347] Generated new cluster ID: e701ffdd24bb4fc1b2499c1e06e93191
I20240501 14:03:45.127533 30705 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240501 14:03:45.140748 30705 catalog_manager.cc:1370] Generated new certificate authority record
I20240501 14:03:45.141968 30705 catalog_manager.cc:1504] Loading token signing keys...
I20240501 14:03:45.156646 30705 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3: Generated new TSK 0
I20240501 14:03:45.157836 30705 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240501 14:03:45.172381 30620 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
/tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.231.1:0
--local_ip_for_outbound_sockets=127.29.231.1
--webserver_interface=127.29.231.1
--webserver_port=0
--tserver_master_addrs=127.29.231.62:36819
--builtin_ntp_servers=127.29.231.20:34843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240501 14:03:45.497211 30719 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 14:03:45.497502 30719 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 14:03:45.497648 30719 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 14:03:45.505244 30719 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 14:03:45.505465 30719 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.231.1
I20240501 14:03:45.514717 30719 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.231.20:34843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.231.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.231.1
--webserver_port=0
--tserver_master_addrs=127.29.231.62:36819
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.231.1
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 13:43:20 UTC on efd1337a2aa3
build id 75
ASAN enabled
I20240501 14:03:45.516136 30719 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 14:03:45.517980 30719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:03:45.530540 30725 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:03:45.531044 30724 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:03:45.531497 30727 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:03:45.532145 30719 server_base.cc:1034] running on GCE node
I20240501 14:03:45.532748 30719 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 14:03:45.533648 30719 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 14:03:45.534871 30719 hybrid_clock.cc:648] HybridClock initialized: now 1714572225534799 us; error 43 us; skew 500 ppm
I20240501 14:03:45.535178 30719 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:03:45.537438 30719 webserver.cc:460] Webserver started at http://127.29.231.1:33931/ using document root <none> and password file <none>
I20240501 14:03:45.538197 30719 fs_manager.cc:359] Metadata directory not provided
I20240501 14:03:45.538324 30719 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:03:45.538601 30719 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 14:03:45.541225 30719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/data/instance:
uuid: "7ed2b79aff844eb39968f24d7f6ab7c2"
format_stamp: "Formatted at 2024-05-01 14:03:45 on dist-test-slave-4827"
I20240501 14:03:45.541950 30719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/wal/instance:
uuid: "7ed2b79aff844eb39968f24d7f6ab7c2"
format_stamp: "Formatted at 2024-05-01 14:03:45 on dist-test-slave-4827"
I20240501 14:03:45.547008 30719 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20240501 14:03:45.550460 30733 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:03:45.551755 30719 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20240501 14:03:45.551908 30719 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/wal
uuid: "7ed2b79aff844eb39968f24d7f6ab7c2"
format_stamp: "Formatted at 2024-05-01 14:03:45 on dist-test-slave-4827"
I20240501 14:03:45.552093 30719 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:03:45.571923 30719 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:03:45.572770 30719 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 14:03:45.573058 30719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:03:45.573956 30719 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 14:03:45.575453 30719 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 14:03:45.575532 30719 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 14:03:45.575665 30719 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 14:03:45.575718 30719 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 14:03:45.607015 30719 rpc_server.cc:307] RPC server started. Bound to: 127.29.231.1:37211
I20240501 14:03:45.607072 30845 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.231.1:37211 every 8 connection(s)
I20240501 14:03:45.608377 30719 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/data/info.pb
I20240501 14:03:45.608919 30620 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu as pid 30719
I20240501 14:03:45.609122 30620 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/wal/instance
I20240501 14:03:45.613021 30620 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
/tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.231.2:0
--local_ip_for_outbound_sockets=127.29.231.2
--webserver_interface=127.29.231.2
--webserver_port=0
--tserver_master_addrs=127.29.231.62:36819
--builtin_ntp_servers=127.29.231.20:34843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240501 14:03:45.628298 30846 heartbeater.cc:347] Connected to a master server at 127.29.231.62:36819
I20240501 14:03:45.628610 30846 heartbeater.cc:464] Registering TS with master...
I20240501 14:03:45.629426 30846 heartbeater.cc:511] Master 127.29.231.62:36819 requested a full tablet report, sending...
I20240501 14:03:45.631500 30659 ts_manager.cc:194] Registered new tserver with Master: 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:45.633087 30659 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.231.1:57277
W20240501 14:03:45.935663 30850 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 14:03:45.935990 30850 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 14:03:45.936131 30850 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 14:03:45.943614 30850 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 14:03:45.943830 30850 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.231.2
I20240501 14:03:45.953157 30850 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.231.20:34843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.231.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.231.2
--webserver_port=0
--tserver_master_addrs=127.29.231.62:36819
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.231.2
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 13:43:20 UTC on efd1337a2aa3
build id 75
ASAN enabled
I20240501 14:03:45.954520 30850 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 14:03:45.956329 30850 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:03:45.968827 30856 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:03:45.969472 30850 server_base.cc:1034] running on GCE node
W20240501 14:03:45.970003 30855 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:03:45.970500 30858 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:03:45.971154 30850 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 14:03:45.972088 30850 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 14:03:45.973297 30850 hybrid_clock.cc:648] HybridClock initialized: now 1714572225973232 us; error 42 us; skew 500 ppm
I20240501 14:03:45.973599 30850 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:03:45.975831 30850 webserver.cc:460] Webserver started at http://127.29.231.2:44439/ using document root <none> and password file <none>
I20240501 14:03:45.976603 30850 fs_manager.cc:359] Metadata directory not provided
I20240501 14:03:45.976733 30850 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:03:45.977021 30850 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 14:03:45.980571 30850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data/instance:
uuid: "b6f6ebcca5034c4183eb4a6f3f8891ec"
format_stamp: "Formatted at 2024-05-01 14:03:45 on dist-test-slave-4827"
I20240501 14:03:45.981981 30850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/wal/instance:
uuid: "b6f6ebcca5034c4183eb4a6f3f8891ec"
format_stamp: "Formatted at 2024-05-01 14:03:45 on dist-test-slave-4827"
I20240501 14:03:45.987555 30850 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20240501 14:03:45.990936 30864 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:03:45.992200 30850 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20240501 14:03:45.992411 30850 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/wal
uuid: "b6f6ebcca5034c4183eb4a6f3f8891ec"
format_stamp: "Formatted at 2024-05-01 14:03:45 on dist-test-slave-4827"
I20240501 14:03:45.992575 30850 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:03:46.009788 30850 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:03:46.010915 30850 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 14:03:46.011247 30850 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:03:46.012415 30850 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 14:03:46.013898 30850 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 14:03:46.013978 30850 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 14:03:46.014103 30850 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 14:03:46.014156 30850 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 14:03:46.044983 30850 rpc_server.cc:307] RPC server started. Bound to: 127.29.231.2:39057
I20240501 14:03:46.045017 30976 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.231.2:39057 every 8 connection(s)
I20240501 14:03:46.046258 30850 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data/info.pb
I20240501 14:03:46.049571 30620 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu as pid 30850
I20240501 14:03:46.049794 30620 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/wal/instance
I20240501 14:03:46.058610 30977 heartbeater.cc:347] Connected to a master server at 127.29.231.62:36819
I20240501 14:03:46.058918 30977 heartbeater.cc:464] Registering TS with master...
I20240501 14:03:46.060334 30977 heartbeater.cc:511] Master 127.29.231.62:36819 requested a full tablet report, sending...
I20240501 14:03:46.061692 30659 ts_manager.cc:194] Registered new tserver with Master: b6f6ebcca5034c4183eb4a6f3f8891ec (127.29.231.2:39057)
I20240501 14:03:46.062469 30659 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.231.2:38217
I20240501 14:03:46.065775 30620 external_mini_cluster.cc:930] 2 TS(s) registered with all masters
I20240501 14:03:46.083995 30620 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu pid 30850
I20240501 14:03:46.091914 30972 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 14:03:46.172581 30620 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu with pid 30850
I20240501 14:03:46.191434 30620 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu pid 30628
I20240501 14:03:46.192621 30689 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 14:03:46.292860 30620 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu with pid 30628
I20240501 14:03:46.315809 30620 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
/tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.231.62:36819
--webserver_interface=127.29.231.62
--webserver_port=40707
--builtin_ntp_servers=127.29.231.20:34843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.231.62:36819
--master_tombstone_evicted_tablet_replicas=false with env {}
I20240501 14:03:46.635993 30846 heartbeater.cc:503] Master 127.29.231.62:36819 was elected leader, sending a full tablet report...
W20240501 14:03:46.637573 30846 heartbeater.cc:644] Failed to heartbeat to 127.29.231.62:36819 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.29.231.62:36819: connect: Connection refused (error 111)
W20240501 14:03:46.638231 30989 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 14:03:46.638558 30989 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 14:03:46.638689 30989 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 14:03:46.646397 30989 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240501 14:03:46.646529 30989 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 14:03:46.646612 30989 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240501 14:03:46.646688 30989 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240501 14:03:46.656127 30989 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.231.20:34843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.29.231.62:36819
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.231.62:36819
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.231.62
--webserver_port=40707
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 13:43:20 UTC on efd1337a2aa3
build id 75
ASAN enabled
I20240501 14:03:46.657685 30989 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 14:03:46.659556 30989 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:03:46.671191 30998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:03:46.671654 30996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:03:46.672128 30995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:03:46.672763 30989 server_base.cc:1034] running on GCE node
I20240501 14:03:46.673568 30989 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 14:03:46.674942 30989 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 14:03:46.676154 30989 hybrid_clock.cc:648] HybridClock initialized: now 1714572226676080 us; error 45 us; skew 500 ppm
I20240501 14:03:46.676491 30989 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:03:46.678776 30989 webserver.cc:460] Webserver started at http://127.29.231.62:40707/ using document root <none> and password file <none>
I20240501 14:03:46.679502 30989 fs_manager.cc:359] Metadata directory not provided
I20240501 14:03:46.679646 30989 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:03:46.685025 30989 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20240501 14:03:46.687884 31004 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:03:46.689185 30989 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20240501 14:03:46.689335 30989 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/master-0/data,/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/master-0/wal
uuid: "7dd9f8218862431683fdb2c6110df2f3"
format_stamp: "Formatted at 2024-05-01 14:03:45 on dist-test-slave-4827"
I20240501 14:03:46.690176 30989 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:03:46.711210 30989 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:03:46.712074 30989 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 14:03:46.712384 30989 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:03:46.730201 30989 rpc_server.cc:307] RPC server started. Bound to: 127.29.231.62:36819
I20240501 14:03:46.730207 31055 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.231.62:36819 every 8 connection(s)
I20240501 14:03:46.731686 30989 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/master-0/data/info.pb
I20240501 14:03:46.737918 31056 sys_catalog.cc:263] Verifying existing consensus state
I20240501 14:03:46.740942 31056 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3: Bootstrap starting.
I20240501 14:03:46.742167 30620 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu as pid 30989
I20240501 14:03:46.757817 31056 log.cc:824] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3: Log is configured to *not* fsync() on all Append() calls
I20240501 14:03:46.765578 31056 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:03:46.766041 31056 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3: Bootstrap complete.
I20240501 14:03:46.773228 31056 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dd9f8218862431683fdb2c6110df2f3" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 36819 } }
I20240501 14:03:46.773942 31056 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dd9f8218862431683fdb2c6110df2f3, State: Initialized, Role: FOLLOWER
I20240501 14:03:46.774508 31056 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dd9f8218862431683fdb2c6110df2f3" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 36819 } }
I20240501 14:03:46.774694 31056 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:03:46.774770 31056 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:03:46.774896 31056 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:03:46.778331 31056 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dd9f8218862431683fdb2c6110df2f3" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 36819 } }
I20240501 14:03:46.778753 31056 leader_election.cc:302] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7dd9f8218862431683fdb2c6110df2f3; no voters:
I20240501 14:03:46.779270 31056 leader_election.cc:288] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 14:03:46.779443 31061 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:03:46.780334 31061 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3 [term 2 LEADER]: Becoming Leader. State: Replica: 7dd9f8218862431683fdb2c6110df2f3, State: Running, Role: LEADER
I20240501 14:03:46.780903 31061 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dd9f8218862431683fdb2c6110df2f3" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 36819 } }
I20240501 14:03:46.781558 31056 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3 [sys.catalog]: configured and running, proceeding with master startup.
I20240501 14:03:46.783392 31063 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7dd9f8218862431683fdb2c6110df2f3. Latest consensus state: current_term: 2 leader_uuid: "7dd9f8218862431683fdb2c6110df2f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dd9f8218862431683fdb2c6110df2f3" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 36819 } } }
I20240501 14:03:46.783705 31063 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3 [sys.catalog]: This master's current role is: LEADER
I20240501 14:03:46.783782 31062 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "7dd9f8218862431683fdb2c6110df2f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dd9f8218862431683fdb2c6110df2f3" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 36819 } } }
I20240501 14:03:46.784148 31062 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3 [sys.catalog]: This master's current role is: LEADER
I20240501 14:03:46.785959 31068 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240501 14:03:46.791412 31068 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240501 14:03:46.793731 31068 catalog_manager.cc:1259] Loaded cluster ID: e701ffdd24bb4fc1b2499c1e06e93191
I20240501 14:03:46.793963 31068 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240501 14:03:46.798069 31068 catalog_manager.cc:1504] Loading token signing keys...
I20240501 14:03:46.799623 31068 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7dd9f8218862431683fdb2c6110df2f3: Loaded TSK: 0
I20240501 14:03:46.801496 31068 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240501 14:03:47.644176 30846 heartbeater.cc:347] Connected to a master server at 127.29.231.62:36819
I20240501 14:03:47.644410 30846 heartbeater.cc:503] Master 127.29.231.62:36819 was elected leader, sending a full tablet report...
I20240501 14:03:47.646365 31021 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "7ed2b79aff844eb39968f24d7f6ab7c2" instance_seqno: 1714572225599320) as {username='slave'} at 127.29.231.1:43239; Asking this server to re-register.
I20240501 14:03:47.647019 30846 heartbeater.cc:464] Registering TS with master...
I20240501 14:03:47.647269 30846 heartbeater.cc:511] Master 127.29.231.62:36819 requested a full tablet report, sending...
I20240501 14:03:47.648496 31021 ts_manager.cc:194] Registered new tserver with Master: 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:47.657967 30620 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20240501 14:03:47.658260 30620 test_util.cc:268] Using random seed: -191741454
I20240501 14:03:47.683699 31021 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51762:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20240501 14:03:47.706259 30781 tablet_service.cc:1467] Processing CreateTablet for tablet 639baa1976b54dd7a9968c285f78b7eb (DEFAULT_TABLE table=test-workload [id=23f92bae23f443ebbb7d73c10ed861f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20240501 14:03:47.707512 30781 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 639baa1976b54dd7a9968c285f78b7eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:03:47.717381 31091 tablet_bootstrap.cc:492] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2: Bootstrap starting.
I20240501 14:03:47.720367 31091 tablet_bootstrap.cc:654] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2: Neither blocks nor log segments found. Creating new log.
I20240501 14:03:47.721345 31091 log.cc:824] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2: Log is configured to *not* fsync() on all Append() calls
I20240501 14:03:47.723685 31091 tablet_bootstrap.cc:492] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2: No bootstrap required, opened a new log
I20240501 14:03:47.723901 31091 ts_tablet_manager.cc:1367] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20240501 14:03:47.729848 31091 raft_consensus.cc:348] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed2b79aff844eb39968f24d7f6ab7c2" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 37211 } }
I20240501 14:03:47.730194 31091 raft_consensus.cc:374] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:03:47.730295 31091 raft_consensus.cc:729] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ed2b79aff844eb39968f24d7f6ab7c2, State: Initialized, Role: FOLLOWER
I20240501 14:03:47.730933 31091 consensus_queue.cc:260] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed2b79aff844eb39968f24d7f6ab7c2" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 37211 } }
I20240501 14:03:47.731119 31091 raft_consensus.cc:388] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:03:47.731252 31091 raft_consensus.cc:482] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:03:47.731401 31091 raft_consensus.cc:3037] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:03:47.733348 31091 raft_consensus.cc:504] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed2b79aff844eb39968f24d7f6ab7c2" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 37211 } }
I20240501 14:03:47.733806 31091 leader_election.cc:302] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ed2b79aff844eb39968f24d7f6ab7c2; no voters:
I20240501 14:03:47.734407 31091 leader_election.cc:288] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 14:03:47.734588 31093 raft_consensus.cc:2781] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:03:47.737636 31091 ts_tablet_manager.cc:1398] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2: Time spent starting tablet: real 0.014s user 0.012s sys 0.002s
I20240501 14:03:47.737854 31093 raft_consensus.cc:686] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [term 1 LEADER]: Becoming Leader. State: Replica: 7ed2b79aff844eb39968f24d7f6ab7c2, State: Running, Role: LEADER
I20240501 14:03:47.738327 31093 consensus_queue.cc:237] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed2b79aff844eb39968f24d7f6ab7c2" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 37211 } }
I20240501 14:03:47.743762 31021 catalog_manager.cc:5484] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1). New cstate: current_term: 1 leader_uuid: "7ed2b79aff844eb39968f24d7f6ab7c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed2b79aff844eb39968f24d7f6ab7c2" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 37211 } health_report { overall_health: HEALTHY } } }
I20240501 14:03:48.381218 30620 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
/tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.231.2:39057
--local_ip_for_outbound_sockets=127.29.231.2
--tserver_master_addrs=127.29.231.62:36819
--webserver_port=44439
--webserver_interface=127.29.231.2
--builtin_ntp_servers=127.29.231.20:34843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240501 14:03:48.699934 31109 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 14:03:48.700243 31109 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 14:03:48.700384 31109 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 14:03:48.707830 31109 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 14:03:48.708032 31109 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.231.2
I20240501 14:03:48.717226 31109 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.231.20:34843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.231.2:39057
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.231.2
--webserver_port=44439
--tserver_master_addrs=127.29.231.62:36819
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.231.2
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 13:43:20 UTC on efd1337a2aa3
build id 75
ASAN enabled
I20240501 14:03:48.718544 31109 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 14:03:48.720309 31109 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:03:48.733000 31115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:03:48.733446 31117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:03:48.734129 31114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:03:48.735525 31109 server_base.cc:1034] running on GCE node
I20240501 14:03:48.736281 31109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 14:03:48.737411 31109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 14:03:48.738660 31109 hybrid_clock.cc:648] HybridClock initialized: now 1714572228738585 us; error 37 us; skew 500 ppm
I20240501 14:03:48.739043 31109 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:03:48.741902 31109 webserver.cc:460] Webserver started at http://127.29.231.2:44439/ using document root <none> and password file <none>
I20240501 14:03:48.742852 31109 fs_manager.cc:359] Metadata directory not provided
I20240501 14:03:48.743026 31109 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:03:48.749639 31109 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20240501 14:03:48.752553 31123 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:03:48.753825 31109 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20240501 14:03:48.753957 31109 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/wal
uuid: "b6f6ebcca5034c4183eb4a6f3f8891ec"
format_stamp: "Formatted at 2024-05-01 14:03:45 on dist-test-slave-4827"
I20240501 14:03:48.754765 31109 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:03:48.781045 31109 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:03:48.781945 31109 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 14:03:48.782253 31109 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:03:48.783222 31109 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 14:03:48.784745 31109 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 14:03:48.784828 31109 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 14:03:48.784950 31109 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 14:03:48.785017 31109 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 14:03:48.815661 31109 rpc_server.cc:307] RPC server started. Bound to: 127.29.231.2:39057
I20240501 14:03:48.815704 31235 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.231.2:39057 every 8 connection(s)
I20240501 14:03:48.817150 31109 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data/info.pb
I20240501 14:03:48.818738 30620 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu as pid 31109
I20240501 14:03:48.823576 30620 tablet_copy_client_session-itest.cc:139] Starting loop 0
I20240501 14:03:48.823736 30620 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu pid 30719
I20240501 14:03:48.824702 30841 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 14:03:48.833510 31236 heartbeater.cc:347] Connected to a master server at 127.29.231.62:36819
I20240501 14:03:48.833796 31236 heartbeater.cc:464] Registering TS with master...
I20240501 14:03:48.834569 31236 heartbeater.cc:511] Master 127.29.231.62:36819 requested a full tablet report, sending...
I20240501 14:03:48.836007 31019 ts_manager.cc:194] Registered new tserver with Master: b6f6ebcca5034c4183eb4a6f3f8891ec (127.29.231.2:39057)
I20240501 14:03:48.837123 31019 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.231.2:47955
I20240501 14:03:48.924263 30620 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu with pid 30719
I20240501 14:03:48.945477 30620 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
/tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.231.1:37211
--local_ip_for_outbound_sockets=127.29.231.1
--tserver_master_addrs=127.29.231.62:36819
--webserver_port=33931
--webserver_interface=127.29.231.1
--builtin_ntp_servers=127.29.231.20:34843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240501 14:03:48.974094 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:48.986493 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.009394 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.010660 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.012965 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.013944 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.018692 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.019794 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.029830 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.031038 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.048645 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.049899 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.059181 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.061100 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.064867 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.066694 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.071149 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.072256 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.076956 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.084590 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.100962 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.102241 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.104967 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.112594 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.117897 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.118937 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.121399 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.122501 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.125221 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.130792 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.157042 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.158273 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.161511 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.162510 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.164345 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.165361 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.200502 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.201851 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.206164 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.207316 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.209681 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.210682 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.227579 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.229368 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.232893 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.235932 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.239495 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.240664 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.251886 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.253057 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.258780 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.259918 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.278268 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.281911 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.284073 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.290220 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.292608 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.293718 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.309705 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.310781 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.313673 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.316493 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
W20240501 14:03:49.320660 31247 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 14:03:49.320955 31247 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 14:03:49.321045 31247 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20240501 14:03:49.322204 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.323257 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
W20240501 14:03:49.329674 31247 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 14:03:49.329870 31247 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.231.1
I20240501 14:03:49.333338 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.334434 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.338176 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.339265 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.341181 31247 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.231.20:34843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.231.1:37211
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.231.1
--webserver_port=33931
--tserver_master_addrs=127.29.231.62:36819
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.231.1
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 13:43:20 UTC on efd1337a2aa3
build id 75
ASAN enabled
I20240501 14:03:49.342639 31247 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 14:03:49.344399 31247 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20240501 14:03:49.347590 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.348704 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.350906 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.352521 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.359956 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
W20240501 14:03:49.360565 31403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:03:49.361438 31401 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:03:49.361723 31398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:03:49.366379 31247 server_base.cc:1034] running on GCE node
I20240501 14:03:49.367144 31247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 14:03:49.367373 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.368345 31247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 14:03:49.369772 31247 hybrid_clock.cc:648] HybridClock initialized: now 1714572229369724 us; error 30 us; skew 500 ppm
I20240501 14:03:49.370070 31247 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:03:49.372385 31247 webserver.cc:460] Webserver started at http://127.29.231.1:33931/ using document root <none> and password file <none>
I20240501 14:03:49.373147 31247 fs_manager.cc:359] Metadata directory not provided
I20240501 14:03:49.373288 31247 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:03:49.378415 31247 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.003s
I20240501 14:03:49.381199 31413 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:03:49.382572 31247 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20240501 14:03:49.382719 31247 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/wal
uuid: "7ed2b79aff844eb39968f24d7f6ab7c2"
format_stamp: "Formatted at 2024-05-01 14:03:45 on dist-test-slave-4827"
I20240501 14:03:49.383620 31247 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:03:49.399210 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.400398 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.410171 31247 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:03:49.411049 31247 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 14:03:49.411317 31247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:03:49.412478 31247 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 14:03:49.412669 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.413700 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.415056 31428 ts_tablet_manager.cc:522] Loading tablet metadata (0/1 complete)
I20240501 14:03:49.418406 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.419401 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.421203 31247 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240501 14:03:49.421340 31247 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20240501 14:03:49.421468 31247 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240501 14:03:49.424284 31247 ts_tablet_manager.cc:590] Registered 1 tablets
I20240501 14:03:49.424376 31247 ts_tablet_manager.cc:569] Time spent register tablets: real 0.003s user 0.000s sys 0.003s
I20240501 14:03:49.424790 31428 tablet_bootstrap.cc:492] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2: Bootstrap starting.
I20240501 14:03:49.427439 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.434087 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.443554 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.449684 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.453230 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.457943 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.467720 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.470541 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.474754 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.476722 31247 rpc_server.cc:307] RPC server started. Bound to: 127.29.231.1:37211
I20240501 14:03:49.476810 31556 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.231.1:37211 every 8 connection(s)
I20240501 14:03:49.477533 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.478827 31247 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/data/info.pb
I20240501 14:03:49.487710 30620 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu as pid 31247
I20240501 14:03:49.519043 31559 heartbeater.cc:347] Connected to a master server at 127.29.231.62:36819
I20240501 14:03:49.519398 31559 heartbeater.cc:464] Registering TS with master...
I20240501 14:03:49.520534 31559 heartbeater.cc:511] Master 127.29.231.62:36819 requested a full tablet report, sending...
I20240501 14:03:49.520753 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.521093 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.523150 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.523211 31019 ts_manager.cc:194] Re-registered known tserver with Master: 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.524698 31019 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.231.1:56759
I20240501 14:03:49.530536 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.531574 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.532244 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.532426 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.532593 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.535588 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.536861 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.537532 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.537675 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.537849 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.541239 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.542246 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.542881 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.543042 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.543211 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.552115 31428 log.cc:824] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2: Log is configured to *not* fsync() on all Append() calls
I20240501 14:03:49.557024 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.558384 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.559118 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.559278 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.559480 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.562083 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.563236 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.563831 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.564013 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.564244 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.583071 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.584179 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.584964 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.585148 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.585373 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.596400 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.597970 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.598644 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.598843 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.599030 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.617269 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.618695 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.619462 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.619647 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.619858 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.623153 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.624284 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.624899 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.625061 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.625255 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.629537 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.630695 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.631326 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.631450 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.631641 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.641659 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.642721 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.643421 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.643602 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.643784 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.645623 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.648551 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.649292 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.649441 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.649616 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.663986 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.665194 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.665887 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.666085 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.666278 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.667687 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.680522 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.681218 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.681385 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.681596 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.692467 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.693593 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.694295 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.694489 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.694693 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.701264 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.702497 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.703218 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.703388 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.703579 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.706674 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.707687 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.708326 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.708508 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.708691 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.721992 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.723076 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.723757 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.723939 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.724141 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.728269 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.735553 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.736255 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.736449 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.736667 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.755687 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.760704 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.761399 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.761574 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.761775 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.767256 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.768323 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.768929 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.769114 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.769325 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.776469 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.777590 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.778216 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.778385 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.778579 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.780529 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.781607 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.782238 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.782413 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.782582 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.784657 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.785670 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.786311 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.786466 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.786659 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.798821 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.799978 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.800654 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.800822 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.800998 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.825733 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.827642 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.828368 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.828509 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.828701 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.831918 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.839772 31236 heartbeater.cc:503] Master 127.29.231.62:36819 was elected leader, sending a full tablet report...
I20240501 14:03:49.840844 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.841478 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.841665 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.841861 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.844054 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.845221 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.845868 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.846017 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.846215 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.856154 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.857551 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.858253 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.858443 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.858654 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.866755 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.867846 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.868543 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.868705 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.868896 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.890336 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.891922 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.892613 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.892796 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.892977 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.897337 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.898599 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.899228 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.899366 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.899542 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.922336 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.923542 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.924198 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.924407 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.924592 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.928961 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.930128 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.930797 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.930943 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.931154 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.936683 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.942170 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.942823 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.942988 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.943176 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.967290 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.968559 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.969502 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.969681 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.969875 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.974462 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.975690 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.976331 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.976516 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.976703 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.979682 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.980819 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.981454 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.981627 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.981856 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.988090 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:49.989185 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:49.989807 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:49.989969 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:49.990141 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:49.995007 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:50.001247 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:50.001976 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:50.002151 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:50.002331 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:50.015105 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:50.016188 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:50.016913 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:50.017086 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:50.017258 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:50.024694 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:50.025872 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:50.026504 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:50.026634 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:50.026824 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:50.029086 31250 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:50.036746 31250 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:50.037569 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:50.037757 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:50.037940 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:50.040334 31564 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:50.044932 31564 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:50.045634 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:50.045802 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:50.045993 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:50.071843 31564 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:50.073133 31564 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:50.073911 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:50.074123 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:50.074335 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:50.078629 31564 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:50.079761 31564 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:50.080516 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:50.080698 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:50.080940 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:50.086915 31564 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:50.088814 31564 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:50.089514 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:50.089715 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:50.089912 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:50.103348 31564 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:50.104560 31564 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:50.105311 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:50.105512 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:50.105723 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:50.110580 31564 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:50.117803 31564 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:50.118468 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:50.118674 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:50.118860 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:50.121096 31564 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:50.122174 31564 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:50.122839 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:50.123018 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:50.123243 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:50.125340 31564 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:50.126346 31564 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:50.126953 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:50.127125 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:50.127310 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:50.148815 31564 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:50.149972 31564 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:50.150715 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:50.150908 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
I20240501 14:03:50.151125 31428 tablet_bootstrap.cc:492] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2: Bootstrap replayed 1/1 log segments. Stats: ops{read=215 overwritten=0 applied=215 ignored=0} inserts{seen=10700 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20240501 14:03:50.151166 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:50.151849 31428 tablet_bootstrap.cc:492] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2: Bootstrap complete.
I20240501 14:03:50.153296 31428 ts_tablet_manager.cc:1367] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2: Time spent bootstrapping tablet: real 0.729s user 0.660s sys 0.060s
I20240501 14:03:50.157820 31428 raft_consensus.cc:348] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed2b79aff844eb39968f24d7f6ab7c2" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 37211 } }
I20240501 14:03:50.158568 31428 raft_consensus.cc:729] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ed2b79aff844eb39968f24d7f6ab7c2, State: Initialized, Role: FOLLOWER
I20240501 14:03:50.159267 31428 consensus_queue.cc:260] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 215, Last appended: 1.215, Last appended by leader: 215, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed2b79aff844eb39968f24d7f6ab7c2" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 37211 } }
I20240501 14:03:50.159494 31428 raft_consensus.cc:388] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:03:50.159624 31428 raft_consensus.cc:482] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:03:50.159777 31564 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:50.159838 31428 raft_consensus.cc:3037] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:03:50.162825 31564 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:50.163491 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:50.163678 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
I20240501 14:03:50.163762 31428 raft_consensus.cc:504] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed2b79aff844eb39968f24d7f6ab7c2" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 37211 } }
W20240501 14:03:50.163861 31526 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:47833: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:50.164446 31428 leader_election.cc:302] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ed2b79aff844eb39968f24d7f6ab7c2; no voters:
I20240501 14:03:50.165259 31428 leader_election.cc:288] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 14:03:50.165391 31779 raft_consensus.cc:2781] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:03:50.166105 31779 raft_consensus.cc:686] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [term 2 LEADER]: Becoming Leader. State: Replica: 7ed2b79aff844eb39968f24d7f6ab7c2, State: Running, Role: LEADER
I20240501 14:03:50.166651 31779 consensus_queue.cc:237] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 215, Committed index: 215, Last appended: 1.215, Last appended by leader: 215, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed2b79aff844eb39968f24d7f6ab7c2" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 37211 } }
I20240501 14:03:50.166812 31564 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:50.167093 31428 ts_tablet_manager.cc:1398] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2: Time spent starting tablet: real 0.014s user 0.009s sys 0.004s
I20240501 14:03:50.166668 31559 heartbeater.cc:503] Master 127.29.231.62:36819 was elected leader, sending a full tablet report...
I20240501 14:03:50.168747 31564 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:50.169471 31526 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:47833)
I20240501 14:03:50.169644 31526 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:47833: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
I20240501 14:03:50.169900 31019 catalog_manager.cc:5484] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "7ed2b79aff844eb39968f24d7f6ab7c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed2b79aff844eb39968f24d7f6ab7c2" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 37211 } health_report { overall_health: HEALTHY } } }
I20240501 14:03:50.172652 31526 tablet_copy_source_session.cc:205] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 14:03:50.177693 31564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 639baa1976b54dd7a9968c285f78b7eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:03:50.188151 31564 tablet_copy_client.cc:783] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Starting download of 0 data blocks...
I20240501 14:03:50.188489 31564 tablet_copy_client.cc:647] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Starting download of 1 WAL segments...
I20240501 14:03:50.193061 31564 tablet_copy_client.cc:523] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 14:03:50.196422 31564 tablet_bootstrap.cc:492] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Bootstrap starting.
I20240501 14:03:50.265368 31564 log.cc:824] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Log is configured to *not* fsync() on all Append() calls
I20240501 14:03:50.795253 31564 tablet_bootstrap.cc:492] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Bootstrap replayed 1/1 log segments. Stats: ops{read=216 overwritten=0 applied=216 ignored=0} inserts{seen=10700 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:03:50.795842 31564 tablet_bootstrap.cc:492] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Bootstrap complete.
I20240501 14:03:50.796375 31564 ts_tablet_manager.cc:1367] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Time spent bootstrapping tablet: real 0.600s user 0.540s sys 0.063s
I20240501 14:03:50.800825 31564 raft_consensus.cc:348] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed2b79aff844eb39968f24d7f6ab7c2" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 37211 } }
I20240501 14:03:50.801165 31564 raft_consensus.cc:729] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: b6f6ebcca5034c4183eb4a6f3f8891ec, State: Initialized, Role: NON_PARTICIPANT
I20240501 14:03:50.801649 31564 consensus_queue.cc:260] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 216, Last appended: 2.216, Last appended by leader: 216, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed2b79aff844eb39968f24d7f6ab7c2" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 37211 } }
I20240501 14:03:50.802917 31564 ts_tablet_manager.cc:1398] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20240501 14:03:50.803794 31526 tablet_copy_service.cc:342] P 7ed2b79aff844eb39968f24d7f6ab7c2: Request end of tablet copy session b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb received from {username='slave'} at 127.29.231.2:47833
I20240501 14:03:50.803964 31526 tablet_copy_service.cc:433] P 7ed2b79aff844eb39968f24d7f6ab7c2: ending tablet copy session b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb on tablet 639baa1976b54dd7a9968c285f78b7eb with peer b6f6ebcca5034c4183eb4a6f3f8891ec
W20240501 14:03:50.804646 31736 ts_tablet_manager.cc:701] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Tablet Copy: Invalid argument: Leader has replica of tablet 639baa1976b54dd7a9968c285f78b7eb with term 0, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20240501 14:03:50.807518 31564 ts_tablet_manager.cc:701] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Tablet Copy: Invalid argument: Leader has replica of tablet 639baa1976b54dd7a9968c285f78b7eb with term 0, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20240501 14:03:50.843076 31564 ts_tablet_manager.cc:701] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Tablet Copy: Invalid argument: Leader has replica of tablet 639baa1976b54dd7a9968c285f78b7eb with term 0, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
I20240501 14:03:50.846150 31171 tablet_service.cc:1514] Processing DeleteTablet for tablet 639baa1976b54dd7a9968c285f78b7eb with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:53358
I20240501 14:03:50.846925 31794 tablet_replica.cc:330] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: stopping tablet replica
I20240501 14:03:50.847298 31794 raft_consensus.cc:2229] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec [term 2 NON_PARTICIPANT]: Raft consensus shutting down.
I20240501 14:03:50.847584 31794 raft_consensus.cc:2258] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec [term 2 NON_PARTICIPANT]: Raft consensus is shut down!
I20240501 14:03:50.848757 31794 ts_tablet_manager.cc:1875] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20240501 14:03:50.853107 31794 ts_tablet_manager.cc:1888] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.216
I20240501 14:03:50.853224 31794 log.cc:1196] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Deleting WAL directory at /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/wal/wals/639baa1976b54dd7a9968c285f78b7eb
I20240501 14:03:50.853675 31794 ts_tablet_manager.cc:1909] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Deleting consensus metadata
I20240501 14:03:50.855443 30620 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu pid 31109
I20240501 14:03:50.856467 31231 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 14:03:50.959908 30620 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu with pid 31109
I20240501 14:03:50.980772 30620 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
/tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.231.2:39057
--local_ip_for_outbound_sockets=127.29.231.2
--tserver_master_addrs=127.29.231.62:36819
--webserver_port=44439
--webserver_interface=127.29.231.2
--builtin_ntp_servers=127.29.231.20:34843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240501 14:03:51.305855 31796 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 14:03:51.306159 31796 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 14:03:51.306245 31796 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 14:03:51.313477 31796 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 14:03:51.313654 31796 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.231.2
I20240501 14:03:51.322572 31796 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.231.20:34843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.231.2:39057
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.231.2
--webserver_port=44439
--tserver_master_addrs=127.29.231.62:36819
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.231.2
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 13:43:20 UTC on efd1337a2aa3
build id 75
ASAN enabled
I20240501 14:03:51.323880 31796 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 14:03:51.325573 31796 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:03:51.337637 31804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:03:51.338112 31801 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:03:51.338778 31802 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:03:51.339500 31796 server_base.cc:1034] running on GCE node
I20240501 14:03:51.340087 31796 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 14:03:51.341017 31796 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 14:03:51.342217 31796 hybrid_clock.cc:648] HybridClock initialized: now 1714572231342141 us; error 53 us; skew 500 ppm
I20240501 14:03:51.342510 31796 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:03:51.347846 31796 webserver.cc:460] Webserver started at http://127.29.231.2:44439/ using document root <none> and password file <none>
I20240501 14:03:51.348627 31796 fs_manager.cc:359] Metadata directory not provided
I20240501 14:03:51.348752 31796 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:03:51.353864 31796 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20240501 14:03:51.356626 31810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:03:51.357930 31796 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20240501 14:03:51.358081 31796 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/wal
uuid: "b6f6ebcca5034c4183eb4a6f3f8891ec"
format_stamp: "Formatted at 2024-05-01 14:03:45 on dist-test-slave-4827"
I20240501 14:03:51.358917 31796 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:03:51.394685 31796 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:03:51.395576 31796 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 14:03:51.395843 31796 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:03:51.396811 31796 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 14:03:51.398309 31796 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 14:03:51.398406 31796 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 14:03:51.398536 31796 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 14:03:51.398607 31796 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 14:03:51.428808 31796 rpc_server.cc:307] RPC server started. Bound to: 127.29.231.2:39057
I20240501 14:03:51.428877 31922 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.231.2:39057 every 8 connection(s)
I20240501 14:03:51.430244 31796 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data/info.pb
I20240501 14:03:51.439121 30620 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu as pid 31796
I20240501 14:03:51.439393 30620 tablet_copy_client_session-itest.cc:139] Starting loop 1
I20240501 14:03:51.439476 30620 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu pid 31247
I20240501 14:03:51.442931 31923 heartbeater.cc:347] Connected to a master server at 127.29.231.62:36819
I20240501 14:03:51.443270 31923 heartbeater.cc:464] Registering TS with master...
I20240501 14:03:51.444067 31923 heartbeater.cc:511] Master 127.29.231.62:36819 requested a full tablet report, sending...
I20240501 14:03:51.445643 31019 ts_manager.cc:194] Re-registered known tserver with Master: b6f6ebcca5034c4183eb4a6f3f8891ec (127.29.231.2:39057)
I20240501 14:03:51.446381 31550 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 14:03:51.446705 31019 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.231.2:34305
I20240501 14:03:51.544790 30620 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu with pid 31247
I20240501 14:03:51.565182 30620 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
/tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.231.1:37211
--local_ip_for_outbound_sockets=127.29.231.1
--tserver_master_addrs=127.29.231.62:36819
--webserver_port=33931
--webserver_interface=127.29.231.1
--builtin_ntp_servers=127.29.231.20:34843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240501 14:03:51.601729 31939 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.613158 31939 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.619694 31939 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.620874 31939 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.639168 31939 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.640394 31939 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.650959 31939 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.652053 31939 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.664098 31939 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.665416 31939 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.672382 31939 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.674295 31939 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.684741 31939 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.686162 31939 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.688385 31939 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.689968 31939 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.704921 31939 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.708699 31939 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.711059 31939 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.712175 31939 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.718966 31939 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.720147 31939 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.732394 31939 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.733953 31939 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.736591 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.740352 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.752374 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.753670 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.756268 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.757370 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.760731 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.763223 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.780153 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.781435 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.790506 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.791718 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.798502 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.799530 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.802143 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.803109 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.811828 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.812997 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.822734 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.823868 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.830747 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.831856 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.833926 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.836819 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.842592 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.843693 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.846601 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.853701 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.856449 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.857558 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.860915 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.861997 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.863829 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.864912 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.879256 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.880513 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.884374 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.885504 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.887688 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.888823 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.892479 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.893486 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.897743 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.898788 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.903877 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.904943 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.907627 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.908664 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.917507 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.918654 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.922339 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.925556 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.930488 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.931658 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
W20240501 14:03:51.950459 31935 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 14:03:51.950763 31935 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 14:03:51.950896 31935 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 14:03:51.958438 31935 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 14:03:51.958653 31935 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.231.1
I20240501 14:03:51.960613 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.961802 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.967713 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.968783 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.970093 31935 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.231.20:34843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.231.1:37211
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.231.1
--webserver_port=33931
--tserver_master_addrs=127.29.231.62:36819
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.231.1
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 13:43:20 UTC on efd1337a2aa3
build id 75
ASAN enabled
I20240501 14:03:51.971854 31935 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 14:03:51.973752 31935 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20240501 14:03:51.973816 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.974920 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
W20240501 14:03:51.986533 32112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:03:51.987046 32115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:03:51.987677 32113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:03:51.988390 31935 server_base.cc:1034] running on GCE node
I20240501 14:03:51.988978 31935 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 14:03:51.989982 31935 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 14:03:51.990299 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:51.991227 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:51.991222 31935 hybrid_clock.cc:648] HybridClock initialized: now 1714572231991162 us; error 44 us; skew 500 ppm
I20240501 14:03:51.991540 31935 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:03:51.994166 31935 webserver.cc:460] Webserver started at http://127.29.231.1:33931/ using document root <none> and password file <none>
I20240501 14:03:51.994874 31935 fs_manager.cc:359] Metadata directory not provided
I20240501 14:03:51.994999 31935 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:03:51.999945 31935 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20240501 14:03:52.001857 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.003003 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.003192 32128 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:03:52.005986 31935 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20240501 14:03:52.006148 31935 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/wal
uuid: "7ed2b79aff844eb39968f24d7f6ab7c2"
format_stamp: "Formatted at 2024-05-01 14:03:45 on dist-test-slave-4827"
I20240501 14:03:52.007016 31935 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:03:52.012492 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.016986 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.026876 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.027806 31935 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:03:52.028012 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.028838 31935 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 14:03:52.029143 31935 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:03:52.030316 31935 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 14:03:52.032092 32144 ts_tablet_manager.cc:522] Loading tablet metadata (0/1 complete)
I20240501 14:03:52.037149 31935 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240501 14:03:52.037268 31935 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20240501 14:03:52.037379 31935 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240501 14:03:52.040134 31935 ts_tablet_manager.cc:590] Registered 1 tablets
I20240501 14:03:52.040212 31935 ts_tablet_manager.cc:569] Time spent register tablets: real 0.003s user 0.000s sys 0.000s
I20240501 14:03:52.040583 32144 tablet_bootstrap.cc:492] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2: Bootstrap starting.
I20240501 14:03:52.046885 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.048862 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.053030 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.055159 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.061012 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.067554 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.073177 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.086787 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.101615 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.103273 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.110287 31935 rpc_server.cc:307] RPC server started. Bound to: 127.29.231.1:37211
I20240501 14:03:52.110337 32270 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.231.1:37211 every 8 connection(s)
I20240501 14:03:52.112143 31935 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/data/info.pb
I20240501 14:03:52.115823 30620 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu as pid 31935
I20240501 14:03:52.124215 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.129134 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.134495 32271 heartbeater.cc:347] Connected to a master server at 127.29.231.62:36819
I20240501 14:03:52.134812 32271 heartbeater.cc:464] Registering TS with master...
I20240501 14:03:52.135744 32271 heartbeater.cc:511] Master 127.29.231.62:36819 requested a full tablet report, sending...
I20240501 14:03:52.138413 31019 ts_manager.cc:194] Re-registered known tserver with Master: 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.139847 31019 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.231.1:50833
I20240501 14:03:52.141535 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.141866 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.144094 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.146080 32144 log.cc:824] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2: Log is configured to *not* fsync() on all Append() calls
I20240501 14:03:52.181800 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.183086 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.183746 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.184114 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.184378 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.186930 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.187942 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.188596 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.188755 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.188938 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.194792 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.195860 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.196516 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.196684 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.196869 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.201086 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.203629 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.204264 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.204428 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.204602 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.228377 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.234820 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.235599 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.235780 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.236001 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.238370 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.239508 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.240047 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.240170 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.240379 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.246258 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.247278 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.247910 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.248101 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.248327 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.253145 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.254294 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.254891 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.255061 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.255261 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.270979 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.272389 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.273068 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.273257 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.273450 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.276435 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.277446 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.278142 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.278311 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.278508 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.282218 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.286352 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.287009 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.287175 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.287334 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.295740 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.296872 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.297565 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.297706 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.297874 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.300912 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.310487 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.311151 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.311319 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.311487 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.319916 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.321049 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.321679 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.321815 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.321987 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.332139 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.333369 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.334196 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.334383 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.334581 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.336661 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.337844 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.338506 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.338660 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.338855 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.343138 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.344210 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.344889 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.345072 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.345254 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.361572 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.362721 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.363550 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.363755 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.364012 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.370867 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.378139 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.378851 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.379020 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.379195 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.381778 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.383400 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.384047 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.384181 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.384409 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.395328 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.402391 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.403203 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.403410 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.403618 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.410498 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.412210 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.412966 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.413115 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.413321 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.420022 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.421252 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.421916 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.422070 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.422247 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.424682 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.429175 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.429940 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.430128 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.430333 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.448295 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.449606 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.449990 31923 heartbeater.cc:503] Master 127.29.231.62:36819 was elected leader, sending a full tablet report...
I20240501 14:03:52.450294 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.450498 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.450698 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.454075 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.458480 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.459100 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.459267 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.459481 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.482297 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.483575 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.484252 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.484434 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.484618 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.489986 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.491016 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.491760 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.491933 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.492157 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.501543 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.502835 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.503530 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.503708 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.503899 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.513505 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.514761 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.515404 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.515534 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.515707 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.523133 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.524407 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.525058 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.525218 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.525390 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.542882 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.544833 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.545572 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.545733 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.545933 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.548108 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.549297 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.549912 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.550067 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.550235 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.552765 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.553735 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.554347 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.554479 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.554636 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.557487 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.560501 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.561105 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.561285 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.561470 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.571372 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.572430 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.573119 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.573282 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.573506 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.576047 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.581322 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.581992 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.582152 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.582311 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.589960 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.591053 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.591732 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.591909 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.592121 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.595685 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.596853 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.597425 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.597599 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.597788 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.613422 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.625101 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.625995 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.626181 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.626401 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.631718 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.632879 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.633489 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.633677 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.633849 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.641068 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.642097 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.642778 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.642927 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.643136 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.647899 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.648986 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.649588 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.649758 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.649938 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.660338 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.661561 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.662230 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.662400 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.662622 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.666287 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.667332 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.667979 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.668161 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.668356 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.670320 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.677413 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.678128 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.678272 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.678485 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.683068 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.684118 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.685074 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.685253 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.685488 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.706934 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.708478 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.709159 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.709303 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.709497 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.723489 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.724627 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.725299 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.725493 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:52.725662 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.732549 32144 tablet_bootstrap.cc:492] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2: Bootstrap replayed 1/1 log segments. Stats: ops{read=216 overwritten=0 applied=216 ignored=0} inserts{seen=10700 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:03:52.733075 32144 tablet_bootstrap.cc:492] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2: Bootstrap complete.
I20240501 14:03:52.734395 32144 ts_tablet_manager.cc:1367] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2: Time spent bootstrapping tablet: real 0.694s user 0.635s sys 0.055s
I20240501 14:03:52.737177 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.739792 32144 raft_consensus.cc:348] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed2b79aff844eb39968f24d7f6ab7c2" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 37211 } }
I20240501 14:03:52.740597 32144 raft_consensus.cc:729] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ed2b79aff844eb39968f24d7f6ab7c2, State: Initialized, Role: FOLLOWER
I20240501 14:03:52.740839 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.741276 32144 consensus_queue.cc:260] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 216, Last appended: 2.216, Last appended by leader: 216, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed2b79aff844eb39968f24d7f6ab7c2" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 37211 } }
I20240501 14:03:52.741535 32144 raft_consensus.cc:388] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:03:52.741544 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.741653 32144 raft_consensus.cc:482] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:03:52.741744 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
I20240501 14:03:52.741825 32144 raft_consensus.cc:3037] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [term 2 FOLLOWER]: Advancing to term 3
W20240501 14:03:52.741932 32242 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:32799: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:52.745941 32144 raft_consensus.cc:504] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed2b79aff844eb39968f24d7f6ab7c2" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 37211 } }
I20240501 14:03:52.746421 32144 leader_election.cc:302] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ed2b79aff844eb39968f24d7f6ab7c2; no voters:
I20240501 14:03:52.746886 32144 leader_election.cc:288] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [CANDIDATE]: Term 3 election: Requested vote from peers
I20240501 14:03:52.747009 32481 raft_consensus.cc:2781] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [term 3 FOLLOWER]: Leader election won for term 3
I20240501 14:03:52.747937 32271 heartbeater.cc:503] Master 127.29.231.62:36819 was elected leader, sending a full tablet report...
I20240501 14:03:52.748031 32481 raft_consensus.cc:686] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [term 3 LEADER]: Becoming Leader. State: Replica: 7ed2b79aff844eb39968f24d7f6ab7c2, State: Running, Role: LEADER
I20240501 14:03:52.748411 32144 ts_tablet_manager.cc:1398] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2: Time spent starting tablet: real 0.014s user 0.015s sys 0.001s
I20240501 14:03:52.748565 32481 consensus_queue.cc:237] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 216, Committed index: 216, Last appended: 2.216, Last appended by leader: 216, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed2b79aff844eb39968f24d7f6ab7c2" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 37211 } }
I20240501 14:03:52.751976 31019 catalog_manager.cc:5484] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 reported cstate change: term changed from 2 to 3. New cstate: current_term: 3 leader_uuid: "7ed2b79aff844eb39968f24d7f6ab7c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed2b79aff844eb39968f24d7f6ab7c2" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 37211 } health_report { overall_health: HEALTHY } } }
I20240501 14:03:52.752242 31937 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:52.753448 31937 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:52.754069 32242 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:32799)
I20240501 14:03:52.754205 32242 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:32799: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
I20240501 14:03:52.756609 32242 tablet_copy_source_session.cc:205] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 14:03:52.761299 31937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 639baa1976b54dd7a9968c285f78b7eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:03:52.770939 31937 tablet_copy_client.cc:783] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Starting download of 0 data blocks...
I20240501 14:03:52.771226 31937 tablet_copy_client.cc:647] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Starting download of 1 WAL segments...
I20240501 14:03:52.775171 31937 tablet_copy_client.cc:523] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 14:03:52.778219 31937 tablet_bootstrap.cc:492] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Bootstrap starting.
I20240501 14:03:52.841606 31937 log.cc:824] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Log is configured to *not* fsync() on all Append() calls
I20240501 14:03:53.369937 31937 tablet_bootstrap.cc:492] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Bootstrap replayed 1/1 log segments. Stats: ops{read=217 overwritten=0 applied=217 ignored=0} inserts{seen=10700 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:03:53.370407 31937 tablet_bootstrap.cc:492] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Bootstrap complete.
I20240501 14:03:53.370951 31937 ts_tablet_manager.cc:1367] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Time spent bootstrapping tablet: real 0.593s user 0.547s sys 0.044s
I20240501 14:03:53.375979 31937 raft_consensus.cc:348] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec [term 3 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed2b79aff844eb39968f24d7f6ab7c2" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 37211 } }
I20240501 14:03:53.376494 31937 raft_consensus.cc:729] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec [term 3 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: b6f6ebcca5034c4183eb4a6f3f8891ec, State: Initialized, Role: NON_PARTICIPANT
I20240501 14:03:53.377056 31937 consensus_queue.cc:260] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 217, Last appended: 3.217, Last appended by leader: 217, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed2b79aff844eb39968f24d7f6ab7c2" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 37211 } }
I20240501 14:03:53.378808 31937 ts_tablet_manager.cc:1398] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Time spent starting tablet: real 0.008s user 0.009s sys 0.000s
I20240501 14:03:53.379719 32242 tablet_copy_service.cc:342] P 7ed2b79aff844eb39968f24d7f6ab7c2: Request end of tablet copy session b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb received from {username='slave'} at 127.29.231.2:32799
I20240501 14:03:53.379887 32242 tablet_copy_service.cc:433] P 7ed2b79aff844eb39968f24d7f6ab7c2: ending tablet copy session b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb on tablet 639baa1976b54dd7a9968c285f78b7eb with peer b6f6ebcca5034c4183eb4a6f3f8891ec
W20240501 14:03:53.379976 32495 ts_tablet_manager.cc:701] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Tablet Copy: Invalid argument: Leader has replica of tablet 639baa1976b54dd7a9968c285f78b7eb with term 0, which is lower than last-logged term 3 on local replica. Rejecting tablet copy request
W20240501 14:03:53.395388 31937 ts_tablet_manager.cc:701] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Tablet Copy: Invalid argument: Leader has replica of tablet 639baa1976b54dd7a9968c285f78b7eb with term 0, which is lower than last-logged term 3 on local replica. Rejecting tablet copy request
I20240501 14:03:53.397691 31858 tablet_service.cc:1514] Processing DeleteTablet for tablet 639baa1976b54dd7a9968c285f78b7eb with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:53364
I20240501 14:03:53.398355 32497 tablet_replica.cc:330] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: stopping tablet replica
I20240501 14:03:53.398769 32497 raft_consensus.cc:2229] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec [term 3 NON_PARTICIPANT]: Raft consensus shutting down.
I20240501 14:03:53.399068 32497 raft_consensus.cc:2258] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec [term 3 NON_PARTICIPANT]: Raft consensus is shut down!
I20240501 14:03:53.400285 32497 ts_tablet_manager.cc:1875] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20240501 14:03:53.404621 32497 ts_tablet_manager.cc:1888] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 3.217
I20240501 14:03:53.404747 32497 log.cc:1196] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Deleting WAL directory at /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/wal/wals/639baa1976b54dd7a9968c285f78b7eb
I20240501 14:03:53.405248 32497 ts_tablet_manager.cc:1909] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Deleting consensus metadata
I20240501 14:03:53.406826 30620 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu pid 31796
I20240501 14:03:53.407716 31918 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 14:03:53.510645 30620 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu with pid 31796
I20240501 14:03:53.531724 30620 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
/tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.231.2:39057
--local_ip_for_outbound_sockets=127.29.231.2
--tserver_master_addrs=127.29.231.62:36819
--webserver_port=44439
--webserver_interface=127.29.231.2
--builtin_ntp_servers=127.29.231.20:34843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240501 14:03:53.866263 32499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 14:03:53.866621 32499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 14:03:53.866760 32499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 14:03:53.874238 32499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 14:03:53.874450 32499 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.231.2
I20240501 14:03:53.883679 32499 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.231.20:34843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.231.2:39057
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.231.2
--webserver_port=44439
--tserver_master_addrs=127.29.231.62:36819
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.231.2
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 13:43:20 UTC on efd1337a2aa3
build id 75
ASAN enabled
I20240501 14:03:53.885071 32499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 14:03:53.886875 32499 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:03:53.899103 32504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:03:53.899737 32505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:03:53.900288 32507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:03:53.900900 32499 server_base.cc:1034] running on GCE node
I20240501 14:03:53.901511 32499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 14:03:53.902426 32499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 14:03:53.903635 32499 hybrid_clock.cc:648] HybridClock initialized: now 1714572233903575 us; error 40 us; skew 500 ppm
I20240501 14:03:53.903923 32499 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:03:53.906145 32499 webserver.cc:460] Webserver started at http://127.29.231.2:44439/ using document root <none> and password file <none>
I20240501 14:03:53.906841 32499 fs_manager.cc:359] Metadata directory not provided
I20240501 14:03:53.906966 32499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:03:53.912075 32499 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20240501 14:03:53.914801 32513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:03:53.916080 32499 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20240501 14:03:53.916260 32499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/wal
uuid: "b6f6ebcca5034c4183eb4a6f3f8891ec"
format_stamp: "Formatted at 2024-05-01 14:03:45 on dist-test-slave-4827"
I20240501 14:03:53.917083 32499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:03:53.956584 32499 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:03:53.957461 32499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 14:03:53.957732 32499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:03:53.958701 32499 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 14:03:53.960247 32499 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 14:03:53.960341 32499 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 14:03:53.960453 32499 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 14:03:53.960523 32499 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 14:03:53.991971 32499 rpc_server.cc:307] RPC server started. Bound to: 127.29.231.2:39057
I20240501 14:03:53.992035 32625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.231.2:39057 every 8 connection(s)
I20240501 14:03:53.993440 32499 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data/info.pb
I20240501 14:03:53.999603 30620 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu as pid 32499
I20240501 14:03:53.999833 30620 tablet_copy_client_session-itest.cc:139] Starting loop 2
I20240501 14:03:53.999938 30620 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu pid 31935
I20240501 14:03:54.008742 32626 heartbeater.cc:347] Connected to a master server at 127.29.231.62:36819
I20240501 14:03:54.009064 32626 heartbeater.cc:464] Registering TS with master...
I20240501 14:03:54.010147 32626 heartbeater.cc:511] Master 127.29.231.62:36819 requested a full tablet report, sending...
I20240501 14:03:54.011996 31019 ts_manager.cc:194] Re-registered known tserver with Master: b6f6ebcca5034c4183eb4a6f3f8891ec (127.29.231.2:39057)
I20240501 14:03:54.013049 31019 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.231.2:35851
I20240501 14:03:54.015275 32266 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 14:03:54.115082 30620 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu with pid 31935
I20240501 14:03:54.136380 30620 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
/tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.231.1:37211
--local_ip_for_outbound_sockets=127.29.231.1
--tserver_master_addrs=127.29.231.62:36819
--webserver_port=33931
--webserver_interface=127.29.231.1
--builtin_ntp_servers=127.29.231.20:34843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240501 14:03:54.156637 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.181334 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.185978 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.188810 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.214956 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.216928 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.221603 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.222795 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.229944 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.231190 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.244092 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.245460 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.271498 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.273025 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.287729 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.289463 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.297744 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.299743 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.305804 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.316569 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.322424 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.336905 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.343809 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.345238 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.367308 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.368685 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.379148 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.382611 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.393519 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.394768 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.419306 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.420584 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.422860 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.424389 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.438019 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.439267 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.443150 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.444389 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.449539 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.450695 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.467952 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.469218 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.477737 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.478971 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.482053 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.483235 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.487183 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.488862 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.491407 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.492470 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.496793 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.497731 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.507418 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.508621 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.519366 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
W20240501 14:03:54.519461 32638 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 14:03:54.519835 32638 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 14:03:54.519984 32638 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20240501 14:03:54.520529 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
W20240501 14:03:54.528184 32638 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 14:03:54.528405 32638 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.231.1
I20240501 14:03:54.530684 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.531728 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.534343 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.535356 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.539458 32638 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.231.20:34843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.231.1:37211
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.231.1
--webserver_port=33931
--tserver_master_addrs=127.29.231.62:36819
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.231.1
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 13:43:20 UTC on efd1337a2aa3
build id 75
ASAN enabled
I20240501 14:03:54.540560 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.541070 32638 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 14:03:54.541476 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.543325 32638 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:03:54.555528 303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:03:54.555671 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
W20240501 14:03:54.556078 306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:03:54.556900 304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:03:54.557404 32638 server_base.cc:1034] running on GCE node
I20240501 14:03:54.558035 32638 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 14:03:54.559003 32638 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 14:03:54.560250 32638 hybrid_clock.cc:648] HybridClock initialized: now 1714572234560151 us; error 55 us; skew 500 ppm
I20240501 14:03:54.560544 32638 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:03:54.562971 32638 webserver.cc:460] Webserver started at http://127.29.231.1:33931/ using document root <none> and password file <none>
I20240501 14:03:54.563879 32638 fs_manager.cc:359] Metadata directory not provided
I20240501 14:03:54.564028 32638 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:03:54.569697 32638 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20240501 14:03:54.572700 316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:03:54.573345 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.574095 32638 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20240501 14:03:54.574261 32638 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/wal
uuid: "7ed2b79aff844eb39968f24d7f6ab7c2"
format_stamp: "Formatted at 2024-05-01 14:03:45 on dist-test-slave-4827"
I20240501 14:03:54.575350 32638 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:03:54.577845 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.578898 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.582767 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.583835 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.593406 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.594564 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.602561 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.603626 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.610318 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.611374 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.613411 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.614333 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.618135 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.619124 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.621163 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.622265 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.633872 32638 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:03:54.634696 32638 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 14:03:54.634933 32638 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:03:54.635828 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.635936 32638 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 14:03:54.636850 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.638612 359 ts_tablet_manager.cc:522] Loading tablet metadata (0/1 complete)
I20240501 14:03:54.643719 32638 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240501 14:03:54.643829 32638 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20240501 14:03:54.643939 32638 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240501 14:03:54.646780 32638 ts_tablet_manager.cc:590] Registered 1 tablets
I20240501 14:03:54.646878 32638 ts_tablet_manager.cc:569] Time spent register tablets: real 0.003s user 0.000s sys 0.001s
I20240501 14:03:54.647248 359 tablet_bootstrap.cc:492] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2: Bootstrap starting.
I20240501 14:03:54.649224 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.650388 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.654884 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.661302 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.670706 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.679399 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.684362 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.695551 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.700623 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.702934 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.705312 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.708024 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.720080 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.720109 32638 rpc_server.cc:307] RPC server started. Bound to: 127.29.231.1:37211
I20240501 14:03:54.720181 489 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.231.1:37211 every 8 connection(s)
I20240501 14:03:54.721302 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.722265 32638 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-0/data/info.pb
I20240501 14:03:54.732590 30620 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu as pid 32638
I20240501 14:03:54.790490 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:54.790843 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:54.792881 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:54.793790 494 heartbeater.cc:347] Connected to a master server at 127.29.231.62:36819
I20240501 14:03:54.794167 494 heartbeater.cc:464] Registering TS with master...
I20240501 14:03:54.795290 494 heartbeater.cc:511] Master 127.29.231.62:36819 requested a full tablet report, sending...
I20240501 14:03:54.797696 31019 ts_manager.cc:194] Re-registered known tserver with Master: 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.798784 31019 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.231.1:39809
I20240501 14:03:54.800951 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.808770 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.809454 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:54.809638 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:54.809821 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:54.819983 359 log.cc:824] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2: Log is configured to *not* fsync() on all Append() calls
I20240501 14:03:54.830464 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.831557 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.832284 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:54.832451 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:54.832669 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:54.842428 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.844082 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.844815 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:54.845003 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:54.845183 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:54.847574 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.848659 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.849273 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:54.849444 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:54.849618 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:54.862612 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.864017 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.864697 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:54.864889 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:54.865082 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:54.882234 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.885160 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.885843 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:54.886009 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:54.886205 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:54.888573 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.889712 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.890280 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:54.890455 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:54.890636 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:54.893867 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.894856 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.895475 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:54.895635 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:54.895829 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:54.914487 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.915786 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.916481 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:54.916646 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:54.916802 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:54.923888 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.926070 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.926738 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:54.926878 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:54.927048 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:54.936619 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.937847 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.938454 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:54.938625 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:54.938807 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:54.942332 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.943390 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.944020 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:54.944142 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:54.944347 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:54.953248 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.954440 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.955066 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:54.955231 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:54.955400 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:54.957576 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.958847 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.959447 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:54.959569 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:54.959750 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:54.962344 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.963388 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.964004 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:54.964156 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:54.964349 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:54.974769 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.975924 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.976563 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:54.976693 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:54.976876 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:54.987782 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:54.988958 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:54.989634 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:54.989827 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:54.990016 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:55.010321 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:55.011587 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:55.012272 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:55.012450 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:55.012688 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:55.015822 32626 heartbeater.cc:503] Master 127.29.231.62:36819 was elected leader, sending a full tablet report...
I20240501 14:03:55.024480 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:55.025568 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:55.026265 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:55.026449 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:55.026652 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:55.029081 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:55.030094 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:55.030694 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:55.030808 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:55.030972 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:55.051574 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:55.052796 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:55.053519 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:55.053686 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:55.053861 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:55.065384 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:55.066551 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:55.067225 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:55.067400 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:55.067615 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:55.075242 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:55.076640 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:55.077270 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:55.077442 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:55.077644 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:55.093447 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:55.094683 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:55.095364 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:55.095516 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:55.095722 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:55.107599 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:55.108834 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:55.109508 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:55.109663 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:55.109823 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:55.112852 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:55.121389 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:55.122141 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:55.122313 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:55.122524 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:55.127436 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:55.128479 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:55.129094 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:55.129271 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:55.129468 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:55.132900 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:55.134364 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:55.134971 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:55.135129 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:55.135357 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:55.143432 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:55.144809 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:55.145421 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:55.145606 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:55.145781 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:55.170917 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:55.172176 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:55.173043 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:55.173197 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:55.173398 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:55.175895 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:55.177402 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:55.178115 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:55.178270 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:55.178457 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:55.183606 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:55.184689 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:55.185282 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:55.185425 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:55.185607 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:55.188256 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:55.194654 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:55.195374 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:55.195533 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:55.195715 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:55.220309 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:55.221854 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:55.222587 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:55.222770 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:55.222999 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:55.225520 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:55.235167 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:55.235941 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:55.236124 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:55.236320 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:55.239912 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:55.241062 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:55.241745 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:55.241878 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:55.242036 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:55.267217 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:55.268499 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:55.269265 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:55.269436 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:55.269610 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:55.272068 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:55.278640 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:55.279340 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:55.279518 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:55.279738 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:55.294488 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:55.295866 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:55.296612 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:55.296805 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:55.297016 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:55.308708 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:55.309970 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:55.310767 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:55.310921 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:55.311161 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:55.329731 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:55.331431 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:55.332142 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:55.332350 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:55.332542 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:55.344810 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:55.346040 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:55.346724 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:55.346868 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:55.347064 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:55.356858 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:55.359580 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:55.360255 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:55.360435 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:55.360605 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:55.363080 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:55.364329 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:55.364941 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:55.365092 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:55.365258 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:55.368288 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:55.375500 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:55.376258 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:55.376435 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:55.376610 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:55.379365 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:55.380633 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:55.381274 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:55.381425 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:55.381593 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:55.389748 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:55.394578 359 tablet_bootstrap.cc:492] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2: Bootstrap replayed 1/1 log segments. Stats: ops{read=217 overwritten=0 applied=217 ignored=0} inserts{seen=10700 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:03:55.395298 359 tablet_bootstrap.cc:492] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2: Bootstrap complete.
I20240501 14:03:55.396857 359 ts_tablet_manager.cc:1367] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2: Time spent bootstrapping tablet: real 0.750s user 0.666s sys 0.052s
I20240501 14:03:55.397413 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:55.398043 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:55.398222 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
W20240501 14:03:55.398429 465 tablet_copy_service.cc:478] P 7ed2b79aff844eb39968f24d7f6ab7c2: Error handling TabletCopyService RPC request from {username='slave'} at 127.29.231.2:41765: Error beginning tablet copy session for tablet 639baa1976b54dd7a9968c285f78b7eb: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240501 14:03:55.402527 359 raft_consensus.cc:348] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed2b79aff844eb39968f24d7f6ab7c2" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 37211 } }
I20240501 14:03:55.403261 359 raft_consensus.cc:729] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ed2b79aff844eb39968f24d7f6ab7c2, State: Initialized, Role: FOLLOWER
I20240501 14:03:55.403810 359 consensus_queue.cc:260] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 217, Last appended: 3.217, Last appended by leader: 217, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed2b79aff844eb39968f24d7f6ab7c2" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 37211 } }
I20240501 14:03:55.403983 359 raft_consensus.cc:388] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [term 3 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:03:55.404078 359 raft_consensus.cc:482] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [term 3 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:03:55.404208 359 raft_consensus.cc:3037] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [term 3 FOLLOWER]: Advancing to term 4
I20240501 14:03:55.407239 32639 ts_tablet_manager.cc:902] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Initiating tablet copy from peer 7ed2b79aff844eb39968f24d7f6ab7c2 (127.29.231.1:37211)
I20240501 14:03:55.407966 359 raft_consensus.cc:504] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed2b79aff844eb39968f24d7f6ab7c2" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 37211 } }
I20240501 14:03:55.408721 32639 tablet_copy_client.cc:308] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:37211
I20240501 14:03:55.408677 359 leader_election.cc:302] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ed2b79aff844eb39968f24d7f6ab7c2; no voters:
I20240501 14:03:55.409312 359 leader_election.cc:288] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [CANDIDATE]: Term 4 election: Requested vote from peers
I20240501 14:03:55.409454 692 raft_consensus.cc:2781] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [term 4 FOLLOWER]: Leader election won for term 4
I20240501 14:03:55.409564 465 tablet_copy_service.cc:140] P 7ed2b79aff844eb39968f24d7f6ab7c2: Received BeginTabletCopySession request for tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec ({username='slave'} at 127.29.231.2:41765)
I20240501 14:03:55.409761 465 tablet_copy_service.cc:161] P 7ed2b79aff844eb39968f24d7f6ab7c2: Beginning new tablet copy session on tablet 639baa1976b54dd7a9968c285f78b7eb from peer b6f6ebcca5034c4183eb4a6f3f8891ec at {username='slave'} at 127.29.231.2:41765: session id = b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb
I20240501 14:03:55.410405 494 heartbeater.cc:503] Master 127.29.231.62:36819 was elected leader, sending a full tablet report...
I20240501 14:03:55.411358 359 ts_tablet_manager.cc:1398] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2: Time spent starting tablet: real 0.014s user 0.009s sys 0.004s
I20240501 14:03:55.415985 692 raft_consensus.cc:686] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [term 4 LEADER]: Becoming Leader. State: Replica: 7ed2b79aff844eb39968f24d7f6ab7c2, State: Running, Role: LEADER
I20240501 14:03:55.416499 692 consensus_queue.cc:237] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 217, Committed index: 217, Last appended: 3.217, Last appended by leader: 217, Current term: 4, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed2b79aff844eb39968f24d7f6ab7c2" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 37211 } }
I20240501 14:03:55.418808 465 tablet_copy_source_session.cc:205] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 14:03:55.420368 31019 catalog_manager.cc:5484] T 639baa1976b54dd7a9968c285f78b7eb P 7ed2b79aff844eb39968f24d7f6ab7c2 reported cstate change: term changed from 3 to 4. New cstate: current_term: 4 leader_uuid: "7ed2b79aff844eb39968f24d7f6ab7c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed2b79aff844eb39968f24d7f6ab7c2" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 37211 } health_report { overall_health: HEALTHY } } }
I20240501 14:03:55.423712 32639 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 639baa1976b54dd7a9968c285f78b7eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:03:55.434672 32639 tablet_copy_client.cc:783] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Starting download of 0 data blocks...
I20240501 14:03:55.435017 32639 tablet_copy_client.cc:647] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Starting download of 1 WAL segments...
I20240501 14:03:55.439144 32639 tablet_copy_client.cc:523] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 14:03:55.442229 32639 tablet_bootstrap.cc:492] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Bootstrap starting.
I20240501 14:03:55.507854 32639 log.cc:824] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Log is configured to *not* fsync() on all Append() calls
I20240501 14:03:56.048851 32639 tablet_bootstrap.cc:492] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Bootstrap replayed 1/1 log segments. Stats: ops{read=218 overwritten=0 applied=217 ignored=0} inserts{seen=10700 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20240501 14:03:56.049401 32639 tablet_bootstrap.cc:492] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Bootstrap complete.
I20240501 14:03:56.049892 32639 ts_tablet_manager.cc:1367] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Time spent bootstrapping tablet: real 0.608s user 0.531s sys 0.077s
I20240501 14:03:56.054867 32639 raft_consensus.cc:348] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec [term 4 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed2b79aff844eb39968f24d7f6ab7c2" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 37211 } }
I20240501 14:03:56.055554 32639 raft_consensus.cc:729] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec [term 4 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: b6f6ebcca5034c4183eb4a6f3f8891ec, State: Initialized, Role: NON_PARTICIPANT
I20240501 14:03:56.056140 32639 consensus_queue.cc:260] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 217, Last appended: 4.218, Last appended by leader: 218, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ed2b79aff844eb39968f24d7f6ab7c2" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 37211 } }
I20240501 14:03:56.057509 32639 ts_tablet_manager.cc:1398] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20240501 14:03:56.058436 465 tablet_copy_service.cc:342] P 7ed2b79aff844eb39968f24d7f6ab7c2: Request end of tablet copy session b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb received from {username='slave'} at 127.29.231.2:41765
I20240501 14:03:56.058580 465 tablet_copy_service.cc:433] P 7ed2b79aff844eb39968f24d7f6ab7c2: ending tablet copy session b6f6ebcca5034c4183eb4a6f3f8891ec-639baa1976b54dd7a9968c285f78b7eb on tablet 639baa1976b54dd7a9968c285f78b7eb with peer b6f6ebcca5034c4183eb4a6f3f8891ec
W20240501 14:03:56.060336 32639 ts_tablet_manager.cc:701] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Tablet Copy: Invalid argument: Leader has replica of tablet 639baa1976b54dd7a9968c285f78b7eb with term 0, which is lower than last-logged term 4 on local replica. Rejecting tablet copy request
W20240501 14:03:56.066080 32639 ts_tablet_manager.cc:701] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Tablet Copy: Invalid argument: Leader has replica of tablet 639baa1976b54dd7a9968c285f78b7eb with term 0, which is lower than last-logged term 4 on local replica. Rejecting tablet copy request
W20240501 14:03:56.066973 32639 ts_tablet_manager.cc:701] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Tablet Copy: Invalid argument: Leader has replica of tablet 639baa1976b54dd7a9968c285f78b7eb with term 0, which is lower than last-logged term 4 on local replica. Rejecting tablet copy request
I20240501 14:03:56.069264 32561 tablet_service.cc:1514] Processing DeleteTablet for tablet 639baa1976b54dd7a9968c285f78b7eb with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:53786
I20240501 14:03:56.069938 704 tablet_replica.cc:330] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: stopping tablet replica
I20240501 14:03:56.070336 704 raft_consensus.cc:2229] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec [term 4 NON_PARTICIPANT]: Raft consensus shutting down.
I20240501 14:03:56.070593 704 pending_rounds.cc:62] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Trying to abort 1 pending ops.
I20240501 14:03:56.070690 704 pending_rounds.cc:68] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Aborting op as it isn't in flight: id { term: 4 index: 218 } timestamp: 7022887876266958848 op_type: NO_OP noop_request { }
I20240501 14:03:56.070856 704 raft_consensus.cc:2866] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec [term 4 NON_PARTICIPANT]: NO_OP replication failed: Aborted: Op aborted
I20240501 14:03:56.070948 704 raft_consensus.cc:2258] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec [term 4 NON_PARTICIPANT]: Raft consensus is shut down!
I20240501 14:03:56.072086 704 ts_tablet_manager.cc:1875] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20240501 14:03:56.076282 704 ts_tablet_manager.cc:1888] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 4.218
I20240501 14:03:56.076422 704 log.cc:1196] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Deleting WAL directory at /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/wal/wals/639baa1976b54dd7a9968c285f78b7eb
I20240501 14:03:56.076869 704 ts_tablet_manager.cc:1909] T 639baa1976b54dd7a9968c285f78b7eb P b6f6ebcca5034c4183eb4a6f3f8891ec: Deleting consensus metadata
I20240501 14:03:56.078435 30620 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu pid 32499
I20240501 14:03:56.079385 32621 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 14:03:56.182266 30620 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu with pid 32499
I20240501 14:03:56.204512 30620 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
/tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.231.2:39057
--local_ip_for_outbound_sockets=127.29.231.2
--tserver_master_addrs=127.29.231.62:36819
--webserver_port=44439
--webserver_interface=127.29.231.2
--builtin_ntp_servers=127.29.231.20:34843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240501 14:03:56.526983 706 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 14:03:56.527271 706 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 14:03:56.527355 706 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 14:03:56.534832 706 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 14:03:56.535034 706 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.231.2
I20240501 14:03:56.543861 706 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.231.20:34843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.231.2:39057
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.231.2
--webserver_port=44439
--tserver_master_addrs=127.29.231.62:36819
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.231.2
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 13:43:20 UTC on efd1337a2aa3
build id 75
ASAN enabled
I20240501 14:03:56.545207 706 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 14:03:56.546896 706 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:03:56.559038 711 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:03:56.559491 714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:03:56.560114 712 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:03:56.560844 706 server_base.cc:1034] running on GCE node
I20240501 14:03:56.561425 706 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 14:03:56.562300 706 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 14:03:56.563514 706 hybrid_clock.cc:648] HybridClock initialized: now 1714572236563450 us; error 48 us; skew 500 ppm
I20240501 14:03:56.563792 706 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:03:56.569216 706 webserver.cc:460] Webserver started at http://127.29.231.2:44439/ using document root <none> and password file <none>
I20240501 14:03:56.569967 706 fs_manager.cc:359] Metadata directory not provided
I20240501 14:03:56.570107 706 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:03:56.575155 706 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20240501 14:03:56.577840 720 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:03:56.579113 706 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20240501 14:03:56.579277 706 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/wal
uuid: "b6f6ebcca5034c4183eb4a6f3f8891ec"
format_stamp: "Formatted at 2024-05-01 14:03:45 on dist-test-slave-4827"
I20240501 14:03:56.580116 706 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:03:56.597368 706 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:03:56.598201 706 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 14:03:56.598469 706 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:03:56.599403 706 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 14:03:56.600953 706 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 14:03:56.601050 706 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 14:03:56.601167 706 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 14:03:56.601238 706 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 14:03:56.632400 706 rpc_server.cc:307] RPC server started. Bound to: 127.29.231.2:39057
I20240501 14:03:56.632467 832 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.231.2:39057 every 8 connection(s)
I20240501 14:03:56.633852 706 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714572224537460-30620-0/minicluster-data/ts-1/data/info.pb
I20240501 14:03:56.642210 30620 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu as pid 706
I20240501 14:03:56.642707 30620 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu pid 32638
I20240501 14:03:56.646863 833 heartbeater.cc:347] Connected to a master server at 127.29.231.62:36819
I20240501 14:03:56.647176 833 heartbeater.cc:464] Registering TS with master...
I20240501 14:03:56.647986 833 heartbeater.cc:511] Master 127.29.231.62:36819 requested a full tablet report, sending...
I20240501 14:03:56.649714 31019 ts_manager.cc:194] Re-registered known tserver with Master: b6f6ebcca5034c4183eb4a6f3f8891ec (127.29.231.2:39057)
I20240501 14:03:56.649996 485 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 14:03:56.650527 31019 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.231.2:36185
I20240501 14:03:56.752988 30620 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu with pid 32638
I20240501 14:03:56.773594 30620 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu pid 706
I20240501 14:03:56.781852 828 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 14:03:56.862138 30620 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu with pid 706
I20240501 14:03:56.878959 30620 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu pid 30989
I20240501 14:03:56.880209 31051 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 14:03:56.986392 30620 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu with pid 30989
2024-05-01T14:03:57Z chronyd exiting
[ OK ] TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping (12421 ms)
[ RUN ] TabletCopyClientSessionITest.TestStartTabletCopy
2024-05-01T14:03:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-01T14:03:57Z Disabled control of system clock
I20240501 14:03:57.051352 30620 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
/tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.231.62:43029
--webserver_interface=127.29.231.62
--webserver_port=0
--builtin_ntp_servers=127.29.231.20:41731
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.231.62:43029
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240501 14:03:57.375681 846 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 14:03:57.376008 846 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 14:03:57.376113 846 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 14:03:57.383597 846 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240501 14:03:57.383723 846 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 14:03:57.383767 846 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240501 14:03:57.383824 846 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240501 14:03:57.392999 846 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.231.20:41731
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.29.231.62:43029
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.231.62:43029
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.231.62
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 13:43:20 UTC on efd1337a2aa3
build id 75
ASAN enabled
I20240501 14:03:57.394335 846 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 14:03:57.396003 846 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:03:57.406993 851 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:03:57.407636 852 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:03:57.408179 854 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:03:57.408957 846 server_base.cc:1034] running on GCE node
I20240501 14:03:57.409752 846 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 14:03:57.411146 846 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 14:03:57.412315 846 hybrid_clock.cc:648] HybridClock initialized: now 1714572237412250 us; error 47 us; skew 500 ppm
I20240501 14:03:57.412626 846 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:03:57.414866 846 webserver.cc:460] Webserver started at http://127.29.231.62:34125/ using document root <none> and password file <none>
I20240501 14:03:57.415563 846 fs_manager.cc:359] Metadata directory not provided
I20240501 14:03:57.415686 846 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:03:57.415974 846 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 14:03:57.418514 846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/master-0/data/instance:
uuid: "6409a174c7c04b48958d120112ee4a47"
format_stamp: "Formatted at 2024-05-01 14:03:57 on dist-test-slave-4827"
I20240501 14:03:57.419224 846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/master-0/wal/instance:
uuid: "6409a174c7c04b48958d120112ee4a47"
format_stamp: "Formatted at 2024-05-01 14:03:57 on dist-test-slave-4827"
I20240501 14:03:57.424185 846 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.006s
I20240501 14:03:57.427368 860 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:03:57.428704 846 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240501 14:03:57.428862 846 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/master-0/data,/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/master-0/wal
uuid: "6409a174c7c04b48958d120112ee4a47"
format_stamp: "Formatted at 2024-05-01 14:03:57 on dist-test-slave-4827"
I20240501 14:03:57.429030 846 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:03:57.450460 846 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:03:57.451298 846 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 14:03:57.451561 846 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:03:57.469161 846 rpc_server.cc:307] RPC server started. Bound to: 127.29.231.62:43029
I20240501 14:03:57.469189 911 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.231.62:43029 every 8 connection(s)
I20240501 14:03:57.470523 846 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/master-0/data/info.pb
I20240501 14:03:57.474174 912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:03:57.478418 30620 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu as pid 846
I20240501 14:03:57.478669 30620 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/master-0/wal/instance
I20240501 14:03:57.484431 912 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47: Bootstrap starting.
I20240501 14:03:57.487368 912 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47: Neither blocks nor log segments found. Creating new log.
I20240501 14:03:57.488489 912 log.cc:824] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47: Log is configured to *not* fsync() on all Append() calls
I20240501 14:03:57.491081 912 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47: No bootstrap required, opened a new log
I20240501 14:03:57.497573 912 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6409a174c7c04b48958d120112ee4a47" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 43029 } }
I20240501 14:03:57.497900 912 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:03:57.497968 912 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6409a174c7c04b48958d120112ee4a47, State: Initialized, Role: FOLLOWER
I20240501 14:03:57.498575 912 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6409a174c7c04b48958d120112ee4a47" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 43029 } }
I20240501 14:03:57.498764 912 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:03:57.498886 912 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:03:57.499025 912 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:03:57.501283 912 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6409a174c7c04b48958d120112ee4a47" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 43029 } }
I20240501 14:03:57.501765 912 leader_election.cc:302] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6409a174c7c04b48958d120112ee4a47; no voters:
I20240501 14:03:57.502319 912 leader_election.cc:288] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 14:03:57.502457 917 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:03:57.503059 917 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47 [term 1 LEADER]: Becoming Leader. State: Replica: 6409a174c7c04b48958d120112ee4a47, State: Running, Role: LEADER
I20240501 14:03:57.503590 917 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6409a174c7c04b48958d120112ee4a47" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 43029 } }
I20240501 14:03:57.504185 912 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47 [sys.catalog]: configured and running, proceeding with master startup.
I20240501 14:03:57.506220 919 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6409a174c7c04b48958d120112ee4a47. Latest consensus state: current_term: 1 leader_uuid: "6409a174c7c04b48958d120112ee4a47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6409a174c7c04b48958d120112ee4a47" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 43029 } } }
I20240501 14:03:57.506639 919 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47 [sys.catalog]: This master's current role is: LEADER
I20240501 14:03:57.507834 918 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6409a174c7c04b48958d120112ee4a47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6409a174c7c04b48958d120112ee4a47" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 43029 } } }
I20240501 14:03:57.508213 918 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47 [sys.catalog]: This master's current role is: LEADER
I20240501 14:03:57.508643 925 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240501 14:03:57.514096 925 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240501 14:03:57.522078 925 catalog_manager.cc:1347] Generated new cluster ID: 0ddcff40e44c42cf9c6db6326b4cfdf2
I20240501 14:03:57.522195 925 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240501 14:03:57.540735 925 catalog_manager.cc:1370] Generated new certificate authority record
I20240501 14:03:57.542403 925 catalog_manager.cc:1504] Loading token signing keys...
I20240501 14:03:57.572683 925 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47: Generated new TSK 0
I20240501 14:03:57.573779 925 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240501 14:03:57.584753 30620 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
/tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.231.1:0
--local_ip_for_outbound_sockets=127.29.231.1
--webserver_interface=127.29.231.1
--webserver_port=0
--tserver_master_addrs=127.29.231.62:43029
--builtin_ntp_servers=127.29.231.20:41731
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240501 14:03:57.908470 936 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 14:03:57.908767 936 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 14:03:57.908865 936 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 14:03:57.916431 936 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 14:03:57.916603 936 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.231.1
I20240501 14:03:57.925520 936 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.231.20:41731
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.231.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.231.1
--webserver_port=0
--tserver_master_addrs=127.29.231.62:43029
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.231.1
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 13:43:20 UTC on efd1337a2aa3
build id 75
ASAN enabled
I20240501 14:03:57.926820 936 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 14:03:57.928627 936 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:03:57.940788 942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:03:57.941282 941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:03:57.941890 944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:03:57.942878 936 server_base.cc:1034] running on GCE node
I20240501 14:03:57.943475 936 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 14:03:57.944375 936 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 14:03:57.945575 936 hybrid_clock.cc:648] HybridClock initialized: now 1714572237945510 us; error 41 us; skew 500 ppm
I20240501 14:03:57.945848 936 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:03:57.947970 936 webserver.cc:460] Webserver started at http://127.29.231.1:39155/ using document root <none> and password file <none>
I20240501 14:03:57.948704 936 fs_manager.cc:359] Metadata directory not provided
I20240501 14:03:57.948829 936 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:03:57.949123 936 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 14:03:57.951645 936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-0/data/instance:
uuid: "f079efd41aa34608b2834041e97217d7"
format_stamp: "Formatted at 2024-05-01 14:03:57 on dist-test-slave-4827"
I20240501 14:03:57.952419 936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-0/wal/instance:
uuid: "f079efd41aa34608b2834041e97217d7"
format_stamp: "Formatted at 2024-05-01 14:03:57 on dist-test-slave-4827"
I20240501 14:03:57.957391 936 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20240501 14:03:57.960709 950 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:03:57.961961 936 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20240501 14:03:57.962108 936 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-0/wal
uuid: "f079efd41aa34608b2834041e97217d7"
format_stamp: "Formatted at 2024-05-01 14:03:57 on dist-test-slave-4827"
I20240501 14:03:57.962292 936 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:03:57.979364 936 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:03:57.980202 936 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 14:03:57.980499 936 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:03:57.981380 936 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 14:03:57.982827 936 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 14:03:57.982897 936 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 14:03:57.982990 936 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 14:03:57.983032 936 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 14:03:58.018321 936 rpc_server.cc:307] RPC server started. Bound to: 127.29.231.1:34041
I20240501 14:03:58.018357 1062 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.231.1:34041 every 8 connection(s)
I20240501 14:03:58.019582 936 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-0/data/info.pb
I20240501 14:03:58.022555 30620 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu as pid 936
I20240501 14:03:58.022747 30620 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-0/wal/instance
I20240501 14:03:58.025705 30620 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
/tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.231.2:0
--local_ip_for_outbound_sockets=127.29.231.2
--webserver_interface=127.29.231.2
--webserver_port=0
--tserver_master_addrs=127.29.231.62:43029
--builtin_ntp_servers=127.29.231.20:41731
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240501 14:03:58.032122 1063 heartbeater.cc:347] Connected to a master server at 127.29.231.62:43029
I20240501 14:03:58.032435 1063 heartbeater.cc:464] Registering TS with master...
I20240501 14:03:58.033267 1063 heartbeater.cc:511] Master 127.29.231.62:43029 requested a full tablet report, sending...
I20240501 14:03:58.035287 877 ts_manager.cc:194] Registered new tserver with Master: f079efd41aa34608b2834041e97217d7 (127.29.231.1:34041)
I20240501 14:03:58.036837 877 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.231.1:50323
W20240501 14:03:58.352814 1067 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 14:03:58.353116 1067 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 14:03:58.353236 1067 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 14:03:58.360653 1067 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 14:03:58.360869 1067 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.231.2
I20240501 14:03:58.369904 1067 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.231.20:41731
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.231.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.231.2
--webserver_port=0
--tserver_master_addrs=127.29.231.62:43029
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.231.2
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 13:43:20 UTC on efd1337a2aa3
build id 75
ASAN enabled
I20240501 14:03:58.371234 1067 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 14:03:58.372995 1067 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:03:58.385401 1072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:03:58.386277 1067 server_base.cc:1034] running on GCE node
W20240501 14:03:58.386997 1073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:03:58.387497 1075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:03:58.388149 1067 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 14:03:58.389061 1067 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 14:03:58.390256 1067 hybrid_clock.cc:648] HybridClock initialized: now 1714572238390188 us; error 48 us; skew 500 ppm
I20240501 14:03:58.390555 1067 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:03:58.392773 1067 webserver.cc:460] Webserver started at http://127.29.231.2:34209/ using document root <none> and password file <none>
I20240501 14:03:58.393492 1067 fs_manager.cc:359] Metadata directory not provided
I20240501 14:03:58.393611 1067 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:03:58.393909 1067 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 14:03:58.396492 1067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-1/data/instance:
uuid: "b24321335b284e4286a20ac80518d332"
format_stamp: "Formatted at 2024-05-01 14:03:58 on dist-test-slave-4827"
I20240501 14:03:58.397224 1067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-1/wal/instance:
uuid: "b24321335b284e4286a20ac80518d332"
format_stamp: "Formatted at 2024-05-01 14:03:58 on dist-test-slave-4827"
I20240501 14:03:58.402184 1067 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20240501 14:03:58.405687 1081 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:03:58.406934 1067 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20240501 14:03:58.407069 1067 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-1/wal
uuid: "b24321335b284e4286a20ac80518d332"
format_stamp: "Formatted at 2024-05-01 14:03:58 on dist-test-slave-4827"
I20240501 14:03:58.407244 1067 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:03:58.427795 1067 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:03:58.428691 1067 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 14:03:58.428936 1067 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:03:58.429841 1067 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 14:03:58.431280 1067 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 14:03:58.431356 1067 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 14:03:58.431450 1067 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 14:03:58.431492 1067 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 14:03:58.462225 1067 rpc_server.cc:307] RPC server started. Bound to: 127.29.231.2:35805
I20240501 14:03:58.462266 1193 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.231.2:35805 every 8 connection(s)
I20240501 14:03:58.463917 1067 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-1/data/info.pb
I20240501 14:03:58.464453 30620 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu as pid 1067
I20240501 14:03:58.464661 30620 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-1/wal/instance
I20240501 14:03:58.476701 1194 heartbeater.cc:347] Connected to a master server at 127.29.231.62:43029
I20240501 14:03:58.476974 1194 heartbeater.cc:464] Registering TS with master...
I20240501 14:03:58.477723 1194 heartbeater.cc:511] Master 127.29.231.62:43029 requested a full tablet report, sending...
I20240501 14:03:58.479087 877 ts_manager.cc:194] Registered new tserver with Master: b24321335b284e4286a20ac80518d332 (127.29.231.2:35805)
I20240501 14:03:58.480149 877 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.231.2:58961
I20240501 14:03:58.480487 30620 external_mini_cluster.cc:930] 2 TS(s) registered with all masters
I20240501 14:03:58.493470 30620 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu pid 1067
I20240501 14:03:58.500984 1189 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 14:03:58.591519 30620 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu with pid 1067
I20240501 14:03:58.607741 30620 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu pid 846
I20240501 14:03:58.608927 907 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 14:03:58.706774 30620 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu with pid 846
I20240501 14:03:58.727130 30620 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
/tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.231.62:43029
--webserver_interface=127.29.231.62
--webserver_port=34125
--builtin_ntp_servers=127.29.231.20:41731
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.231.62:43029
--master_tombstone_evicted_tablet_replicas=false with env {}
I20240501 14:03:59.039584 1063 heartbeater.cc:503] Master 127.29.231.62:43029 was elected leader, sending a full tablet report...
W20240501 14:03:59.041062 1063 heartbeater.cc:644] Failed to heartbeat to 127.29.231.62:43029 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.29.231.62:43029: connect: Connection refused (error 111)
W20240501 14:03:59.052435 1206 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 14:03:59.052747 1206 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 14:03:59.052871 1206 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 14:03:59.060423 1206 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240501 14:03:59.060554 1206 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 14:03:59.060634 1206 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240501 14:03:59.060719 1206 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240501 14:03:59.069914 1206 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.231.20:41731
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.29.231.62:43029
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.231.62:43029
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.231.62
--webserver_port=34125
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 13:43:20 UTC on efd1337a2aa3
build id 75
ASAN enabled
I20240501 14:03:59.071292 1206 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 14:03:59.073068 1206 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:03:59.084533 1215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:03:59.085086 1212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:03:59.085769 1213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:03:59.086504 1206 server_base.cc:1034] running on GCE node
I20240501 14:03:59.087286 1206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 14:03:59.088739 1206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 14:03:59.089951 1206 hybrid_clock.cc:648] HybridClock initialized: now 1714572239089890 us; error 43 us; skew 500 ppm
I20240501 14:03:59.090269 1206 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:03:59.092489 1206 webserver.cc:460] Webserver started at http://127.29.231.62:34125/ using document root <none> and password file <none>
I20240501 14:03:59.093195 1206 fs_manager.cc:359] Metadata directory not provided
I20240501 14:03:59.093336 1206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:03:59.098508 1206 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20240501 14:03:59.101294 1221 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:03:59.102530 1206 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240501 14:03:59.102689 1206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/master-0/data,/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/master-0/wal
uuid: "6409a174c7c04b48958d120112ee4a47"
format_stamp: "Formatted at 2024-05-01 14:03:57 on dist-test-slave-4827"
I20240501 14:03:59.103497 1206 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:03:59.124724 1206 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:03:59.125880 1206 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 14:03:59.126197 1206 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:03:59.147887 1272 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.231.62:43029 every 8 connection(s)
I20240501 14:03:59.147929 1206 rpc_server.cc:307] RPC server started. Bound to: 127.29.231.62:43029
I20240501 14:03:59.150291 1206 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/master-0/data/info.pb
I20240501 14:03:59.155148 30620 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu as pid 1206
I20240501 14:03:59.157801 1273 sys_catalog.cc:263] Verifying existing consensus state
I20240501 14:03:59.162945 1273 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47: Bootstrap starting.
I20240501 14:03:59.180014 1273 log.cc:824] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47: Log is configured to *not* fsync() on all Append() calls
I20240501 14:03:59.187948 1273 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:03:59.188450 1273 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47: Bootstrap complete.
I20240501 14:03:59.195103 1273 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6409a174c7c04b48958d120112ee4a47" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 43029 } }
I20240501 14:03:59.195782 1273 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6409a174c7c04b48958d120112ee4a47, State: Initialized, Role: FOLLOWER
I20240501 14:03:59.196411 1273 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6409a174c7c04b48958d120112ee4a47" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 43029 } }
I20240501 14:03:59.196628 1273 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:03:59.196745 1273 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:03:59.196911 1273 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:03:59.200634 1273 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6409a174c7c04b48958d120112ee4a47" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 43029 } }
I20240501 14:03:59.201077 1273 leader_election.cc:302] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6409a174c7c04b48958d120112ee4a47; no voters:
I20240501 14:03:59.201582 1273 leader_election.cc:288] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 14:03:59.201725 1278 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:03:59.202435 1278 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47 [term 2 LEADER]: Becoming Leader. State: Replica: 6409a174c7c04b48958d120112ee4a47, State: Running, Role: LEADER
I20240501 14:03:59.202981 1278 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6409a174c7c04b48958d120112ee4a47" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 43029 } }
I20240501 14:03:59.203642 1273 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47 [sys.catalog]: configured and running, proceeding with master startup.
I20240501 14:03:59.205446 1279 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "6409a174c7c04b48958d120112ee4a47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6409a174c7c04b48958d120112ee4a47" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 43029 } } }
I20240501 14:03:59.205888 1279 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47 [sys.catalog]: This master's current role is: LEADER
I20240501 14:03:59.206393 1280 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6409a174c7c04b48958d120112ee4a47. Latest consensus state: current_term: 2 leader_uuid: "6409a174c7c04b48958d120112ee4a47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6409a174c7c04b48958d120112ee4a47" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 43029 } } }
I20240501 14:03:59.206709 1280 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47 [sys.catalog]: This master's current role is: LEADER
I20240501 14:03:59.206758 1285 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240501 14:03:59.211686 1285 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240501 14:03:59.212708 1285 catalog_manager.cc:1259] Loaded cluster ID: 0ddcff40e44c42cf9c6db6326b4cfdf2
I20240501 14:03:59.212797 1285 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240501 14:03:59.215631 1285 catalog_manager.cc:1504] Loading token signing keys...
I20240501 14:03:59.216939 1285 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6409a174c7c04b48958d120112ee4a47: Loaded TSK: 0
I20240501 14:03:59.218593 1285 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240501 14:04:00.047210 1063 heartbeater.cc:347] Connected to a master server at 127.29.231.62:43029
I20240501 14:04:00.047427 1063 heartbeater.cc:503] Master 127.29.231.62:43029 was elected leader, sending a full tablet report...
I20240501 14:04:00.049247 1238 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "f079efd41aa34608b2834041e97217d7" instance_seqno: 1714572238010408) as {username='slave'} at 127.29.231.1:40935; Asking this server to re-register.
I20240501 14:04:00.049945 1063 heartbeater.cc:464] Registering TS with master...
I20240501 14:04:00.050190 1063 heartbeater.cc:511] Master 127.29.231.62:43029 requested a full tablet report, sending...
I20240501 14:04:00.051293 1237 ts_manager.cc:194] Registered new tserver with Master: f079efd41aa34608b2834041e97217d7 (127.29.231.1:34041)
I20240501 14:04:00.062780 30620 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20240501 14:04:00.062953 30620 test_util.cc:268] Using random seed: -179336743
I20240501 14:04:00.081456 1237 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53066:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20240501 14:04:00.103603 998 tablet_service.cc:1467] Processing CreateTablet for tablet 9dc1d19b1f1d466b8b690f36ce809f7f (DEFAULT_TABLE table=test-workload [id=8dff0b663c5041caab3f2ba8bcf3156b]), partition=RANGE (key) PARTITION UNBOUNDED
I20240501 14:04:00.104897 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9dc1d19b1f1d466b8b690f36ce809f7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:00.114671 1308 tablet_bootstrap.cc:492] T 9dc1d19b1f1d466b8b690f36ce809f7f P f079efd41aa34608b2834041e97217d7: Bootstrap starting.
I20240501 14:04:00.117512 1308 tablet_bootstrap.cc:654] T 9dc1d19b1f1d466b8b690f36ce809f7f P f079efd41aa34608b2834041e97217d7: Neither blocks nor log segments found. Creating new log.
I20240501 14:04:00.118474 1308 log.cc:824] T 9dc1d19b1f1d466b8b690f36ce809f7f P f079efd41aa34608b2834041e97217d7: Log is configured to *not* fsync() on all Append() calls
I20240501 14:04:00.120697 1308 tablet_bootstrap.cc:492] T 9dc1d19b1f1d466b8b690f36ce809f7f P f079efd41aa34608b2834041e97217d7: No bootstrap required, opened a new log
I20240501 14:04:00.120921 1308 ts_tablet_manager.cc:1367] T 9dc1d19b1f1d466b8b690f36ce809f7f P f079efd41aa34608b2834041e97217d7: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20240501 14:04:00.126688 1308 raft_consensus.cc:348] T 9dc1d19b1f1d466b8b690f36ce809f7f P f079efd41aa34608b2834041e97217d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f079efd41aa34608b2834041e97217d7" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 34041 } }
I20240501 14:04:00.126981 1308 raft_consensus.cc:374] T 9dc1d19b1f1d466b8b690f36ce809f7f P f079efd41aa34608b2834041e97217d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:04:00.127071 1308 raft_consensus.cc:729] T 9dc1d19b1f1d466b8b690f36ce809f7f P f079efd41aa34608b2834041e97217d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f079efd41aa34608b2834041e97217d7, State: Initialized, Role: FOLLOWER
I20240501 14:04:00.127614 1308 consensus_queue.cc:260] T 9dc1d19b1f1d466b8b690f36ce809f7f P f079efd41aa34608b2834041e97217d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f079efd41aa34608b2834041e97217d7" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 34041 } }
I20240501 14:04:00.127805 1308 raft_consensus.cc:388] T 9dc1d19b1f1d466b8b690f36ce809f7f P f079efd41aa34608b2834041e97217d7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:00.127916 1308 raft_consensus.cc:482] T 9dc1d19b1f1d466b8b690f36ce809f7f P f079efd41aa34608b2834041e97217d7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:00.128054 1308 raft_consensus.cc:3037] T 9dc1d19b1f1d466b8b690f36ce809f7f P f079efd41aa34608b2834041e97217d7 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:04:00.129926 1308 raft_consensus.cc:504] T 9dc1d19b1f1d466b8b690f36ce809f7f P f079efd41aa34608b2834041e97217d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f079efd41aa34608b2834041e97217d7" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 34041 } }
I20240501 14:04:00.130393 1308 leader_election.cc:302] T 9dc1d19b1f1d466b8b690f36ce809f7f P f079efd41aa34608b2834041e97217d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f079efd41aa34608b2834041e97217d7; no voters:
I20240501 14:04:00.130918 1308 leader_election.cc:288] T 9dc1d19b1f1d466b8b690f36ce809f7f P f079efd41aa34608b2834041e97217d7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 14:04:00.131052 1310 raft_consensus.cc:2781] T 9dc1d19b1f1d466b8b690f36ce809f7f P f079efd41aa34608b2834041e97217d7 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:04:00.132545 1308 ts_tablet_manager.cc:1398] T 9dc1d19b1f1d466b8b690f36ce809f7f P f079efd41aa34608b2834041e97217d7: Time spent starting tablet: real 0.012s user 0.007s sys 0.005s
I20240501 14:04:00.132687 1310 raft_consensus.cc:686] T 9dc1d19b1f1d466b8b690f36ce809f7f P f079efd41aa34608b2834041e97217d7 [term 1 LEADER]: Becoming Leader. State: Replica: f079efd41aa34608b2834041e97217d7, State: Running, Role: LEADER
I20240501 14:04:00.133105 1310 consensus_queue.cc:237] T 9dc1d19b1f1d466b8b690f36ce809f7f P f079efd41aa34608b2834041e97217d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f079efd41aa34608b2834041e97217d7" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 34041 } }
I20240501 14:04:00.138056 1237 catalog_manager.cc:5484] T 9dc1d19b1f1d466b8b690f36ce809f7f P f079efd41aa34608b2834041e97217d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to f079efd41aa34608b2834041e97217d7 (127.29.231.1). New cstate: current_term: 1 leader_uuid: "f079efd41aa34608b2834041e97217d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f079efd41aa34608b2834041e97217d7" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 34041 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:00.728169 30620 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
/tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.231.2:35805
--local_ip_for_outbound_sockets=127.29.231.2
--tserver_master_addrs=127.29.231.62:43029
--webserver_port=34209
--webserver_interface=127.29.231.2
--builtin_ntp_servers=127.29.231.20:41731
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240501 14:04:01.051544 1326 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 14:04:01.051829 1326 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 14:04:01.051915 1326 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 14:04:01.059535 1326 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 14:04:01.059731 1326 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.231.2
I20240501 14:04:01.068943 1326 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.231.20:41731
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.231.2:35805
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.231.2
--webserver_port=34209
--tserver_master_addrs=127.29.231.62:43029
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.231.2
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 13:43:20 UTC on efd1337a2aa3
build id 75
ASAN enabled
I20240501 14:04:01.070276 1326 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 14:04:01.071967 1326 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:04:01.084549 1331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:04:01.085121 1334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:04:01.085851 1332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:04:01.086627 1326 server_base.cc:1034] running on GCE node
I20240501 14:04:01.087255 1326 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 14:04:01.088275 1326 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 14:04:01.089524 1326 hybrid_clock.cc:648] HybridClock initialized: now 1714572241089461 us; error 39 us; skew 500 ppm
I20240501 14:04:01.089846 1326 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:04:01.092133 1326 webserver.cc:460] Webserver started at http://127.29.231.2:34209/ using document root <none> and password file <none>
I20240501 14:04:01.092921 1326 fs_manager.cc:359] Metadata directory not provided
I20240501 14:04:01.093070 1326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:04:01.098464 1326 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20240501 14:04:01.101261 1340 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:04:01.102679 1326 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20240501 14:04:01.102838 1326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-1/wal
uuid: "b24321335b284e4286a20ac80518d332"
format_stamp: "Formatted at 2024-05-01 14:03:58 on dist-test-slave-4827"
I20240501 14:04:01.103693 1326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:04:01.130343 1326 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:04:01.131222 1326 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 14:04:01.131503 1326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:04:01.132645 1326 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 14:04:01.134164 1326 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 14:04:01.134261 1326 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 14:04:01.134380 1326 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 14:04:01.134459 1326 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 14:04:01.164058 1326 rpc_server.cc:307] RPC server started. Bound to: 127.29.231.2:35805
I20240501 14:04:01.164108 1452 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.231.2:35805 every 8 connection(s)
I20240501 14:04:01.165514 1326 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-1/data/info.pb
I20240501 14:04:01.166852 30620 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu as pid 1326
I20240501 14:04:01.178640 1453 heartbeater.cc:347] Connected to a master server at 127.29.231.62:43029
I20240501 14:04:01.178963 1453 heartbeater.cc:464] Registering TS with master...
I20240501 14:04:01.179818 1453 heartbeater.cc:511] Master 127.29.231.62:43029 requested a full tablet report, sending...
I20240501 14:04:01.180279 1458 ts_tablet_manager.cc:902] T 9dc1d19b1f1d466b8b690f36ce809f7f P b24321335b284e4286a20ac80518d332: Initiating tablet copy from peer f079efd41aa34608b2834041e97217d7 (127.29.231.1:34041)
I20240501 14:04:01.181407 1231 ts_manager.cc:194] Registered new tserver with Master: b24321335b284e4286a20ac80518d332 (127.29.231.2:35805)
I20240501 14:04:01.183537 1231 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.231.2:52733
I20240501 14:04:01.183856 1458 tablet_copy_client.cc:308] T 9dc1d19b1f1d466b8b690f36ce809f7f P b24321335b284e4286a20ac80518d332: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:34041
I20240501 14:04:01.189545 1038 tablet_copy_service.cc:140] P f079efd41aa34608b2834041e97217d7: Received BeginTabletCopySession request for tablet 9dc1d19b1f1d466b8b690f36ce809f7f from peer b24321335b284e4286a20ac80518d332 ({username='slave'} at 127.29.231.2:51109)
I20240501 14:04:01.189730 1038 tablet_copy_service.cc:161] P f079efd41aa34608b2834041e97217d7: Beginning new tablet copy session on tablet 9dc1d19b1f1d466b8b690f36ce809f7f from peer b24321335b284e4286a20ac80518d332 at {username='slave'} at 127.29.231.2:51109: session id = b24321335b284e4286a20ac80518d332-9dc1d19b1f1d466b8b690f36ce809f7f
I20240501 14:04:01.192171 1038 tablet_copy_source_session.cc:205] T 9dc1d19b1f1d466b8b690f36ce809f7f P f079efd41aa34608b2834041e97217d7: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 14:04:01.196198 1458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9dc1d19b1f1d466b8b690f36ce809f7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:01.206197 1458 tablet_copy_client.cc:783] T 9dc1d19b1f1d466b8b690f36ce809f7f P b24321335b284e4286a20ac80518d332: tablet copy: Starting download of 0 data blocks...
I20240501 14:04:01.206434 1458 tablet_copy_client.cc:647] T 9dc1d19b1f1d466b8b690f36ce809f7f P b24321335b284e4286a20ac80518d332: tablet copy: Starting download of 1 WAL segments...
I20240501 14:04:01.210916 1458 tablet_copy_client.cc:523] T 9dc1d19b1f1d466b8b690f36ce809f7f P b24321335b284e4286a20ac80518d332: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 14:04:01.213892 1458 tablet_bootstrap.cc:492] T 9dc1d19b1f1d466b8b690f36ce809f7f P b24321335b284e4286a20ac80518d332: Bootstrap starting.
I20240501 14:04:01.275741 1458 log.cc:824] T 9dc1d19b1f1d466b8b690f36ce809f7f P b24321335b284e4286a20ac80518d332: Log is configured to *not* fsync() on all Append() calls
I20240501 14:04:01.762218 1458 tablet_bootstrap.cc:492] T 9dc1d19b1f1d466b8b690f36ce809f7f P b24321335b284e4286a20ac80518d332: Bootstrap replayed 1/1 log segments. Stats: ops{read=209 overwritten=0 applied=209 ignored=0} inserts{seen=10400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:04:01.762676 1458 tablet_bootstrap.cc:492] T 9dc1d19b1f1d466b8b690f36ce809f7f P b24321335b284e4286a20ac80518d332: Bootstrap complete.
I20240501 14:04:01.763144 1458 ts_tablet_manager.cc:1367] T 9dc1d19b1f1d466b8b690f36ce809f7f P b24321335b284e4286a20ac80518d332: Time spent bootstrapping tablet: real 0.549s user 0.524s sys 0.024s
I20240501 14:04:01.767508 1458 raft_consensus.cc:348] T 9dc1d19b1f1d466b8b690f36ce809f7f P b24321335b284e4286a20ac80518d332 [term 1 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f079efd41aa34608b2834041e97217d7" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 34041 } }
I20240501 14:04:01.767838 1458 raft_consensus.cc:729] T 9dc1d19b1f1d466b8b690f36ce809f7f P b24321335b284e4286a20ac80518d332 [term 1 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: b24321335b284e4286a20ac80518d332, State: Initialized, Role: NON_PARTICIPANT
I20240501 14:04:01.768302 1458 consensus_queue.cc:260] T 9dc1d19b1f1d466b8b690f36ce809f7f P b24321335b284e4286a20ac80518d332 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 209, Last appended: 1.209, Last appended by leader: 209, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f079efd41aa34608b2834041e97217d7" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 34041 } }
I20240501 14:04:01.769223 1453 heartbeater.cc:503] Master 127.29.231.62:43029 was elected leader, sending a full tablet report...
I20240501 14:04:01.769651 1458 ts_tablet_manager.cc:1398] T 9dc1d19b1f1d466b8b690f36ce809f7f P b24321335b284e4286a20ac80518d332: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20240501 14:04:01.770663 1038 tablet_copy_service.cc:342] P f079efd41aa34608b2834041e97217d7: Request end of tablet copy session b24321335b284e4286a20ac80518d332-9dc1d19b1f1d466b8b690f36ce809f7f received from {username='slave'} at 127.29.231.2:51109
I20240501 14:04:01.770829 1038 tablet_copy_service.cc:433] P f079efd41aa34608b2834041e97217d7: ending tablet copy session b24321335b284e4286a20ac80518d332-9dc1d19b1f1d466b8b690f36ce809f7f on tablet 9dc1d19b1f1d466b8b690f36ce809f7f with peer b24321335b284e4286a20ac80518d332
I20240501 14:04:01.772414 1388 tablet_service.cc:1514] Processing DeleteTablet for tablet 9dc1d19b1f1d466b8b690f36ce809f7f with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:44398
I20240501 14:04:01.773135 1465 tablet_replica.cc:330] T 9dc1d19b1f1d466b8b690f36ce809f7f P b24321335b284e4286a20ac80518d332: stopping tablet replica
I20240501 14:04:01.773572 1465 raft_consensus.cc:2229] T 9dc1d19b1f1d466b8b690f36ce809f7f P b24321335b284e4286a20ac80518d332 [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20240501 14:04:01.773913 1465 raft_consensus.cc:2258] T 9dc1d19b1f1d466b8b690f36ce809f7f P b24321335b284e4286a20ac80518d332 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20240501 14:04:01.775414 1465 ts_tablet_manager.cc:1875] T 9dc1d19b1f1d466b8b690f36ce809f7f P b24321335b284e4286a20ac80518d332: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 14:04:01.779652 1465 ts_tablet_manager.cc:1888] T 9dc1d19b1f1d466b8b690f36ce809f7f P b24321335b284e4286a20ac80518d332: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.209
I20240501 14:04:01.779799 1465 log.cc:1196] T 9dc1d19b1f1d466b8b690f36ce809f7f P b24321335b284e4286a20ac80518d332: Deleting WAL directory at /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714572224537460-30620-0/minicluster-data/ts-1/wal/wals/9dc1d19b1f1d466b8b690f36ce809f7f
I20240501 14:04:01.781581 1458 ts_tablet_manager.cc:902] T 9dc1d19b1f1d466b8b690f36ce809f7f P b24321335b284e4286a20ac80518d332: Initiating tablet copy from peer f079efd41aa34608b2834041e97217d7 (127.29.231.1:34041)
I20240501 14:04:01.782593 1458 tablet_copy_client.cc:308] T 9dc1d19b1f1d466b8b690f36ce809f7f P b24321335b284e4286a20ac80518d332: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:34041
I20240501 14:04:01.783210 1038 tablet_copy_service.cc:140] P f079efd41aa34608b2834041e97217d7: Received BeginTabletCopySession request for tablet 9dc1d19b1f1d466b8b690f36ce809f7f from peer b24321335b284e4286a20ac80518d332 ({username='slave'} at 127.29.231.2:51109)
I20240501 14:04:01.783387 1038 tablet_copy_service.cc:161] P f079efd41aa34608b2834041e97217d7: Beginning new tablet copy session on tablet 9dc1d19b1f1d466b8b690f36ce809f7f from peer b24321335b284e4286a20ac80518d332 at {username='slave'} at 127.29.231.2:51109: session id = b24321335b284e4286a20ac80518d332-9dc1d19b1f1d466b8b690f36ce809f7f
I20240501 14:04:01.785312 1038 tablet_copy_source_session.cc:205] T 9dc1d19b1f1d466b8b690f36ce809f7f P f079efd41aa34608b2834041e97217d7: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 14:04:01.786069 1458 ts_tablet_manager.cc:1875] T 9dc1d19b1f1d466b8b690f36ce809f7f P b24321335b284e4286a20ac80518d332: Deleting tablet data with delete state TABLET_DATA_COPYING
I20240501 14:04:01.790048 1458 ts_tablet_manager.cc:1888] T 9dc1d19b1f1d466b8b690f36ce809f7f P b24321335b284e4286a20ac80518d332: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.209
I20240501 14:04:01.790298 1458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9dc1d19b1f1d466b8b690f36ce809f7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:01.792353 1458 tablet_copy_client.cc:783] T 9dc1d19b1f1d466b8b690f36ce809f7f P b24321335b284e4286a20ac80518d332: tablet copy: Starting download of 0 data blocks...
I20240501 14:04:01.792558 1458 tablet_copy_client.cc:647] T 9dc1d19b1f1d466b8b690f36ce809f7f P b24321335b284e4286a20ac80518d332: tablet copy: Starting download of 1 WAL segments...
I20240501 14:04:01.795923 1458 tablet_copy_client.cc:523] T 9dc1d19b1f1d466b8b690f36ce809f7f P b24321335b284e4286a20ac80518d332: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 14:04:01.798213 1458 tablet_bootstrap.cc:492] T 9dc1d19b1f1d466b8b690f36ce809f7f P b24321335b284e4286a20ac80518d332: Bootstrap starting.
I20240501 14:04:02.333734 1458 tablet_bootstrap.cc:492] T 9dc1d19b1f1d466b8b690f36ce809f7f P b24321335b284e4286a20ac80518d332: Bootstrap replayed 1/1 log segments. Stats: ops{read=209 overwritten=0 applied=209 ignored=0} inserts{seen=10400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:04:02.334144 1458 tablet_bootstrap.cc:492] T 9dc1d19b1f1d466b8b690f36ce809f7f P b24321335b284e4286a20ac80518d332: Bootstrap complete.
I20240501 14:04:02.334455 1458 ts_tablet_manager.cc:1367] T 9dc1d19b1f1d466b8b690f36ce809f7f P b24321335b284e4286a20ac80518d332: Time spent bootstrapping tablet: real 0.536s user 0.500s sys 0.036s
I20240501 14:04:02.335227 1458 raft_consensus.cc:348] T 9dc1d19b1f1d466b8b690f36ce809f7f P b24321335b284e4286a20ac80518d332 [term 1 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f079efd41aa34608b2834041e97217d7" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 34041 } }
I20240501 14:04:02.335408 1458 raft_consensus.cc:729] T 9dc1d19b1f1d466b8b690f36ce809f7f P b24321335b284e4286a20ac80518d332 [term 1 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: b24321335b284e4286a20ac80518d332, State: Initialized, Role: NON_PARTICIPANT
I20240501 14:04:02.335618 1458 consensus_queue.cc:260] T 9dc1d19b1f1d466b8b690f36ce809f7f P b24321335b284e4286a20ac80518d332 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 209, Last appended: 1.209, Last appended by leader: 209, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f079efd41aa34608b2834041e97217d7" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 34041 } }
I20240501 14:04:02.336407 1458 ts_tablet_manager.cc:1398] T 9dc1d19b1f1d466b8b690f36ce809f7f P b24321335b284e4286a20ac80518d332: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
I20240501 14:04:02.337224 1038 tablet_copy_service.cc:342] P f079efd41aa34608b2834041e97217d7: Request end of tablet copy session b24321335b284e4286a20ac80518d332-9dc1d19b1f1d466b8b690f36ce809f7f received from {username='slave'} at 127.29.231.2:51109
I20240501 14:04:02.337363 1038 tablet_copy_service.cc:433] P f079efd41aa34608b2834041e97217d7: ending tablet copy session b24321335b284e4286a20ac80518d332-9dc1d19b1f1d466b8b690f36ce809f7f on tablet 9dc1d19b1f1d466b8b690f36ce809f7f with peer b24321335b284e4286a20ac80518d332
I20240501 14:04:02.337754 30620 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu pid 936
I20240501 14:04:02.339123 1058 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 14:04:02.436012 30620 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu with pid 936
I20240501 14:04:02.455308 30620 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu pid 1326
I20240501 14:04:02.456471 1448 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 14:04:02.568770 30620 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu with pid 1326
I20240501 14:04:02.588738 30620 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu pid 1206
I20240501 14:04:02.589855 1268 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 14:04:02.691557 30620 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu with pid 1206
2024-05-01T14:04:02Z chronyd exiting
[ OK ] TabletCopyClientSessionITest.TestStartTabletCopy (5704 ms)
[ RUN ] TabletCopyClientSessionITest.TestCopyFromCrashedSource
2024-05-01T14:04:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-01T14:04:02Z Disabled control of system clock
I20240501 14:04:02.756616 30620 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
/tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.231.62:38015
--webserver_interface=127.29.231.62
--webserver_port=0
--builtin_ntp_servers=127.29.231.20:40099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.231.62:38015
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240501 14:04:03.075546 1478 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 14:04:03.075860 1478 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 14:04:03.075995 1478 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 14:04:03.083474 1478 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240501 14:04:03.083586 1478 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 14:04:03.083662 1478 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240501 14:04:03.083748 1478 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240501 14:04:03.092814 1478 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.231.20:40099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.29.231.62:38015
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.231.62:38015
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.231.62
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 13:43:20 UTC on efd1337a2aa3
build id 75
ASAN enabled
I20240501 14:04:03.094202 1478 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 14:04:03.095908 1478 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:04:03.106808 1483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:04:03.107498 1484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:04:03.108016 1486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:04:03.108706 1478 server_base.cc:1034] running on GCE node
I20240501 14:04:03.109467 1478 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 14:04:03.110826 1478 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 14:04:03.112043 1478 hybrid_clock.cc:648] HybridClock initialized: now 1714572243111982 us; error 36 us; skew 500 ppm
I20240501 14:04:03.112402 1478 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:04:03.117875 1478 webserver.cc:460] Webserver started at http://127.29.231.62:33707/ using document root <none> and password file <none>
I20240501 14:04:03.118623 1478 fs_manager.cc:359] Metadata directory not provided
I20240501 14:04:03.118752 1478 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:04:03.119036 1478 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 14:04:03.121690 1478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/master-0/data/instance:
uuid: "39d620203ed7405ba785084c28686f43"
format_stamp: "Formatted at 2024-05-01 14:04:03 on dist-test-slave-4827"
I20240501 14:04:03.122442 1478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/master-0/wal/instance:
uuid: "39d620203ed7405ba785084c28686f43"
format_stamp: "Formatted at 2024-05-01 14:04:03 on dist-test-slave-4827"
I20240501 14:04:03.127636 1478 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20240501 14:04:03.130801 1492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:04:03.132006 1478 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240501 14:04:03.132189 1478 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/master-0/data,/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/master-0/wal
uuid: "39d620203ed7405ba785084c28686f43"
format_stamp: "Formatted at 2024-05-01 14:04:03 on dist-test-slave-4827"
I20240501 14:04:03.132388 1478 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:04:03.147326 1478 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:04:03.148064 1478 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 14:04:03.148387 1478 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:04:03.164710 1478 rpc_server.cc:307] RPC server started. Bound to: 127.29.231.62:38015
I20240501 14:04:03.164734 1543 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.231.62:38015 every 8 connection(s)
I20240501 14:04:03.166041 1478 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/master-0/data/info.pb
I20240501 14:04:03.169842 1544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:03.174876 30620 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu as pid 1478
I20240501 14:04:03.175128 30620 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/master-0/wal/instance
I20240501 14:04:03.179454 1544 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43: Bootstrap starting.
I20240501 14:04:03.182463 1544 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43: Neither blocks nor log segments found. Creating new log.
I20240501 14:04:03.183472 1544 log.cc:824] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43: Log is configured to *not* fsync() on all Append() calls
I20240501 14:04:03.186276 1544 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43: No bootstrap required, opened a new log
I20240501 14:04:03.192727 1544 raft_consensus.cc:348] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39d620203ed7405ba785084c28686f43" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 38015 } }
I20240501 14:04:03.193073 1544 raft_consensus.cc:374] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:04:03.193171 1544 raft_consensus.cc:729] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39d620203ed7405ba785084c28686f43, State: Initialized, Role: FOLLOWER
I20240501 14:04:03.193739 1544 consensus_queue.cc:260] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39d620203ed7405ba785084c28686f43" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 38015 } }
I20240501 14:04:03.193933 1544 raft_consensus.cc:388] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:03.194056 1544 raft_consensus.cc:482] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:03.194198 1544 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:04:03.196522 1544 raft_consensus.cc:504] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39d620203ed7405ba785084c28686f43" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 38015 } }
I20240501 14:04:03.196996 1544 leader_election.cc:302] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 39d620203ed7405ba785084c28686f43; no voters:
I20240501 14:04:03.197535 1544 leader_election.cc:288] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 14:04:03.197649 1549 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:04:03.198885 1549 raft_consensus.cc:686] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43 [term 1 LEADER]: Becoming Leader. State: Replica: 39d620203ed7405ba785084c28686f43, State: Running, Role: LEADER
I20240501 14:04:03.199364 1549 consensus_queue.cc:237] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39d620203ed7405ba785084c28686f43" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 38015 } }
I20240501 14:04:03.199571 1544 sys_catalog.cc:564] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43 [sys.catalog]: configured and running, proceeding with master startup.
I20240501 14:04:03.202325 1551 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39d620203ed7405ba785084c28686f43. Latest consensus state: current_term: 1 leader_uuid: "39d620203ed7405ba785084c28686f43" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39d620203ed7405ba785084c28686f43" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 38015 } } }
I20240501 14:04:03.202723 1551 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43 [sys.catalog]: This master's current role is: LEADER
I20240501 14:04:03.202785 1550 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "39d620203ed7405ba785084c28686f43" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39d620203ed7405ba785084c28686f43" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 38015 } } }
I20240501 14:04:03.203052 1550 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43 [sys.catalog]: This master's current role is: LEADER
I20240501 14:04:03.203622 1558 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240501 14:04:03.209720 1558 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240501 14:04:03.218103 1558 catalog_manager.cc:1347] Generated new cluster ID: 010e73c45aac448ebcb93941eabd73dc
I20240501 14:04:03.218219 1558 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240501 14:04:03.239863 1558 catalog_manager.cc:1370] Generated new certificate authority record
I20240501 14:04:03.241101 1558 catalog_manager.cc:1504] Loading token signing keys...
I20240501 14:04:03.253815 1558 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43: Generated new TSK 0
I20240501 14:04:03.254953 1558 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240501 14:04:03.261934 30620 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
/tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.231.1:0
--local_ip_for_outbound_sockets=127.29.231.1
--webserver_interface=127.29.231.1
--webserver_port=0
--tserver_master_addrs=127.29.231.62:38015
--builtin_ntp_servers=127.29.231.20:40099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240501 14:04:03.585143 1568 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 14:04:03.585451 1568 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 14:04:03.585587 1568 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 14:04:03.593012 1568 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 14:04:03.593223 1568 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.231.1
I20240501 14:04:03.602156 1568 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.231.20:40099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.231.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.231.1
--webserver_port=0
--tserver_master_addrs=127.29.231.62:38015
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.231.1
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 13:43:20 UTC on efd1337a2aa3
build id 75
ASAN enabled
I20240501 14:04:03.603574 1568 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 14:04:03.605294 1568 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:04:03.617282 1573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:04:03.617897 1574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:04:03.618680 1576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:04:03.619437 1568 server_base.cc:1034] running on GCE node
I20240501 14:04:03.620034 1568 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 14:04:03.620963 1568 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 14:04:03.622192 1568 hybrid_clock.cc:648] HybridClock initialized: now 1714572243622138 us; error 41 us; skew 500 ppm
I20240501 14:04:03.622485 1568 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:04:03.624797 1568 webserver.cc:460] Webserver started at http://127.29.231.1:45423/ using document root <none> and password file <none>
I20240501 14:04:03.625515 1568 fs_manager.cc:359] Metadata directory not provided
I20240501 14:04:03.625645 1568 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:04:03.625929 1568 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 14:04:03.628613 1568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-0/data/instance:
uuid: "42780e7735104ee68bb1eb39779d3235"
format_stamp: "Formatted at 2024-05-01 14:04:03 on dist-test-slave-4827"
I20240501 14:04:03.629356 1568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-0/wal/instance:
uuid: "42780e7735104ee68bb1eb39779d3235"
format_stamp: "Formatted at 2024-05-01 14:04:03 on dist-test-slave-4827"
I20240501 14:04:03.634280 1568 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20240501 14:04:03.637485 1582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:04:03.638689 1568 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20240501 14:04:03.638856 1568 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-0/wal
uuid: "42780e7735104ee68bb1eb39779d3235"
format_stamp: "Formatted at 2024-05-01 14:04:03 on dist-test-slave-4827"
I20240501 14:04:03.639024 1568 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:04:03.659204 1568 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:04:03.660037 1568 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 14:04:03.660358 1568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:04:03.661254 1568 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 14:04:03.662645 1568 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 14:04:03.662724 1568 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 14:04:03.662860 1568 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 14:04:03.662917 1568 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 14:04:03.697242 1568 rpc_server.cc:307] RPC server started. Bound to: 127.29.231.1:46437
I20240501 14:04:03.697274 1694 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.231.1:46437 every 8 connection(s)
I20240501 14:04:03.698493 1568 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-0/data/info.pb
I20240501 14:04:03.700819 30620 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu as pid 1568
I20240501 14:04:03.701030 30620 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-0/wal/instance
I20240501 14:04:03.704530 30620 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
/tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.231.2:0
--local_ip_for_outbound_sockets=127.29.231.2
--webserver_interface=127.29.231.2
--webserver_port=0
--tserver_master_addrs=127.29.231.62:38015
--builtin_ntp_servers=127.29.231.20:40099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240501 14:04:03.711859 1695 heartbeater.cc:347] Connected to a master server at 127.29.231.62:38015
I20240501 14:04:03.712152 1695 heartbeater.cc:464] Registering TS with master...
I20240501 14:04:03.712978 1695 heartbeater.cc:511] Master 127.29.231.62:38015 requested a full tablet report, sending...
I20240501 14:04:03.715160 1509 ts_manager.cc:194] Registered new tserver with Master: 42780e7735104ee68bb1eb39779d3235 (127.29.231.1:46437)
I20240501 14:04:03.717398 1509 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.231.1:49087
W20240501 14:04:04.026921 1699 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 14:04:04.027258 1699 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 14:04:04.027396 1699 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 14:04:04.035004 1699 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 14:04:04.035249 1699 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.231.2
I20240501 14:04:04.044631 1699 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.231.20:40099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.231.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.231.2
--webserver_port=0
--tserver_master_addrs=127.29.231.62:38015
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.231.2
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 13:43:20 UTC on efd1337a2aa3
build id 75
ASAN enabled
I20240501 14:04:04.046028 1699 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 14:04:04.047780 1699 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:04:04.059953 1704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:04:04.060529 1705 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:04:04.061273 1707 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:04:04.062151 1699 server_base.cc:1034] running on GCE node
I20240501 14:04:04.062774 1699 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 14:04:04.063730 1699 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 14:04:04.064940 1699 hybrid_clock.cc:648] HybridClock initialized: now 1714572244064879 us; error 40 us; skew 500 ppm
I20240501 14:04:04.065239 1699 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:04:04.067555 1699 webserver.cc:460] Webserver started at http://127.29.231.2:38585/ using document root <none> and password file <none>
I20240501 14:04:04.068357 1699 fs_manager.cc:359] Metadata directory not provided
I20240501 14:04:04.068500 1699 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:04:04.068801 1699 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 14:04:04.071494 1699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-1/data/instance:
uuid: "a13c35b559e04e699f856b592d17c276"
format_stamp: "Formatted at 2024-05-01 14:04:04 on dist-test-slave-4827"
I20240501 14:04:04.072312 1699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-1/wal/instance:
uuid: "a13c35b559e04e699f856b592d17c276"
format_stamp: "Formatted at 2024-05-01 14:04:04 on dist-test-slave-4827"
I20240501 14:04:04.077802 1699 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20240501 14:04:04.081311 1713 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:04:04.082681 1699 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20240501 14:04:04.082854 1699 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-1/wal
uuid: "a13c35b559e04e699f856b592d17c276"
format_stamp: "Formatted at 2024-05-01 14:04:04 on dist-test-slave-4827"
I20240501 14:04:04.083041 1699 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:04:04.096997 1699 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:04:04.097800 1699 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 14:04:04.098063 1699 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:04:04.098975 1699 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 14:04:04.100580 1699 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 14:04:04.100662 1699 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 14:04:04.100792 1699 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 14:04:04.100848 1699 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 14:04:04.132259 1699 rpc_server.cc:307] RPC server started. Bound to: 127.29.231.2:36437
I20240501 14:04:04.132288 1825 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.231.2:36437 every 8 connection(s)
I20240501 14:04:04.133543 1699 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-1/data/info.pb
I20240501 14:04:04.134840 30620 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu as pid 1699
I20240501 14:04:04.135038 30620 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-1/wal/instance
I20240501 14:04:04.145612 1826 heartbeater.cc:347] Connected to a master server at 127.29.231.62:38015
I20240501 14:04:04.145897 1826 heartbeater.cc:464] Registering TS with master...
I20240501 14:04:04.146672 1826 heartbeater.cc:511] Master 127.29.231.62:38015 requested a full tablet report, sending...
I20240501 14:04:04.147912 1509 ts_manager.cc:194] Registered new tserver with Master: a13c35b559e04e699f856b592d17c276 (127.29.231.2:36437)
I20240501 14:04:04.148696 1509 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.231.2:35081
I20240501 14:04:04.150714 30620 external_mini_cluster.cc:930] 2 TS(s) registered with all masters
I20240501 14:04:04.163465 30620 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu pid 1699
I20240501 14:04:04.171630 1821 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 14:04:04.250373 30620 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu with pid 1699
I20240501 14:04:04.266952 30620 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu pid 1478
I20240501 14:04:04.268046 1539 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 14:04:04.364874 30620 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu with pid 1478
I20240501 14:04:04.385596 30620 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
/tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.231.62:38015
--webserver_interface=127.29.231.62
--webserver_port=33707
--builtin_ntp_servers=127.29.231.20:40099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.231.62:38015
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240501 14:04:04.709167 1838 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 14:04:04.709498 1838 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 14:04:04.709630 1838 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 14:04:04.717198 1838 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240501 14:04:04.717330 1838 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 14:04:04.717408 1838 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240501 14:04:04.717491 1838 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240501 14:04:04.720386 1695 heartbeater.cc:503] Master 127.29.231.62:38015 was elected leader, sending a full tablet report...
W20240501 14:04:04.721925 1695 heartbeater.cc:644] Failed to heartbeat to 127.29.231.62:38015 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.29.231.62:38015: connect: Connection refused (error 111)
I20240501 14:04:04.727115 1838 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.231.20:40099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.29.231.62:38015
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.231.62:38015
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.231.62
--webserver_port=33707
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 13:43:20 UTC on efd1337a2aa3
build id 75
ASAN enabled
I20240501 14:04:04.728477 1838 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 14:04:04.730250 1838 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:04:04.740875 1844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:04:04.741817 1845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:04:04.742282 1847 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:04:04.743034 1838 server_base.cc:1034] running on GCE node
I20240501 14:04:04.743863 1838 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 14:04:04.745325 1838 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 14:04:04.746572 1838 hybrid_clock.cc:648] HybridClock initialized: now 1714572244746510 us; error 36 us; skew 500 ppm
I20240501 14:04:04.746908 1838 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:04:04.749186 1838 webserver.cc:460] Webserver started at http://127.29.231.62:33707/ using document root <none> and password file <none>
I20240501 14:04:04.749914 1838 fs_manager.cc:359] Metadata directory not provided
I20240501 14:04:04.750061 1838 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:04:04.755465 1838 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.001s
I20240501 14:04:04.758383 1853 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:04:04.759850 1838 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20240501 14:04:04.760035 1838 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/master-0/data,/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/master-0/wal
uuid: "39d620203ed7405ba785084c28686f43"
format_stamp: "Formatted at 2024-05-01 14:04:03 on dist-test-slave-4827"
I20240501 14:04:04.760978 1838 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:04:04.787357 1838 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:04:04.788305 1838 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 14:04:04.788606 1838 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:04:04.806100 1838 rpc_server.cc:307] RPC server started. Bound to: 127.29.231.62:38015
I20240501 14:04:04.806130 1904 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.231.62:38015 every 8 connection(s)
I20240501 14:04:04.807617 1838 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/master-0/data/info.pb
I20240501 14:04:04.813764 1905 sys_catalog.cc:263] Verifying existing consensus state
I20240501 14:04:04.814843 30620 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu as pid 1838
I20240501 14:04:04.817678 1905 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43: Bootstrap starting.
I20240501 14:04:04.833324 1905 log.cc:824] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43: Log is configured to *not* fsync() on all Append() calls
I20240501 14:04:04.841230 1905 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:04:04.841832 1905 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43: Bootstrap complete.
I20240501 14:04:04.848731 1905 raft_consensus.cc:348] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39d620203ed7405ba785084c28686f43" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 38015 } }
I20240501 14:04:04.849470 1905 raft_consensus.cc:729] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39d620203ed7405ba785084c28686f43, State: Initialized, Role: FOLLOWER
I20240501 14:04:04.850073 1905 consensus_queue.cc:260] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39d620203ed7405ba785084c28686f43" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 38015 } }
I20240501 14:04:04.850281 1905 raft_consensus.cc:388] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:04.850404 1905 raft_consensus.cc:482] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:04.850576 1905 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:04:04.854751 1905 raft_consensus.cc:504] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39d620203ed7405ba785084c28686f43" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 38015 } }
I20240501 14:04:04.855221 1905 leader_election.cc:302] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 39d620203ed7405ba785084c28686f43; no voters:
I20240501 14:04:04.855747 1905 leader_election.cc:288] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 14:04:04.855895 1910 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:04:04.856525 1910 raft_consensus.cc:686] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43 [term 2 LEADER]: Becoming Leader. State: Replica: 39d620203ed7405ba785084c28686f43, State: Running, Role: LEADER
I20240501 14:04:04.857059 1910 consensus_queue.cc:237] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39d620203ed7405ba785084c28686f43" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 38015 } }
I20240501 14:04:04.857669 1905 sys_catalog.cc:564] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43 [sys.catalog]: configured and running, proceeding with master startup.
I20240501 14:04:04.859476 1911 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "39d620203ed7405ba785084c28686f43" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39d620203ed7405ba785084c28686f43" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 38015 } } }
I20240501 14:04:04.859843 1911 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43 [sys.catalog]: This master's current role is: LEADER
I20240501 14:04:04.860258 1912 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39d620203ed7405ba785084c28686f43. Latest consensus state: current_term: 2 leader_uuid: "39d620203ed7405ba785084c28686f43" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39d620203ed7405ba785084c28686f43" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 38015 } } }
I20240501 14:04:04.860563 1912 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43 [sys.catalog]: This master's current role is: LEADER
I20240501 14:04:04.863662 1918 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240501 14:04:04.869318 1918 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240501 14:04:04.870911 1918 catalog_manager.cc:1259] Loaded cluster ID: 010e73c45aac448ebcb93941eabd73dc
I20240501 14:04:04.871081 1918 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240501 14:04:04.875188 1918 catalog_manager.cc:1504] Loading token signing keys...
I20240501 14:04:04.876610 1918 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 39d620203ed7405ba785084c28686f43: Loaded TSK: 0
I20240501 14:04:04.878183 1918 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240501 14:04:05.728948 1695 heartbeater.cc:347] Connected to a master server at 127.29.231.62:38015
I20240501 14:04:05.729162 1695 heartbeater.cc:503] Master 127.29.231.62:38015 was elected leader, sending a full tablet report...
I20240501 14:04:05.730909 1870 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "42780e7735104ee68bb1eb39779d3235" instance_seqno: 1714572243686612) as {username='slave'} at 127.29.231.1:59725; Asking this server to re-register.
I20240501 14:04:05.731600 1695 heartbeater.cc:464] Registering TS with master...
I20240501 14:04:05.731838 1695 heartbeater.cc:511] Master 127.29.231.62:38015 requested a full tablet report, sending...
I20240501 14:04:05.733024 1870 ts_manager.cc:194] Registered new tserver with Master: 42780e7735104ee68bb1eb39779d3235 (127.29.231.1:46437)
I20240501 14:04:05.737613 30620 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20240501 14:04:05.737778 30620 test_util.cc:268] Using random seed: -173661918
I20240501 14:04:05.756733 1870 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53568:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20240501 14:04:05.779366 1630 tablet_service.cc:1467] Processing CreateTablet for tablet 93750b8a6858405288949468773388c1 (DEFAULT_TABLE table=test-workload [id=f9fb8d1c49f74718aec6c142f4837cb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20240501 14:04:05.780622 1630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93750b8a6858405288949468773388c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:05.789821 1940 tablet_bootstrap.cc:492] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235: Bootstrap starting.
I20240501 14:04:05.792729 1940 tablet_bootstrap.cc:654] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235: Neither blocks nor log segments found. Creating new log.
I20240501 14:04:05.793709 1940 log.cc:824] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235: Log is configured to *not* fsync() on all Append() calls
I20240501 14:04:05.795912 1940 tablet_bootstrap.cc:492] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235: No bootstrap required, opened a new log
I20240501 14:04:05.796159 1940 ts_tablet_manager.cc:1367] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20240501 14:04:05.802294 1940 raft_consensus.cc:348] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42780e7735104ee68bb1eb39779d3235" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 46437 } }
I20240501 14:04:05.802618 1940 raft_consensus.cc:374] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:04:05.802716 1940 raft_consensus.cc:729] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42780e7735104ee68bb1eb39779d3235, State: Initialized, Role: FOLLOWER
I20240501 14:04:05.803283 1940 consensus_queue.cc:260] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42780e7735104ee68bb1eb39779d3235" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 46437 } }
I20240501 14:04:05.803481 1940 raft_consensus.cc:388] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:05.803601 1940 raft_consensus.cc:482] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:05.803748 1940 raft_consensus.cc:3037] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:04:05.805711 1940 raft_consensus.cc:504] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42780e7735104ee68bb1eb39779d3235" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 46437 } }
I20240501 14:04:05.806174 1940 leader_election.cc:302] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 42780e7735104ee68bb1eb39779d3235; no voters:
I20240501 14:04:05.806739 1940 leader_election.cc:288] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 14:04:05.806919 1942 raft_consensus.cc:2781] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:04:05.808506 1940 ts_tablet_manager.cc:1398] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20240501 14:04:05.809137 1942 raft_consensus.cc:686] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235 [term 1 LEADER]: Becoming Leader. State: Replica: 42780e7735104ee68bb1eb39779d3235, State: Running, Role: LEADER
I20240501 14:04:05.809623 1942 consensus_queue.cc:237] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42780e7735104ee68bb1eb39779d3235" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 46437 } }
I20240501 14:04:05.815290 1870 catalog_manager.cc:5484] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42780e7735104ee68bb1eb39779d3235 (127.29.231.1). New cstate: current_term: 1 leader_uuid: "42780e7735104ee68bb1eb39779d3235" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42780e7735104ee68bb1eb39779d3235" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 46437 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:06.405776 30620 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
/tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.231.2:36437
--local_ip_for_outbound_sockets=127.29.231.2
--tserver_master_addrs=127.29.231.62:38015
--webserver_port=38585
--webserver_interface=127.29.231.2
--builtin_ntp_servers=127.29.231.20:40099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240501 14:04:06.733485 1957 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 14:04:06.733855 1957 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 14:04:06.734014 1957 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 14:04:06.741608 1957 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 14:04:06.741781 1957 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.231.2
I20240501 14:04:06.750814 1957 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.231.20:40099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.231.2:36437
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.231.2
--webserver_port=38585
--tserver_master_addrs=127.29.231.62:38015
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.231.2
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 13:43:20 UTC on efd1337a2aa3
build id 75
ASAN enabled
I20240501 14:04:06.752138 1957 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 14:04:06.753983 1957 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:04:06.766268 1962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:04:06.766929 1965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:04:06.767642 1963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:04:06.768419 1957 server_base.cc:1034] running on GCE node
I20240501 14:04:06.769023 1957 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 14:04:06.769979 1957 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 14:04:06.771184 1957 hybrid_clock.cc:648] HybridClock initialized: now 1714572246771110 us; error 56 us; skew 500 ppm
I20240501 14:04:06.771478 1957 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:04:06.773669 1957 webserver.cc:460] Webserver started at http://127.29.231.2:38585/ using document root <none> and password file <none>
I20240501 14:04:06.774391 1957 fs_manager.cc:359] Metadata directory not provided
I20240501 14:04:06.774535 1957 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:04:06.779687 1957 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20240501 14:04:06.782330 1971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:04:06.783620 1957 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20240501 14:04:06.783767 1957 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-1/wal
uuid: "a13c35b559e04e699f856b592d17c276"
format_stamp: "Formatted at 2024-05-01 14:04:04 on dist-test-slave-4827"
I20240501 14:04:06.784618 1957 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:04:06.800895 1957 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:04:06.801767 1957 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 14:04:06.802037 1957 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:04:06.802989 1957 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 14:04:06.804550 1957 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 14:04:06.804651 1957 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 14:04:06.804765 1957 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 14:04:06.804837 1957 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 14:04:06.838229 1957 rpc_server.cc:307] RPC server started. Bound to: 127.29.231.2:36437
I20240501 14:04:06.838284 2083 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.231.2:36437 every 8 connection(s)
I20240501 14:04:06.839726 1957 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-1/data/info.pb
I20240501 14:04:06.846136 30620 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu as pid 1957
W20240501 14:04:06.850167 1690 generic_service.cc:139] {username='slave'} at 127.0.0.1:33540 forcing change of non-runtime-safe flag fault_crash_on_handle_tc_fetch_data
I20240501 14:04:06.850456 1690 generic_service.cc:175] {username='slave'} at 127.0.0.1:33540 changed flags via RPC: fault_crash_on_handle_tc_fetch_data from '0' to '1.0'
I20240501 14:04:06.853672 2084 heartbeater.cc:347] Connected to a master server at 127.29.231.62:38015
I20240501 14:04:06.853981 2084 heartbeater.cc:464] Registering TS with master...
I20240501 14:04:06.855127 2084 heartbeater.cc:511] Master 127.29.231.62:38015 requested a full tablet report, sending...
I20240501 14:04:06.856662 1870 ts_manager.cc:194] Registered new tserver with Master: a13c35b559e04e699f856b592d17c276 (127.29.231.2:36437)
I20240501 14:04:06.857942 1870 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.231.2:53937
I20240501 14:04:06.861310 2089 ts_tablet_manager.cc:902] T 93750b8a6858405288949468773388c1 P a13c35b559e04e699f856b592d17c276: Initiating tablet copy from peer 42780e7735104ee68bb1eb39779d3235 (127.29.231.1:46437)
I20240501 14:04:06.862857 2089 tablet_copy_client.cc:308] T 93750b8a6858405288949468773388c1 P a13c35b559e04e699f856b592d17c276: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:46437
I20240501 14:04:06.868584 1670 tablet_copy_service.cc:140] P 42780e7735104ee68bb1eb39779d3235: Received BeginTabletCopySession request for tablet 93750b8a6858405288949468773388c1 from peer a13c35b559e04e699f856b592d17c276 ({username='slave'} at 127.29.231.2:35791)
I20240501 14:04:06.868804 1670 tablet_copy_service.cc:161] P 42780e7735104ee68bb1eb39779d3235: Beginning new tablet copy session on tablet 93750b8a6858405288949468773388c1 from peer a13c35b559e04e699f856b592d17c276 at {username='slave'} at 127.29.231.2:35791: session id = a13c35b559e04e699f856b592d17c276-93750b8a6858405288949468773388c1
I20240501 14:04:06.871376 1670 tablet_copy_source_session.cc:205] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 14:04:06.875572 2089 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93750b8a6858405288949468773388c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:06.885576 2089 tablet_copy_client.cc:783] T 93750b8a6858405288949468773388c1 P a13c35b559e04e699f856b592d17c276: tablet copy: Starting download of 0 data blocks...
I20240501 14:04:06.885856 2089 tablet_copy_client.cc:647] T 93750b8a6858405288949468773388c1 P a13c35b559e04e699f856b592d17c276: tablet copy: Starting download of 1 WAL segments...
W20240501 14:04:06.887297 1670 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20240501 14:04:06.887415 1670 fault_injection.cc:44] THIS SERVER MAY CRASH!
E20240501 14:04:06.887480 1670 fault_injection.cc:59] injecting fault for kudu (pid 1568): FLAGS_fault_crash_on_handle_tc_fetch_data (process will exit)
W20240501 14:04:06.906625 2089 ts_tablet_manager.cc:980] T 93750b8a6858405288949468773388c1 P a13c35b559e04e699f856b592d17c276: Tablet Copy: Unable to fetch data from remote peer 42780e7735104ee68bb1eb39779d3235 (127.29.231.1:46437): Network error: Unable to download WAL segment with seq. number 1: unable to fetch data from remote: recv got EOF from 127.29.231.1:46437 (error 108)
I20240501 14:04:06.906842 2089 tablet_replica.cc:330] T 93750b8a6858405288949468773388c1 P a13c35b559e04e699f856b592d17c276: stopping tablet replica
I20240501 14:04:06.907096 2089 raft_consensus.cc:2229] T 93750b8a6858405288949468773388c1 P a13c35b559e04e699f856b592d17c276 [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20240501 14:04:06.907292 2089 raft_consensus.cc:2258] T 93750b8a6858405288949468773388c1 P a13c35b559e04e699f856b592d17c276 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
W20240501 14:04:06.908419 2089 tablet_copy_client.cc:1108] T 93750b8a6858405288949468773388c1 P a13c35b559e04e699f856b592d17c276: tablet copy: Unable to close tablet copy session: Network error: failure ending tablet copy session: Client connection negotiation failed: client connection to 127.29.231.1:46437: connect: Connection refused (error 111)
W20240501 14:04:06.909117 2089 tablet_metadata.cc:476] failed to load DataDirGroup from superblock: Already present: tried to load directory group for tablet 93750b8a6858405288949468773388c1 but one is already registered
I20240501 14:04:06.909334 2089 ts_tablet_manager.cc:1875] T 93750b8a6858405288949468773388c1 P a13c35b559e04e699f856b592d17c276: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 14:04:06.913815 2089 ts_tablet_manager.cc:1888] T 93750b8a6858405288949468773388c1 P a13c35b559e04e699f856b592d17c276: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.0
I20240501 14:04:06.913961 2089 log.cc:1196] T 93750b8a6858405288949468773388c1 P a13c35b559e04e699f856b592d17c276: Deleting WAL directory at /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-1/wal/wals/93750b8a6858405288949468773388c1
I20240501 14:04:06.918339 30620 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
/tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.231.1:46437
--local_ip_for_outbound_sockets=127.29.231.1
--tserver_master_addrs=127.29.231.62:38015
--webserver_port=45423
--webserver_interface=127.29.231.1
--builtin_ntp_servers=127.29.231.20:40099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240501 14:04:07.242784 2094 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 14:04:07.243106 2094 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 14:04:07.243254 2094 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 14:04:07.250694 2094 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 14:04:07.250929 2094 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.231.1
I20240501 14:04:07.260041 2094 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.231.20:40099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.231.1:46437
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.231.1
--webserver_port=45423
--tserver_master_addrs=127.29.231.62:38015
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.231.1
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 13:43:20 UTC on efd1337a2aa3
build id 75
ASAN enabled
I20240501 14:04:07.261427 2094 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 14:04:07.263132 2094 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:04:07.276185 2100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:04:07.276635 2099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:04:07.277256 2102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:04:07.278172 2094 server_base.cc:1034] running on GCE node
I20240501 14:04:07.278802 2094 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 14:04:07.279780 2094 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 14:04:07.280994 2094 hybrid_clock.cc:648] HybridClock initialized: now 1714572247280912 us; error 57 us; skew 500 ppm
I20240501 14:04:07.281309 2094 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:04:07.283540 2094 webserver.cc:460] Webserver started at http://127.29.231.1:45423/ using document root <none> and password file <none>
I20240501 14:04:07.284291 2094 fs_manager.cc:359] Metadata directory not provided
I20240501 14:04:07.284440 2094 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:04:07.289691 2094 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.004s
I20240501 14:04:07.292546 2108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:04:07.293792 2094 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20240501 14:04:07.293941 2094 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-0/wal
uuid: "42780e7735104ee68bb1eb39779d3235"
format_stamp: "Formatted at 2024-05-01 14:04:03 on dist-test-slave-4827"
I20240501 14:04:07.294765 2094 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:04:07.320693 2094 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:04:07.321552 2094 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 14:04:07.321821 2094 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:04:07.322750 2094 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 14:04:07.324594 2115 ts_tablet_manager.cc:522] Loading tablet metadata (0/1 complete)
I20240501 14:04:07.329650 2094 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240501 14:04:07.329785 2094 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20240501 14:04:07.329913 2094 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240501 14:04:07.332713 2094 ts_tablet_manager.cc:590] Registered 1 tablets
I20240501 14:04:07.332799 2094 ts_tablet_manager.cc:569] Time spent register tablets: real 0.003s user 0.003s sys 0.000s
I20240501 14:04:07.333097 2115 tablet_bootstrap.cc:492] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235: Bootstrap starting.
I20240501 14:04:07.374835 2094 rpc_server.cc:307] RPC server started. Bound to: 127.29.231.1:46437
I20240501 14:04:07.374862 2221 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.231.1:46437 every 8 connection(s)
I20240501 14:04:07.376415 2094 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714572224537460-30620-0/minicluster-data/ts-0/data/info.pb
I20240501 14:04:07.378724 30620 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu as pid 2094
I20240501 14:04:07.404758 2222 heartbeater.cc:347] Connected to a master server at 127.29.231.62:38015
I20240501 14:04:07.405081 2222 heartbeater.cc:464] Registering TS with master...
I20240501 14:04:07.406175 2222 heartbeater.cc:511] Master 127.29.231.62:38015 requested a full tablet report, sending...
I20240501 14:04:07.409142 1870 ts_manager.cc:194] Re-registered known tserver with Master: 42780e7735104ee68bb1eb39779d3235 (127.29.231.1:46437)
I20240501 14:04:07.410219 1870 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.231.1:34601
I20240501 14:04:07.431458 2115 log.cc:824] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235: Log is configured to *not* fsync() on all Append() calls
I20240501 14:04:07.860718 2084 heartbeater.cc:503] Master 127.29.231.62:38015 was elected leader, sending a full tablet report...
W20240501 14:04:07.862308 1870 catalog_manager.cc:5397] Tablet 93750b8a6858405288949468773388c1 (table test-workload [id=f9fb8d1c49f74718aec6c142f4837cb4]) has failed on TS a13c35b559e04e699f856b592d17c276 (127.29.231.2:36437): Network error: Unable to download WAL segment with seq. number 1: unable to fetch data from remote: recv got EOF from 127.29.231.1:46437 (error 108)
I20240501 14:04:07.909554 2115 tablet_bootstrap.cc:492] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235: Bootstrap replayed 1/1 log segments. Stats: ops{read=209 overwritten=0 applied=209 ignored=0} inserts{seen=10400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:04:07.910190 2115 tablet_bootstrap.cc:492] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235: Bootstrap complete.
I20240501 14:04:07.911392 2115 ts_tablet_manager.cc:1367] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235: Time spent bootstrapping tablet: real 0.579s user 0.521s sys 0.052s
I20240501 14:04:07.915895 2115 raft_consensus.cc:348] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42780e7735104ee68bb1eb39779d3235" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 46437 } }
I20240501 14:04:07.916893 2115 raft_consensus.cc:729] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42780e7735104ee68bb1eb39779d3235, State: Initialized, Role: FOLLOWER
I20240501 14:04:07.917457 2115 consensus_queue.cc:260] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 209, Last appended: 1.209, Last appended by leader: 209, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42780e7735104ee68bb1eb39779d3235" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 46437 } }
I20240501 14:04:07.917655 2115 raft_consensus.cc:388] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:07.917762 2115 raft_consensus.cc:482] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:07.917917 2115 raft_consensus.cc:3037] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:04:07.921330 2115 raft_consensus.cc:504] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42780e7735104ee68bb1eb39779d3235" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 46437 } }
I20240501 14:04:07.921795 2115 leader_election.cc:302] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 42780e7735104ee68bb1eb39779d3235; no voters:
I20240501 14:04:07.922293 2115 leader_election.cc:288] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 14:04:07.922410 2229 raft_consensus.cc:2781] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:04:07.923393 2222 heartbeater.cc:503] Master 127.29.231.62:38015 was elected leader, sending a full tablet report...
I20240501 14:04:07.923475 2229 raft_consensus.cc:686] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235 [term 2 LEADER]: Becoming Leader. State: Replica: 42780e7735104ee68bb1eb39779d3235, State: Running, Role: LEADER
I20240501 14:04:07.923760 2115 ts_tablet_manager.cc:1398] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235: Time spent starting tablet: real 0.012s user 0.014s sys 0.000s
I20240501 14:04:07.923933 2229 consensus_queue.cc:237] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 209, Committed index: 209, Last appended: 1.209, Last appended by leader: 209, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42780e7735104ee68bb1eb39779d3235" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 46437 } }
I20240501 14:04:07.927569 1870 catalog_manager.cc:5484] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "42780e7735104ee68bb1eb39779d3235" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42780e7735104ee68bb1eb39779d3235" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 46437 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:07.929441 2235 ts_tablet_manager.cc:902] T 93750b8a6858405288949468773388c1 P a13c35b559e04e699f856b592d17c276: Initiating tablet copy from peer 42780e7735104ee68bb1eb39779d3235 (127.29.231.1:46437)
I20240501 14:04:07.930768 2235 tablet_copy_client.cc:308] T 93750b8a6858405288949468773388c1 P a13c35b559e04e699f856b592d17c276: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:46437
I20240501 14:04:07.937523 2197 tablet_copy_service.cc:140] P 42780e7735104ee68bb1eb39779d3235: Received BeginTabletCopySession request for tablet 93750b8a6858405288949468773388c1 from peer a13c35b559e04e699f856b592d17c276 ({username='slave'} at 127.29.231.2:50053)
I20240501 14:04:07.937734 2197 tablet_copy_service.cc:161] P 42780e7735104ee68bb1eb39779d3235: Beginning new tablet copy session on tablet 93750b8a6858405288949468773388c1 from peer a13c35b559e04e699f856b592d17c276 at {username='slave'} at 127.29.231.2:50053: session id = a13c35b559e04e699f856b592d17c276-93750b8a6858405288949468773388c1
I20240501 14:04:07.940049 2197 tablet_copy_source_session.cc:205] T 93750b8a6858405288949468773388c1 P 42780e7735104ee68bb1eb39779d3235: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 14:04:07.941490 2235 ts_tablet_manager.cc:1875] T 93750b8a6858405288949468773388c1 P a13c35b559e04e699f856b592d17c276: Deleting tablet data with delete state TABLET_DATA_COPYING
I20240501 14:04:07.945880 2235 ts_tablet_manager.cc:1888] T 93750b8a6858405288949468773388c1 P a13c35b559e04e699f856b592d17c276: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.0
I20240501 14:04:07.946107 2235 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93750b8a6858405288949468773388c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:07.948168 2235 tablet_copy_client.cc:783] T 93750b8a6858405288949468773388c1 P a13c35b559e04e699f856b592d17c276: tablet copy: Starting download of 0 data blocks...
I20240501 14:04:07.948424 2235 tablet_copy_client.cc:647] T 93750b8a6858405288949468773388c1 P a13c35b559e04e699f856b592d17c276: tablet copy: Starting download of 1 WAL segments...
I20240501 14:04:07.952390 2235 tablet_copy_client.cc:523] T 93750b8a6858405288949468773388c1 P a13c35b559e04e699f856b592d17c276: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 14:04:07.955035 2235 tablet_bootstrap.cc:492] T 93750b8a6858405288949468773388c1 P a13c35b559e04e699f856b592d17c276: Bootstrap starting.
I20240501 14:04:08.021267 2235 log.cc:824] T 93750b8a6858405288949468773388c1 P a13c35b559e04e699f856b592d17c276: Log is configured to *not* fsync() on all Append() calls
I20240501 14:04:08.514751 2235 tablet_bootstrap.cc:492] T 93750b8a6858405288949468773388c1 P a13c35b559e04e699f856b592d17c276: Bootstrap replayed 1/1 log segments. Stats: ops{read=210 overwritten=0 applied=210 ignored=0} inserts{seen=10400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:04:08.515228 2235 tablet_bootstrap.cc:492] T 93750b8a6858405288949468773388c1 P a13c35b559e04e699f856b592d17c276: Bootstrap complete.
I20240501 14:04:08.515726 2235 ts_tablet_manager.cc:1367] T 93750b8a6858405288949468773388c1 P a13c35b559e04e699f856b592d17c276: Time spent bootstrapping tablet: real 0.561s user 0.515s sys 0.044s
I20240501 14:04:08.520145 2235 raft_consensus.cc:348] T 93750b8a6858405288949468773388c1 P a13c35b559e04e699f856b592d17c276 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42780e7735104ee68bb1eb39779d3235" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 46437 } }
I20240501 14:04:08.520459 2235 raft_consensus.cc:729] T 93750b8a6858405288949468773388c1 P a13c35b559e04e699f856b592d17c276 [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: a13c35b559e04e699f856b592d17c276, State: Initialized, Role: NON_PARTICIPANT
I20240501 14:04:08.520968 2235 consensus_queue.cc:260] T 93750b8a6858405288949468773388c1 P a13c35b559e04e699f856b592d17c276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 210, Last appended: 2.210, Last appended by leader: 210, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42780e7735104ee68bb1eb39779d3235" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 46437 } }
I20240501 14:04:08.522545 2235 ts_tablet_manager.cc:1398] T 93750b8a6858405288949468773388c1 P a13c35b559e04e699f856b592d17c276: Time spent starting tablet: real 0.007s user 0.009s sys 0.000s
I20240501 14:04:08.523499 2197 tablet_copy_service.cc:342] P 42780e7735104ee68bb1eb39779d3235: Request end of tablet copy session a13c35b559e04e699f856b592d17c276-93750b8a6858405288949468773388c1 received from {username='slave'} at 127.29.231.2:50053
I20240501 14:04:08.523665 2197 tablet_copy_service.cc:433] P 42780e7735104ee68bb1eb39779d3235: ending tablet copy session a13c35b559e04e699f856b592d17c276-93750b8a6858405288949468773388c1 on tablet 93750b8a6858405288949468773388c1 with peer a13c35b559e04e699f856b592d17c276
I20240501 14:04:08.525319 30620 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu pid 2094
I20240501 14:04:08.526543 2217 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 14:04:08.626219 30620 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu with pid 2094
I20240501 14:04:08.646535 30620 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu pid 1957
I20240501 14:04:08.647605 2079 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 14:04:08.747129 30620 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu with pid 1957
I20240501 14:04:08.766186 30620 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu pid 1838
I20240501 14:04:08.767268 1900 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 14:04:08.870605 30620 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu with pid 1838
2024-05-01T14:04:08Z chronyd exiting
[ OK ] TabletCopyClientSessionITest.TestCopyFromCrashedSource (6180 ms)
[ RUN ] TabletCopyClientSessionITest.TestTabletCopyWithBusySource
2024-05-01T14:04:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-01T14:04:08Z Disabled control of system clock
I20240501 14:04:08.938613 30620 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
/tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.231.62:39165
--webserver_interface=127.29.231.62
--webserver_port=0
--builtin_ntp_servers=127.29.231.20:37607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.231.62:39165
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240501 14:04:09.274423 2253 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 14:04:09.274726 2253 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 14:04:09.274870 2253 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 14:04:09.283455 2253 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240501 14:04:09.283566 2253 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 14:04:09.283636 2253 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240501 14:04:09.283716 2253 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240501 14:04:09.292985 2253 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.231.20:37607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.29.231.62:39165
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.231.62:39165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.231.62
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 13:43:20 UTC on efd1337a2aa3
build id 75
ASAN enabled
I20240501 14:04:09.294327 2253 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 14:04:09.296051 2253 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:04:09.306857 2258 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:04:09.307507 2259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:04:09.308180 2261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:04:09.308948 2253 server_base.cc:1034] running on GCE node
I20240501 14:04:09.309768 2253 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 14:04:09.311190 2253 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 14:04:09.312410 2253 hybrid_clock.cc:648] HybridClock initialized: now 1714572249312349 us; error 30 us; skew 500 ppm
I20240501 14:04:09.312741 2253 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:04:09.314977 2253 webserver.cc:460] Webserver started at http://127.29.231.62:37987/ using document root <none> and password file <none>
I20240501 14:04:09.315690 2253 fs_manager.cc:359] Metadata directory not provided
I20240501 14:04:09.315829 2253 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:04:09.316126 2253 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 14:04:09.318717 2253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/master-0/data/instance:
uuid: "a66d046337ea4e5aa7ca347b3faf837c"
format_stamp: "Formatted at 2024-05-01 14:04:09 on dist-test-slave-4827"
I20240501 14:04:09.319578 2253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/master-0/wal/instance:
uuid: "a66d046337ea4e5aa7ca347b3faf837c"
format_stamp: "Formatted at 2024-05-01 14:04:09 on dist-test-slave-4827"
I20240501 14:04:09.324682 2253 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20240501 14:04:09.327833 2267 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:04:09.329221 2253 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240501 14:04:09.329396 2253 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/master-0/data,/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/master-0/wal
uuid: "a66d046337ea4e5aa7ca347b3faf837c"
format_stamp: "Formatted at 2024-05-01 14:04:09 on dist-test-slave-4827"
I20240501 14:04:09.329591 2253 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:04:09.359748 2253 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:04:09.360697 2253 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 14:04:09.360992 2253 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:04:09.377907 2253 rpc_server.cc:307] RPC server started. Bound to: 127.29.231.62:39165
I20240501 14:04:09.377936 2318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.231.62:39165 every 8 connection(s)
I20240501 14:04:09.379323 2253 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/master-0/data/info.pb
I20240501 14:04:09.382987 2319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:09.387643 30620 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu as pid 2253
I20240501 14:04:09.387879 30620 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/master-0/wal/instance
I20240501 14:04:09.393380 2319 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c: Bootstrap starting.
I20240501 14:04:09.396450 2319 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c: Neither blocks nor log segments found. Creating new log.
I20240501 14:04:09.397450 2319 log.cc:824] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c: Log is configured to *not* fsync() on all Append() calls
I20240501 14:04:09.400439 2319 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c: No bootstrap required, opened a new log
I20240501 14:04:09.406627 2319 raft_consensus.cc:348] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a66d046337ea4e5aa7ca347b3faf837c" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 39165 } }
I20240501 14:04:09.406939 2319 raft_consensus.cc:374] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:04:09.407013 2319 raft_consensus.cc:729] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a66d046337ea4e5aa7ca347b3faf837c, State: Initialized, Role: FOLLOWER
I20240501 14:04:09.407522 2319 consensus_queue.cc:260] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a66d046337ea4e5aa7ca347b3faf837c" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 39165 } }
I20240501 14:04:09.407707 2319 raft_consensus.cc:388] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:09.407829 2319 raft_consensus.cc:482] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:09.407976 2319 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:04:09.410151 2319 raft_consensus.cc:504] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a66d046337ea4e5aa7ca347b3faf837c" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 39165 } }
I20240501 14:04:09.410569 2319 leader_election.cc:302] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a66d046337ea4e5aa7ca347b3faf837c; no voters:
I20240501 14:04:09.411093 2319 leader_election.cc:288] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 14:04:09.411233 2324 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:04:09.411828 2324 raft_consensus.cc:686] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c [term 1 LEADER]: Becoming Leader. State: Replica: a66d046337ea4e5aa7ca347b3faf837c, State: Running, Role: LEADER
I20240501 14:04:09.412716 2324 consensus_queue.cc:237] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a66d046337ea4e5aa7ca347b3faf837c" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 39165 } }
I20240501 14:04:09.413183 2319 sys_catalog.cc:564] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c [sys.catalog]: configured and running, proceeding with master startup.
I20240501 14:04:09.415777 2325 sys_catalog.cc:455] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a66d046337ea4e5aa7ca347b3faf837c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a66d046337ea4e5aa7ca347b3faf837c" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 39165 } } }
I20240501 14:04:09.415771 2326 sys_catalog.cc:455] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c [sys.catalog]: SysCatalogTable state changed. Reason: New leader a66d046337ea4e5aa7ca347b3faf837c. Latest consensus state: current_term: 1 leader_uuid: "a66d046337ea4e5aa7ca347b3faf837c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a66d046337ea4e5aa7ca347b3faf837c" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 39165 } } }
I20240501 14:04:09.416153 2325 sys_catalog.cc:458] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c [sys.catalog]: This master's current role is: LEADER
I20240501 14:04:09.416150 2326 sys_catalog.cc:458] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c [sys.catalog]: This master's current role is: LEADER
I20240501 14:04:09.418804 2333 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240501 14:04:09.423354 2333 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240501 14:04:09.431190 2333 catalog_manager.cc:1347] Generated new cluster ID: 40ac2649ce2c435e9ab9643ba26f99ba
I20240501 14:04:09.431298 2333 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240501 14:04:09.446382 2333 catalog_manager.cc:1370] Generated new certificate authority record
I20240501 14:04:09.447862 2333 catalog_manager.cc:1504] Loading token signing keys...
I20240501 14:04:09.456568 2333 catalog_manager.cc:5857] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c: Generated new TSK 0
I20240501 14:04:09.457439 2333 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240501 14:04:09.464079 30620 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
/tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.231.1:0
--local_ip_for_outbound_sockets=127.29.231.1
--webserver_interface=127.29.231.1
--webserver_port=0
--tserver_master_addrs=127.29.231.62:39165
--builtin_ntp_servers=127.29.231.20:37607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=20 with env {}
W20240501 14:04:09.800192 2343 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 14:04:09.800518 2343 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 14:04:09.800657 2343 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 14:04:09.808105 2343 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 14:04:09.808338 2343 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.231.1
I20240501 14:04:09.817409 2343 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.231.20:37607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.231.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.231.1
--webserver_port=0
--tserver_master_addrs=127.29.231.62:39165
--num_tablets_to_copy_simultaneously=20
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.231.1
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 13:43:20 UTC on efd1337a2aa3
build id 75
ASAN enabled
I20240501 14:04:09.818787 2343 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 14:04:09.820573 2343 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:04:09.833168 2349 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:04:09.833578 2348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:04:09.834441 2351 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:04:09.835443 2343 server_base.cc:1034] running on GCE node
I20240501 14:04:09.836061 2343 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 14:04:09.837103 2343 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 14:04:09.838330 2343 hybrid_clock.cc:648] HybridClock initialized: now 1714572249838257 us; error 34 us; skew 500 ppm
I20240501 14:04:09.838637 2343 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:04:09.840864 2343 webserver.cc:460] Webserver started at http://127.29.231.1:43911/ using document root <none> and password file <none>
I20240501 14:04:09.841583 2343 fs_manager.cc:359] Metadata directory not provided
I20240501 14:04:09.841707 2343 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:04:09.842016 2343 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 14:04:09.844700 2343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-0/data/instance:
uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8"
format_stamp: "Formatted at 2024-05-01 14:04:09 on dist-test-slave-4827"
I20240501 14:04:09.845453 2343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-0/wal/instance:
uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8"
format_stamp: "Formatted at 2024-05-01 14:04:09 on dist-test-slave-4827"
I20240501 14:04:09.850557 2343 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20240501 14:04:09.853874 2357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:04:09.855192 2343 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20240501 14:04:09.855357 2343 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-0/wal
uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8"
format_stamp: "Formatted at 2024-05-01 14:04:09 on dist-test-slave-4827"
I20240501 14:04:09.855537 2343 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:04:09.880467 2343 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:04:09.881299 2343 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 14:04:09.881584 2343 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:04:09.882509 2343 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 14:04:09.884018 2343 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 14:04:09.884099 2343 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 14:04:09.884251 2343 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 14:04:09.884322 2343 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20240501 14:04:09.915441 2343 rpc_server.cc:307] RPC server started. Bound to: 127.29.231.1:33163
I20240501 14:04:09.915501 2469 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.231.1:33163 every 8 connection(s)
I20240501 14:04:09.916806 2343 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-0/data/info.pb
I20240501 14:04:09.924598 30620 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu as pid 2343
I20240501 14:04:09.924787 30620 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-0/wal/instance
I20240501 14:04:09.928381 30620 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
/tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.231.2:0
--local_ip_for_outbound_sockets=127.29.231.2
--webserver_interface=127.29.231.2
--webserver_port=0
--tserver_master_addrs=127.29.231.62:39165
--builtin_ntp_servers=127.29.231.20:37607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=20 with env {}
I20240501 14:04:09.929776 2470 heartbeater.cc:347] Connected to a master server at 127.29.231.62:39165
I20240501 14:04:09.930083 2470 heartbeater.cc:464] Registering TS with master...
I20240501 14:04:09.930904 2470 heartbeater.cc:511] Master 127.29.231.62:39165 requested a full tablet report, sending...
I20240501 14:04:09.933221 2284 ts_manager.cc:194] Registered new tserver with Master: 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1:33163)
I20240501 14:04:09.934881 2284 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.231.1:51455
W20240501 14:04:10.254949 2474 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 14:04:10.255278 2474 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 14:04:10.255427 2474 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 14:04:10.262991 2474 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 14:04:10.263226 2474 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.231.2
I20240501 14:04:10.272047 2474 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.231.20:37607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.231.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.231.2
--webserver_port=0
--tserver_master_addrs=127.29.231.62:39165
--num_tablets_to_copy_simultaneously=20
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.231.2
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 13:43:20 UTC on efd1337a2aa3
build id 75
ASAN enabled
I20240501 14:04:10.273445 2474 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 14:04:10.275175 2474 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:04:10.288443 2479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:04:10.289095 2480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:04:10.289747 2482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:04:10.290395 2474 server_base.cc:1034] running on GCE node
I20240501 14:04:10.290992 2474 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 14:04:10.291923 2474 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 14:04:10.293140 2474 hybrid_clock.cc:648] HybridClock initialized: now 1714572250293074 us; error 39 us; skew 500 ppm
I20240501 14:04:10.293442 2474 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:04:10.295653 2474 webserver.cc:460] Webserver started at http://127.29.231.2:39667/ using document root <none> and password file <none>
I20240501 14:04:10.296417 2474 fs_manager.cc:359] Metadata directory not provided
I20240501 14:04:10.296550 2474 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:04:10.296849 2474 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 14:04:10.299499 2474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-1/data/instance:
uuid: "875af4e39aa44837abfe99827303b395"
format_stamp: "Formatted at 2024-05-01 14:04:10 on dist-test-slave-4827"
I20240501 14:04:10.300333 2474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-1/wal/instance:
uuid: "875af4e39aa44837abfe99827303b395"
format_stamp: "Formatted at 2024-05-01 14:04:10 on dist-test-slave-4827"
I20240501 14:04:10.305650 2474 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20240501 14:04:10.309011 2488 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:04:10.310256 2474 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20240501 14:04:10.310415 2474 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-1/wal
uuid: "875af4e39aa44837abfe99827303b395"
format_stamp: "Formatted at 2024-05-01 14:04:10 on dist-test-slave-4827"
I20240501 14:04:10.310577 2474 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:04:10.335572 2474 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:04:10.336464 2474 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 14:04:10.336750 2474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:04:10.337709 2474 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 14:04:10.339228 2474 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 14:04:10.339314 2474 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 14:04:10.339453 2474 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 14:04:10.339509 2474 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 14:04:10.370625 2474 rpc_server.cc:307] RPC server started. Bound to: 127.29.231.2:41687
I20240501 14:04:10.370661 2600 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.231.2:41687 every 8 connection(s)
I20240501 14:04:10.371898 2474 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-1/data/info.pb
I20240501 14:04:10.379016 30620 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu as pid 2474
I20240501 14:04:10.379204 30620 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-1/wal/instance
I20240501 14:04:10.385062 2601 heartbeater.cc:347] Connected to a master server at 127.29.231.62:39165
I20240501 14:04:10.385340 2601 heartbeater.cc:464] Registering TS with master...
I20240501 14:04:10.386111 2601 heartbeater.cc:511] Master 127.29.231.62:39165 requested a full tablet report, sending...
I20240501 14:04:10.387526 2284 ts_manager.cc:194] Registered new tserver with Master: 875af4e39aa44837abfe99827303b395 (127.29.231.2:41687)
I20240501 14:04:10.388304 2284 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.231.2:46181
I20240501 14:04:10.395339 30620 external_mini_cluster.cc:930] 2 TS(s) registered with all masters
I20240501 14:04:10.408716 30620 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu pid 2474
I20240501 14:04:10.416939 2596 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 14:04:10.497593 30620 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu with pid 2474
I20240501 14:04:10.513729 30620 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu pid 2253
I20240501 14:04:10.514916 2314 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 14:04:10.613005 30620 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu with pid 2253
I20240501 14:04:10.633728 30620 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
/tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.231.62:39165
--webserver_interface=127.29.231.62
--webserver_port=37987
--builtin_ntp_servers=127.29.231.20:37607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.231.62:39165
--master_tombstone_evicted_tablet_replicas=false with env {}
I20240501 14:04:10.937716 2470 heartbeater.cc:503] Master 127.29.231.62:39165 was elected leader, sending a full tablet report...
W20240501 14:04:10.939267 2470 heartbeater.cc:644] Failed to heartbeat to 127.29.231.62:39165 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.29.231.62:39165: connect: Connection refused (error 111)
W20240501 14:04:10.962000 2613 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 14:04:10.962304 2613 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 14:04:10.962410 2613 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 14:04:10.969832 2613 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240501 14:04:10.969939 2613 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 14:04:10.969983 2613 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240501 14:04:10.970039 2613 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240501 14:04:10.978916 2613 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.231.20:37607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.29.231.62:39165
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.231.62:39165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.231.62
--webserver_port=37987
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 13:43:20 UTC on efd1337a2aa3
build id 75
ASAN enabled
I20240501 14:04:10.980288 2613 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 14:04:10.982026 2613 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:04:10.992753 2619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:04:10.993373 2620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:04:10.994088 2622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:04:10.994812 2613 server_base.cc:1034] running on GCE node
I20240501 14:04:10.995572 2613 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 14:04:10.996994 2613 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 14:04:10.998200 2613 hybrid_clock.cc:648] HybridClock initialized: now 1714572250998134 us; error 44 us; skew 500 ppm
I20240501 14:04:10.998517 2613 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:04:11.000753 2613 webserver.cc:460] Webserver started at http://127.29.231.62:37987/ using document root <none> and password file <none>
I20240501 14:04:11.001459 2613 fs_manager.cc:359] Metadata directory not provided
I20240501 14:04:11.001613 2613 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:04:11.006772 2613 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20240501 14:04:11.009594 2628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:04:11.010876 2613 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240501 14:04:11.011039 2613 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/master-0/data,/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/master-0/wal
uuid: "a66d046337ea4e5aa7ca347b3faf837c"
format_stamp: "Formatted at 2024-05-01 14:04:09 on dist-test-slave-4827"
I20240501 14:04:11.011855 2613 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:04:11.037595 2613 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:04:11.038455 2613 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 14:04:11.038713 2613 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:04:11.056624 2613 rpc_server.cc:307] RPC server started. Bound to: 127.29.231.62:39165
I20240501 14:04:11.056643 2679 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.231.62:39165 every 8 connection(s)
I20240501 14:04:11.058116 2613 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/master-0/data/info.pb
I20240501 14:04:11.064210 2680 sys_catalog.cc:263] Verifying existing consensus state
I20240501 14:04:11.064996 30620 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu as pid 2613
I20240501 14:04:11.067593 2680 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c: Bootstrap starting.
I20240501 14:04:11.083724 2680 log.cc:824] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c: Log is configured to *not* fsync() on all Append() calls
I20240501 14:04:11.091522 2680 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:04:11.092087 2680 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c: Bootstrap complete.
I20240501 14:04:11.098897 2680 raft_consensus.cc:348] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a66d046337ea4e5aa7ca347b3faf837c" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 39165 } }
I20240501 14:04:11.099630 2680 raft_consensus.cc:729] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a66d046337ea4e5aa7ca347b3faf837c, State: Initialized, Role: FOLLOWER
I20240501 14:04:11.100360 2680 consensus_queue.cc:260] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a66d046337ea4e5aa7ca347b3faf837c" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 39165 } }
I20240501 14:04:11.100579 2680 raft_consensus.cc:388] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:11.100689 2680 raft_consensus.cc:482] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:11.100862 2680 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:04:11.104784 2680 raft_consensus.cc:504] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a66d046337ea4e5aa7ca347b3faf837c" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 39165 } }
I20240501 14:04:11.105270 2680 leader_election.cc:302] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a66d046337ea4e5aa7ca347b3faf837c; no voters:
I20240501 14:04:11.105796 2680 leader_election.cc:288] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 14:04:11.105950 2685 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:04:11.106568 2685 raft_consensus.cc:686] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c [term 2 LEADER]: Becoming Leader. State: Replica: a66d046337ea4e5aa7ca347b3faf837c, State: Running, Role: LEADER
I20240501 14:04:11.107101 2685 consensus_queue.cc:237] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a66d046337ea4e5aa7ca347b3faf837c" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 39165 } }
I20240501 14:04:11.107704 2680 sys_catalog.cc:564] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c [sys.catalog]: configured and running, proceeding with master startup.
I20240501 14:04:11.109818 2686 sys_catalog.cc:455] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "a66d046337ea4e5aa7ca347b3faf837c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a66d046337ea4e5aa7ca347b3faf837c" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 39165 } } }
I20240501 14:04:11.109840 2687 sys_catalog.cc:455] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c [sys.catalog]: SysCatalogTable state changed. Reason: New leader a66d046337ea4e5aa7ca347b3faf837c. Latest consensus state: current_term: 2 leader_uuid: "a66d046337ea4e5aa7ca347b3faf837c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a66d046337ea4e5aa7ca347b3faf837c" member_type: VOTER last_known_addr { host: "127.29.231.62" port: 39165 } } }
I20240501 14:04:11.110284 2686 sys_catalog.cc:458] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c [sys.catalog]: This master's current role is: LEADER
I20240501 14:04:11.110291 2687 sys_catalog.cc:458] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c [sys.catalog]: This master's current role is: LEADER
I20240501 14:04:11.111224 2692 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240501 14:04:11.119139 2692 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240501 14:04:11.120806 2692 catalog_manager.cc:1259] Loaded cluster ID: 40ac2649ce2c435e9ab9643ba26f99ba
I20240501 14:04:11.120885 2692 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240501 14:04:11.123597 2692 catalog_manager.cc:1504] Loading token signing keys...
I20240501 14:04:11.124715 2692 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a66d046337ea4e5aa7ca347b3faf837c: Loaded TSK: 0
I20240501 14:04:11.125941 2692 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240501 14:04:11.946048 2470 heartbeater.cc:347] Connected to a master server at 127.29.231.62:39165
I20240501 14:04:11.946281 2470 heartbeater.cc:503] Master 127.29.231.62:39165 was elected leader, sending a full tablet report...
I20240501 14:04:11.948026 2645 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" instance_seqno: 1714572249907724) as {username='slave'} at 127.29.231.1:43465; Asking this server to re-register.
I20240501 14:04:11.948712 2470 heartbeater.cc:464] Registering TS with master...
I20240501 14:04:11.948927 2470 heartbeater.cc:511] Master 127.29.231.62:39165 requested a full tablet report, sending...
I20240501 14:04:11.950060 2645 ts_manager.cc:194] Registered new tserver with Master: 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1:33163)
I20240501 14:04:11.959301 30620 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20240501 14:04:11.959493 30620 test_util.cc:268] Using random seed: -167440201
I20240501 14:04:11.979430 2645 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52830:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "<redacted>""\004\001\000fff\006\004\001\000\314\314\314\014\004\001\000233\023\004\001\000\230\231\231\031\004\001\000\376\377\377\037\004\001\000dff&\004\001\000\312\314\314,\004\001\0000333\004\001\000\226\231\2319\004\001\000\374\377\377?\004\001\000bffF\004\001\000\310\314\314L\004\001\000.33S\004\001\000\224\231\231Y\004\001\000\372\377\377_\004\001\000`fff\004\001\000\306\314\314l\004\001\000,33s\004\001\000\222\231\231y"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20240501 14:04:12.014747 2397 tablet_service.cc:1467] Processing CreateTablet for tablet 0ff204737078438c933a74bd0336fde4 (DEFAULT_TABLE table=test-workload [id=bf6eded407ce4223b9fd1e3e06b14b6f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 966367638
I20240501 14:04:12.014372 2398 tablet_service.cc:1467] Processing CreateTablet for tablet 664d737a61d846e3bcce7000b9617b35 (DEFAULT_TABLE table=test-workload [id=bf6eded407ce4223b9fd1e3e06b14b6f]), partition=RANGE (key) PARTITION 751619274 <= VALUES < 858993456
I20240501 14:04:12.015200 2393 tablet_service.cc:1467] Processing CreateTablet for tablet 8905fd25304648629180625e85507e2a (DEFAULT_TABLE table=test-workload [id=bf6eded407ce4223b9fd1e3e06b14b6f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1395864366
I20240501 14:04:12.015448 2396 tablet_service.cc:1467] Processing CreateTablet for tablet d6d953d9f0ff488a818c340f64df2b7f (DEFAULT_TABLE table=test-workload [id=bf6eded407ce4223b9fd1e3e06b14b6f]), partition=RANGE (key) PARTITION 966367638 <= VALUES < 1073741820
I20240501 14:04:12.014582 2389 tablet_service.cc:1467] Processing CreateTablet for tablet fa5ce4bdc1af4d8888c7756810d6d18d (DEFAULT_TABLE table=test-workload [id=bf6eded407ce4223b9fd1e3e06b14b6f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1825361094
I20240501 14:04:12.016060 2395 tablet_service.cc:1467] Processing CreateTablet for tablet f17c217d525f40a1b698b080175949cd (DEFAULT_TABLE table=test-workload [id=bf6eded407ce4223b9fd1e3e06b14b6f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1181116002
I20240501 14:04:12.016074 2405 tablet_service.cc:1467] Processing CreateTablet for tablet 8dd66af8436c4f71b019990d2800ea00 (DEFAULT_TABLE table=test-workload [id=bf6eded407ce4223b9fd1e3e06b14b6f]), partition=RANGE (key) PARTITION VALUES < 107374182
I20240501 14:04:12.016726 2391 tablet_service.cc:1467] Processing CreateTablet for tablet 15f78e215c5c4b15a95453f3bfae1aab (DEFAULT_TABLE table=test-workload [id=bf6eded407ce4223b9fd1e3e06b14b6f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1610612730
I20240501 14:04:12.017077 2395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f17c217d525f40a1b698b080175949cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:12.017583 2398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 664d737a61d846e3bcce7000b9617b35. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:12.017483 2390 tablet_service.cc:1467] Processing CreateTablet for tablet fa6f5697f90447dbb48240766d24b855 (DEFAULT_TABLE table=test-workload [id=bf6eded407ce4223b9fd1e3e06b14b6f]), partition=RANGE (key) PARTITION 1610612730 <= VALUES < 1717986912
I20240501 14:04:12.017863 2391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15f78e215c5c4b15a95453f3bfae1aab. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:12.018241 2388 tablet_service.cc:1467] Processing CreateTablet for tablet 26835459e32949b3ad28eb9f925f9632 (DEFAULT_TABLE table=test-workload [id=bf6eded407ce4223b9fd1e3e06b14b6f]), partition=RANGE (key) PARTITION 1825361094 <= VALUES < 1932735276
I20240501 14:04:12.018517 2396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6d953d9f0ff488a818c340f64df2b7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:12.018772 2388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26835459e32949b3ad28eb9f925f9632. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:12.018978 2405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8dd66af8436c4f71b019990d2800ea00. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:12.019141 2392 tablet_service.cc:1467] Processing CreateTablet for tablet acafe3e6514a4d50b863992d8ab16573 (DEFAULT_TABLE table=test-workload [id=bf6eded407ce4223b9fd1e3e06b14b6f]), partition=RANGE (key) PARTITION 1395864366 <= VALUES < 1503238548
I20240501 14:04:12.019789 2393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8905fd25304648629180625e85507e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:12.020042 2397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ff204737078438c933a74bd0336fde4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:12.020097 2387 tablet_service.cc:1467] Processing CreateTablet for tablet 7791050ac9a14b1a8f7efedeae29c775 (DEFAULT_TABLE table=test-workload [id=bf6eded407ce4223b9fd1e3e06b14b6f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES < 2040109458
I20240501 14:04:12.014498 2401 tablet_service.cc:1467] Processing CreateTablet for tablet 6b414d33585c40e6bf8ffb34d0877c1e (DEFAULT_TABLE table=test-workload [id=bf6eded407ce4223b9fd1e3e06b14b6f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 536870910
I20240501 14:04:12.021854 2389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa5ce4bdc1af4d8888c7756810d6d18d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:12.022095 2392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acafe3e6514a4d50b863992d8ab16573. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:12.022441 2401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b414d33585c40e6bf8ffb34d0877c1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:12.022652 2387 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7791050ac9a14b1a8f7efedeae29c775. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:12.023422 2404 tablet_service.cc:1467] Processing CreateTablet for tablet 628b61d5ad54485a94c4682411a5cf41 (DEFAULT_TABLE table=test-workload [id=bf6eded407ce4223b9fd1e3e06b14b6f]), partition=RANGE (key) PARTITION 107374182 <= VALUES < 214748364
I20240501 14:04:12.021230 2399 tablet_service.cc:1467] Processing CreateTablet for tablet 9bc0426756ed4034bfd9b99d36212481 (DEFAULT_TABLE table=test-workload [id=bf6eded407ce4223b9fd1e3e06b14b6f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 751619274
I20240501 14:04:12.023578 2390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa6f5697f90447dbb48240766d24b855. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:12.023809 2403 tablet_service.cc:1467] Processing CreateTablet for tablet 80972674f56c44f7b4b684d81177cd7e (DEFAULT_TABLE table=test-workload [id=bf6eded407ce4223b9fd1e3e06b14b6f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 322122546
I20240501 14:04:12.023856 2400 tablet_service.cc:1467] Processing CreateTablet for tablet e9dc4d74a9064cbbbf756062d4c80dfc (DEFAULT_TABLE table=test-workload [id=bf6eded407ce4223b9fd1e3e06b14b6f]), partition=RANGE (key) PARTITION 536870910 <= VALUES < 644245092
I20240501 14:04:12.023895 2386 tablet_service.cc:1467] Processing CreateTablet for tablet e03fee94218743268b60937bf81a9c79 (DEFAULT_TABLE table=test-workload [id=bf6eded407ce4223b9fd1e3e06b14b6f]), partition=RANGE (key) PARTITION 2040109458 <= VALUES
I20240501 14:04:12.024726 2404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 628b61d5ad54485a94c4682411a5cf41. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:12.024727 2402 tablet_service.cc:1467] Processing CreateTablet for tablet c110feabb9164a78b4d125811a7e014a (DEFAULT_TABLE table=test-workload [id=bf6eded407ce4223b9fd1e3e06b14b6f]), partition=RANGE (key) PARTITION 322122546 <= VALUES < 429496728
I20240501 14:04:12.025310 2400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9dc4d74a9064cbbbf756062d4c80dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:12.025826 2402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c110feabb9164a78b4d125811a7e014a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:12.026029 2399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bc0426756ed4034bfd9b99d36212481. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:12.026201 2386 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e03fee94218743268b60937bf81a9c79. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:12.026505 2394 tablet_service.cc:1467] Processing CreateTablet for tablet 377e1da98a1f4075af0ea8bd47f79ca8 (DEFAULT_TABLE table=test-workload [id=bf6eded407ce4223b9fd1e3e06b14b6f]), partition=RANGE (key) PARTITION 1181116002 <= VALUES < 1288490184
I20240501 14:04:12.028620 2403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80972674f56c44f7b4b684d81177cd7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:12.030613 2394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 377e1da98a1f4075af0ea8bd47f79ca8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:12.095901 2715 tablet_bootstrap.cc:492] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:12.100104 2715 tablet_bootstrap.cc:654] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Neither blocks nor log segments found. Creating new log.
I20240501 14:04:12.101195 2715 log.cc:824] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Log is configured to *not* fsync() on all Append() calls
I20240501 14:04:12.103590 2715 tablet_bootstrap.cc:492] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8: No bootstrap required, opened a new log
I20240501 14:04:12.103834 2715 ts_tablet_manager.cc:1367] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.002s
I20240501 14:04:12.109651 2715 raft_consensus.cc:348] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.109983 2715 raft_consensus.cc:374] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:04:12.110080 2715 raft_consensus.cc:729] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:12.110690 2715 consensus_queue.cc:260] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.110890 2715 raft_consensus.cc:388] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:12.111007 2715 raft_consensus.cc:482] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:12.111151 2715 raft_consensus.cc:3037] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:04:12.113168 2715 raft_consensus.cc:504] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.113617 2715 leader_election.cc:302] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:12.114243 2715 leader_election.cc:288] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 14:04:12.114390 2717 raft_consensus.cc:2781] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:04:12.114977 2717 raft_consensus.cc:686] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:12.115473 2717 consensus_queue.cc:237] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.116299 2715 ts_tablet_manager.cc:1398] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.012s user 0.009s sys 0.005s
I20240501 14:04:12.116657 2715 tablet_bootstrap.cc:492] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:12.118471 2715 tablet_bootstrap.cc:654] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8: Neither blocks nor log segments found. Creating new log.
I20240501 14:04:12.120651 2715 tablet_bootstrap.cc:492] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8: No bootstrap required, opened a new log
I20240501 14:04:12.120796 2715 ts_tablet_manager.cc:1367] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.002s
I20240501 14:04:12.121245 2645 catalog_manager.cc:5484] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1). New cstate: current_term: 1 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:12.121714 2715 raft_consensus.cc:348] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.121884 2715 raft_consensus.cc:374] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:04:12.121982 2715 raft_consensus.cc:729] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:12.122216 2715 consensus_queue.cc:260] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.122406 2715 raft_consensus.cc:388] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:12.122490 2715 raft_consensus.cc:482] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:12.122597 2715 raft_consensus.cc:3037] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:04:12.124666 2715 raft_consensus.cc:504] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.124910 2715 leader_election.cc:302] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:12.125085 2715 leader_election.cc:288] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 14:04:12.125147 2717 raft_consensus.cc:2781] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:04:12.125305 2717 raft_consensus.cc:686] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:12.125568 2715 ts_tablet_manager.cc:1398] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20240501 14:04:12.125519 2717 consensus_queue.cc:237] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.125810 2715 tablet_bootstrap.cc:492] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:12.127295 2715 tablet_bootstrap.cc:654] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8: Neither blocks nor log segments found. Creating new log.
I20240501 14:04:12.128319 2645 catalog_manager.cc:5484] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1). New cstate: current_term: 1 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:12.129112 2715 tablet_bootstrap.cc:492] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8: No bootstrap required, opened a new log
I20240501 14:04:12.129245 2715 ts_tablet_manager.cc:1367] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20240501 14:04:12.129746 2715 raft_consensus.cc:348] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.129889 2715 raft_consensus.cc:374] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:04:12.129961 2715 raft_consensus.cc:729] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:12.130172 2715 consensus_queue.cc:260] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.130332 2715 raft_consensus.cc:388] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:12.130445 2715 raft_consensus.cc:482] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:12.130543 2715 raft_consensus.cc:3037] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:04:12.133010 2715 raft_consensus.cc:504] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.133256 2715 leader_election.cc:302] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:12.133464 2715 leader_election.cc:288] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 14:04:12.133527 2717 raft_consensus.cc:2781] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:04:12.133690 2717 raft_consensus.cc:686] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:12.133877 2715 ts_tablet_manager.cc:1398] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20240501 14:04:12.133899 2717 consensus_queue.cc:237] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.134119 2715 tablet_bootstrap.cc:492] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:12.135632 2715 tablet_bootstrap.cc:654] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8: Neither blocks nor log segments found. Creating new log.
I20240501 14:04:12.136170 2645 catalog_manager.cc:5484] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1). New cstate: current_term: 1 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:12.137341 2715 tablet_bootstrap.cc:492] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8: No bootstrap required, opened a new log
I20240501 14:04:12.137465 2715 ts_tablet_manager.cc:1367] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20240501 14:04:12.138110 2715 raft_consensus.cc:348] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.138257 2715 raft_consensus.cc:374] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:04:12.138366 2715 raft_consensus.cc:729] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:12.138561 2715 consensus_queue.cc:260] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.138697 2715 raft_consensus.cc:388] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:12.138782 2715 raft_consensus.cc:482] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:12.138896 2715 raft_consensus.cc:3037] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:04:12.140686 2715 raft_consensus.cc:504] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.140872 2715 leader_election.cc:302] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:12.141007 2715 leader_election.cc:288] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 14:04:12.141088 2717 raft_consensus.cc:2781] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:04:12.141240 2717 raft_consensus.cc:686] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:12.141453 2715 ts_tablet_manager.cc:1398] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20240501 14:04:12.141484 2717 consensus_queue.cc:237] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.141698 2715 tablet_bootstrap.cc:492] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:12.143222 2715 tablet_bootstrap.cc:654] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8: Neither blocks nor log segments found. Creating new log.
I20240501 14:04:12.143582 2645 catalog_manager.cc:5484] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1). New cstate: current_term: 1 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:12.144922 2715 tablet_bootstrap.cc:492] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8: No bootstrap required, opened a new log
I20240501 14:04:12.145072 2715 ts_tablet_manager.cc:1367] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20240501 14:04:12.145716 2715 raft_consensus.cc:348] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.145864 2715 raft_consensus.cc:374] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:04:12.145943 2715 raft_consensus.cc:729] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:12.146167 2715 consensus_queue.cc:260] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.146288 2715 raft_consensus.cc:388] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:12.146378 2715 raft_consensus.cc:482] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:12.146483 2715 raft_consensus.cc:3037] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:04:12.148675 2715 raft_consensus.cc:504] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.148856 2715 leader_election.cc:302] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:12.149037 2715 leader_election.cc:288] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 14:04:12.149092 2717 raft_consensus.cc:2781] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:04:12.149279 2717 raft_consensus.cc:686] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:12.149443 2715 ts_tablet_manager.cc:1398] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240501 14:04:12.149514 2717 consensus_queue.cc:237] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.149693 2715 tablet_bootstrap.cc:492] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:12.151237 2715 tablet_bootstrap.cc:654] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Neither blocks nor log segments found. Creating new log.
I20240501 14:04:12.151598 2645 catalog_manager.cc:5484] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1). New cstate: current_term: 1 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:12.152889 2715 tablet_bootstrap.cc:492] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8: No bootstrap required, opened a new log
I20240501 14:04:12.153024 2715 ts_tablet_manager.cc:1367] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 14:04:12.153636 2715 raft_consensus.cc:348] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.153757 2715 raft_consensus.cc:374] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:04:12.153847 2715 raft_consensus.cc:729] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:12.154042 2715 consensus_queue.cc:260] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.154196 2715 raft_consensus.cc:388] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:12.154275 2715 raft_consensus.cc:482] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:12.154393 2715 raft_consensus.cc:3037] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:04:12.156374 2715 raft_consensus.cc:504] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.156574 2715 leader_election.cc:302] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:12.156718 2715 leader_election.cc:288] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 14:04:12.156800 2717 raft_consensus.cc:2781] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:04:12.156966 2717 raft_consensus.cc:686] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:12.157147 2715 ts_tablet_manager.cc:1398] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20240501 14:04:12.157207 2717 consensus_queue.cc:237] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.157415 2715 tablet_bootstrap.cc:492] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:12.159096 2715 tablet_bootstrap.cc:654] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Neither blocks nor log segments found. Creating new log.
I20240501 14:04:12.159307 2645 catalog_manager.cc:5484] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1). New cstate: current_term: 1 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:12.160976 2715 tablet_bootstrap.cc:492] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8: No bootstrap required, opened a new log
I20240501 14:04:12.161113 2715 ts_tablet_manager.cc:1367] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20240501 14:04:12.161834 2715 raft_consensus.cc:348] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.162045 2715 raft_consensus.cc:374] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:04:12.162135 2715 raft_consensus.cc:729] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:12.162376 2715 consensus_queue.cc:260] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.162540 2715 raft_consensus.cc:388] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:12.162642 2715 raft_consensus.cc:482] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:12.162734 2715 raft_consensus.cc:3037] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:04:12.165016 2715 raft_consensus.cc:504] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.165196 2715 leader_election.cc:302] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:12.165352 2715 leader_election.cc:288] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 14:04:12.165431 2717 raft_consensus.cc:2781] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:04:12.165556 2717 raft_consensus.cc:686] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:12.165800 2715 ts_tablet_manager.cc:1398] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20240501 14:04:12.165773 2717 consensus_queue.cc:237] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.166045 2715 tablet_bootstrap.cc:492] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:12.167618 2715 tablet_bootstrap.cc:654] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Neither blocks nor log segments found. Creating new log.
I20240501 14:04:12.167912 2645 catalog_manager.cc:5484] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1). New cstate: current_term: 1 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:12.169322 2715 tablet_bootstrap.cc:492] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8: No bootstrap required, opened a new log
I20240501 14:04:12.169459 2715 ts_tablet_manager.cc:1367] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.003s
I20240501 14:04:12.170207 2715 raft_consensus.cc:348] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.170375 2715 raft_consensus.cc:374] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:04:12.170478 2715 raft_consensus.cc:729] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:12.170684 2715 consensus_queue.cc:260] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.170857 2715 raft_consensus.cc:388] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:12.170945 2715 raft_consensus.cc:482] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:12.171062 2715 raft_consensus.cc:3037] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:04:12.173079 2715 raft_consensus.cc:504] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.173344 2715 leader_election.cc:302] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:12.173517 2715 leader_election.cc:288] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 14:04:12.173592 2717 raft_consensus.cc:2781] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:04:12.173761 2717 raft_consensus.cc:686] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:12.173935 2715 ts_tablet_manager.cc:1398] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20240501 14:04:12.173981 2717 consensus_queue.cc:237] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.174170 2715 tablet_bootstrap.cc:492] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:12.175877 2715 tablet_bootstrap.cc:654] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Neither blocks nor log segments found. Creating new log.
I20240501 14:04:12.175860 2645 catalog_manager.cc:5484] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1). New cstate: current_term: 1 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:12.177512 2715 tablet_bootstrap.cc:492] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8: No bootstrap required, opened a new log
I20240501 14:04:12.177660 2715 ts_tablet_manager.cc:1367] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240501 14:04:12.178274 2715 raft_consensus.cc:348] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.178452 2715 raft_consensus.cc:374] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:04:12.178534 2715 raft_consensus.cc:729] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:12.178769 2715 consensus_queue.cc:260] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.178910 2715 raft_consensus.cc:388] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:12.179001 2715 raft_consensus.cc:482] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:12.179085 2715 raft_consensus.cc:3037] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:04:12.180869 2715 raft_consensus.cc:504] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.181056 2715 leader_election.cc:302] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:12.181246 2715 leader_election.cc:288] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 14:04:12.181295 2717 raft_consensus.cc:2781] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:04:12.181490 2717 raft_consensus.cc:686] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:12.181737 2715 ts_tablet_manager.cc:1398] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20240501 14:04:12.181735 2717 consensus_queue.cc:237] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.182062 2715 tablet_bootstrap.cc:492] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:12.183485 2715 tablet_bootstrap.cc:654] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Neither blocks nor log segments found. Creating new log.
I20240501 14:04:12.183952 2645 catalog_manager.cc:5484] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1). New cstate: current_term: 1 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:12.185122 2715 tablet_bootstrap.cc:492] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8: No bootstrap required, opened a new log
I20240501 14:04:12.185262 2715 ts_tablet_manager.cc:1367] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 14:04:12.185871 2715 raft_consensus.cc:348] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.186008 2715 raft_consensus.cc:374] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:04:12.186090 2715 raft_consensus.cc:729] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:12.186305 2715 consensus_queue.cc:260] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.186478 2715 raft_consensus.cc:388] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:12.186553 2715 raft_consensus.cc:482] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:12.186658 2715 raft_consensus.cc:3037] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:04:12.188688 2715 raft_consensus.cc:504] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.188935 2715 leader_election.cc:302] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:12.189114 2715 leader_election.cc:288] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 14:04:12.189165 2717 raft_consensus.cc:2781] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:04:12.189321 2717 raft_consensus.cc:686] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:12.189553 2717 consensus_queue.cc:237] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.189656 2715 ts_tablet_manager.cc:1398] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20240501 14:04:12.189900 2715 tablet_bootstrap.cc:492] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:12.191447 2715 tablet_bootstrap.cc:654] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Neither blocks nor log segments found. Creating new log.
I20240501 14:04:12.191730 2645 catalog_manager.cc:5484] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1). New cstate: current_term: 1 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:12.193146 2715 tablet_bootstrap.cc:492] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8: No bootstrap required, opened a new log
I20240501 14:04:12.193372 2715 ts_tablet_manager.cc:1367] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20240501 14:04:12.194093 2715 raft_consensus.cc:348] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.194272 2715 raft_consensus.cc:374] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:04:12.194348 2715 raft_consensus.cc:729] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:12.194537 2715 consensus_queue.cc:260] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.194671 2715 raft_consensus.cc:388] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:12.194764 2715 raft_consensus.cc:482] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:12.194859 2715 raft_consensus.cc:3037] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:04:12.196897 2715 raft_consensus.cc:504] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.197165 2715 leader_election.cc:302] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:12.197352 2715 leader_election.cc:288] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 14:04:12.197419 2717 raft_consensus.cc:2781] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:04:12.197726 2715 ts_tablet_manager.cc:1398] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.004s user 0.001s sys 0.003s
I20240501 14:04:12.197801 2717 raft_consensus.cc:686] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:12.198029 2715 tablet_bootstrap.cc:492] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:12.198076 2717 consensus_queue.cc:237] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.199836 2715 tablet_bootstrap.cc:654] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8: Neither blocks nor log segments found. Creating new log.
I20240501 14:04:12.200335 2645 catalog_manager.cc:5484] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1). New cstate: current_term: 1 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:12.201506 2715 tablet_bootstrap.cc:492] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8: No bootstrap required, opened a new log
I20240501 14:04:12.201625 2715 ts_tablet_manager.cc:1367] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240501 14:04:12.202250 2715 raft_consensus.cc:348] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.202395 2715 raft_consensus.cc:374] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:04:12.202481 2715 raft_consensus.cc:729] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:12.202668 2715 consensus_queue.cc:260] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.202821 2715 raft_consensus.cc:388] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:12.202910 2715 raft_consensus.cc:482] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:12.203020 2715 raft_consensus.cc:3037] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:04:12.204936 2715 raft_consensus.cc:504] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.205140 2715 leader_election.cc:302] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:12.205314 2715 leader_election.cc:288] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 14:04:12.205384 2717 raft_consensus.cc:2781] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:04:12.205549 2717 raft_consensus.cc:686] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:12.205785 2715 ts_tablet_manager.cc:1398] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20240501 14:04:12.205781 2717 consensus_queue.cc:237] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.206068 2715 tablet_bootstrap.cc:492] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:12.207589 2715 tablet_bootstrap.cc:654] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Neither blocks nor log segments found. Creating new log.
I20240501 14:04:12.207806 2645 catalog_manager.cc:5484] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1). New cstate: current_term: 1 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:12.209240 2715 tablet_bootstrap.cc:492] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8: No bootstrap required, opened a new log
I20240501 14:04:12.209391 2715 ts_tablet_manager.cc:1367] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240501 14:04:12.209942 2715 raft_consensus.cc:348] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.210125 2715 raft_consensus.cc:374] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:04:12.210220 2715 raft_consensus.cc:729] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:12.210453 2715 consensus_queue.cc:260] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.210594 2715 raft_consensus.cc:388] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:12.210709 2715 raft_consensus.cc:482] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:12.210808 2715 raft_consensus.cc:3037] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:04:12.213270 2715 raft_consensus.cc:504] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.213455 2715 leader_election.cc:302] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:12.213603 2715 leader_election.cc:288] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 14:04:12.213675 2717 raft_consensus.cc:2781] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:04:12.213918 2717 raft_consensus.cc:686] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:12.214020 2715 ts_tablet_manager.cc:1398] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.005s user 0.003s sys 0.001s
I20240501 14:04:12.214150 2717 consensus_queue.cc:237] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.214265 2715 tablet_bootstrap.cc:492] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:12.215771 2715 tablet_bootstrap.cc:654] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Neither blocks nor log segments found. Creating new log.
I20240501 14:04:12.216658 2645 catalog_manager.cc:5484] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1). New cstate: current_term: 1 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:12.217584 2715 tablet_bootstrap.cc:492] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8: No bootstrap required, opened a new log
I20240501 14:04:12.217715 2715 ts_tablet_manager.cc:1367] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240501 14:04:12.218384 2715 raft_consensus.cc:348] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.218546 2715 raft_consensus.cc:374] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:04:12.218640 2715 raft_consensus.cc:729] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:12.218851 2715 consensus_queue.cc:260] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.219048 2715 raft_consensus.cc:388] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:12.219135 2715 raft_consensus.cc:482] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:12.219251 2715 raft_consensus.cc:3037] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:04:12.221261 2715 raft_consensus.cc:504] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.221465 2715 leader_election.cc:302] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:12.221628 2715 leader_election.cc:288] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 14:04:12.221695 2717 raft_consensus.cc:2781] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:04:12.221896 2717 raft_consensus.cc:686] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:12.222115 2715 ts_tablet_manager.cc:1398] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20240501 14:04:12.222116 2717 consensus_queue.cc:237] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.222416 2715 tablet_bootstrap.cc:492] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:12.223927 2715 tablet_bootstrap.cc:654] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8: Neither blocks nor log segments found. Creating new log.
I20240501 14:04:12.224169 2645 catalog_manager.cc:5484] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1). New cstate: current_term: 1 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:12.225669 2715 tablet_bootstrap.cc:492] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8: No bootstrap required, opened a new log
I20240501 14:04:12.225805 2715 ts_tablet_manager.cc:1367] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 14:04:12.226469 2715 raft_consensus.cc:348] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.226649 2715 raft_consensus.cc:374] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:04:12.226723 2715 raft_consensus.cc:729] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:12.226960 2715 consensus_queue.cc:260] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.227133 2715 raft_consensus.cc:388] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:12.227210 2715 raft_consensus.cc:482] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:12.227278 2715 raft_consensus.cc:3037] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:04:12.229292 2715 raft_consensus.cc:504] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.229465 2715 leader_election.cc:302] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:12.229629 2715 leader_election.cc:288] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 14:04:12.229734 2717 raft_consensus.cc:2781] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:04:12.229863 2717 raft_consensus.cc:686] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:12.230094 2715 ts_tablet_manager.cc:1398] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20240501 14:04:12.230091 2717 consensus_queue.cc:237] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.230383 2715 tablet_bootstrap.cc:492] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:12.231915 2715 tablet_bootstrap.cc:654] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Neither blocks nor log segments found. Creating new log.
I20240501 14:04:12.232354 2645 catalog_manager.cc:5484] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1). New cstate: current_term: 1 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:12.233613 2715 tablet_bootstrap.cc:492] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8: No bootstrap required, opened a new log
I20240501 14:04:12.233738 2715 ts_tablet_manager.cc:1367] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20240501 14:04:12.234346 2715 raft_consensus.cc:348] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.234494 2715 raft_consensus.cc:374] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:04:12.234596 2715 raft_consensus.cc:729] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:12.234769 2715 consensus_queue.cc:260] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.234899 2715 raft_consensus.cc:388] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:12.234977 2715 raft_consensus.cc:482] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:12.235059 2715 raft_consensus.cc:3037] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:04:12.236938 2715 raft_consensus.cc:504] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.237139 2715 leader_election.cc:302] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:12.237289 2715 leader_election.cc:288] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 14:04:12.237406 2717 raft_consensus.cc:2781] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:04:12.237598 2717 raft_consensus.cc:686] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:12.237695 2715 ts_tablet_manager.cc:1398] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20240501 14:04:12.237819 2717 consensus_queue.cc:237] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.237944 2715 tablet_bootstrap.cc:492] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:12.240087 2645 catalog_manager.cc:5484] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1). New cstate: current_term: 1 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:12.260481 2715 tablet_bootstrap.cc:654] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8: Neither blocks nor log segments found. Creating new log.
I20240501 14:04:12.262434 2715 tablet_bootstrap.cc:492] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8: No bootstrap required, opened a new log
I20240501 14:04:12.262574 2715 ts_tablet_manager.cc:1367] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.000s
I20240501 14:04:12.263154 2715 raft_consensus.cc:348] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.263317 2715 raft_consensus.cc:374] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:04:12.263363 2715 raft_consensus.cc:729] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:12.263568 2715 consensus_queue.cc:260] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.263703 2715 raft_consensus.cc:388] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:12.263769 2715 raft_consensus.cc:482] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:12.263835 2715 raft_consensus.cc:3037] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:04:12.265617 2715 raft_consensus.cc:504] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.265806 2715 leader_election.cc:302] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:12.265975 2715 leader_election.cc:288] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 14:04:12.266068 2717 raft_consensus.cc:2781] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:04:12.266225 2717 raft_consensus.cc:686] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:12.266479 2715 ts_tablet_manager.cc:1398] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240501 14:04:12.266539 2717 consensus_queue.cc:237] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.266765 2715 tablet_bootstrap.cc:492] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:12.268383 2715 tablet_bootstrap.cc:654] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8: Neither blocks nor log segments found. Creating new log.
I20240501 14:04:12.269241 2645 catalog_manager.cc:5484] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1). New cstate: current_term: 1 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:12.270032 2715 tablet_bootstrap.cc:492] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8: No bootstrap required, opened a new log
I20240501 14:04:12.270181 2715 ts_tablet_manager.cc:1367] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20240501 14:04:12.270900 2715 raft_consensus.cc:348] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.271021 2715 raft_consensus.cc:374] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:04:12.271085 2715 raft_consensus.cc:729] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:12.271279 2715 consensus_queue.cc:260] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.271456 2715 raft_consensus.cc:388] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:12.271538 2715 raft_consensus.cc:482] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:12.271646 2715 raft_consensus.cc:3037] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:04:12.274046 2715 raft_consensus.cc:504] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.274312 2715 leader_election.cc:302] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:12.274518 2715 leader_election.cc:288] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 14:04:12.274574 2717 raft_consensus.cc:2781] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:04:12.274825 2717 raft_consensus.cc:686] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:12.274963 2715 ts_tablet_manager.cc:1398] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20240501 14:04:12.275059 2717 consensus_queue.cc:237] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.275228 2715 tablet_bootstrap.cc:492] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:12.276751 2715 tablet_bootstrap.cc:654] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8: Neither blocks nor log segments found. Creating new log.
I20240501 14:04:12.277565 2645 catalog_manager.cc:5484] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1). New cstate: current_term: 1 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:12.278496 2715 tablet_bootstrap.cc:492] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8: No bootstrap required, opened a new log
I20240501 14:04:12.278625 2715 ts_tablet_manager.cc:1367] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20240501 14:04:12.279171 2715 raft_consensus.cc:348] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.279352 2715 raft_consensus.cc:374] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:04:12.279428 2715 raft_consensus.cc:729] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:12.279639 2715 consensus_queue.cc:260] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.279783 2715 raft_consensus.cc:388] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:12.279877 2715 raft_consensus.cc:482] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:12.279980 2715 raft_consensus.cc:3037] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:04:12.281915 2715 raft_consensus.cc:504] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.282114 2715 leader_election.cc:302] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:12.282290 2715 leader_election.cc:288] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 14:04:12.282353 2717 raft_consensus.cc:2781] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:04:12.282552 2717 raft_consensus.cc:686] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:12.282688 2715 ts_tablet_manager.cc:1398] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20240501 14:04:12.282814 2717 consensus_queue.cc:237] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.282939 2715 tablet_bootstrap.cc:492] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:12.284559 2715 tablet_bootstrap.cc:654] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Neither blocks nor log segments found. Creating new log.
I20240501 14:04:12.285320 2645 catalog_manager.cc:5484] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1). New cstate: current_term: 1 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:12.286332 2715 tablet_bootstrap.cc:492] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8: No bootstrap required, opened a new log
I20240501 14:04:12.286445 2715 ts_tablet_manager.cc:1367] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240501 14:04:12.287005 2715 raft_consensus.cc:348] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.287179 2715 raft_consensus.cc:374] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:04:12.287277 2715 raft_consensus.cc:729] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:12.287472 2715 consensus_queue.cc:260] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.287655 2715 raft_consensus.cc:388] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:12.287756 2715 raft_consensus.cc:482] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:12.287859 2715 raft_consensus.cc:3037] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:04:12.290313 2715 raft_consensus.cc:504] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.290609 2715 leader_election.cc:302] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:12.290808 2715 leader_election.cc:288] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 14:04:12.290931 2717 raft_consensus.cc:2781] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:04:12.291194 2717 raft_consensus.cc:686] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:12.291399 2715 ts_tablet_manager.cc:1398] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.005s user 0.001s sys 0.004s
I20240501 14:04:12.291433 2717 consensus_queue.cc:237] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:12.293915 2645 catalog_manager.cc:5484] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1). New cstate: current_term: 1 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:15.846944 30620 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
/tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.231.2:41687
--local_ip_for_outbound_sockets=127.29.231.2
--tserver_master_addrs=127.29.231.62:39165
--webserver_port=39667
--webserver_interface=127.29.231.2
--builtin_ntp_servers=127.29.231.20:37607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=20 with env {}
W20240501 14:04:16.193852 2811 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 14:04:16.194157 2811 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 14:04:16.194250 2811 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 14:04:16.201714 2811 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 14:04:16.201915 2811 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.231.2
I20240501 14:04:16.210920 2811 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.231.20:37607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.231.2:41687
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.231.2
--webserver_port=39667
--tserver_master_addrs=127.29.231.62:39165
--num_tablets_to_copy_simultaneously=20
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.231.2
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 13:43:20 UTC on efd1337a2aa3
build id 75
ASAN enabled
I20240501 14:04:16.212348 2811 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 14:04:16.214169 2811 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:04:16.226359 2816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:04:16.227034 2817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:04:16.227752 2819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:04:16.228471 2811 server_base.cc:1034] running on GCE node
I20240501 14:04:16.229036 2811 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 14:04:16.229912 2811 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 14:04:16.231128 2811 hybrid_clock.cc:648] HybridClock initialized: now 1714572256231052 us; error 51 us; skew 500 ppm
I20240501 14:04:16.231429 2811 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:04:16.233649 2811 webserver.cc:460] Webserver started at http://127.29.231.2:39667/ using document root <none> and password file <none>
I20240501 14:04:16.234400 2811 fs_manager.cc:359] Metadata directory not provided
I20240501 14:04:16.234535 2811 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:04:16.239696 2811 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20240501 14:04:16.242403 2825 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:04:16.243789 2811 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20240501 14:04:16.243938 2811 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-1/data,/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-1/wal
uuid: "875af4e39aa44837abfe99827303b395"
format_stamp: "Formatted at 2024-05-01 14:04:10 on dist-test-slave-4827"
I20240501 14:04:16.244845 2811 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:04:16.265182 2811 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:04:16.266005 2811 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 14:04:16.266275 2811 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:04:16.267199 2811 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 14:04:16.268720 2811 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 14:04:16.268831 2811 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 14:04:16.268918 2811 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 14:04:16.268970 2811 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 14:04:16.299438 2811 rpc_server.cc:307] RPC server started. Bound to: 127.29.231.2:41687
I20240501 14:04:16.299494 2937 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.231.2:41687 every 8 connection(s)
I20240501 14:04:16.300995 2811 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-1/data/info.pb
I20240501 14:04:16.309331 30620 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu as pid 2811
I20240501 14:04:16.311167 30620 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu pid 2343
I20240501 14:04:16.312505 2465 generic_service.cc:196] Checking for leaks (request via RPC)
I20240501 14:04:16.316133 2938 heartbeater.cc:347] Connected to a master server at 127.29.231.62:39165
I20240501 14:04:16.316464 2938 heartbeater.cc:464] Registering TS with master...
I20240501 14:04:16.317523 2938 heartbeater.cc:511] Master 127.29.231.62:39165 requested a full tablet report, sending...
I20240501 14:04:16.319195 2638 ts_manager.cc:194] Registered new tserver with Master: 875af4e39aa44837abfe99827303b395 (127.29.231.2:41687)
I20240501 14:04:16.321400 2638 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.231.2:37219
I20240501 14:04:16.527500 30620 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu with pid 2343
W20240501 14:04:16.560936 2632 connection.cc:535] server connection from 127.29.231.1:43465 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20240501 14:04:16.561776 30620 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
/tmp/dist-test-taskxseJ1W/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.231.1:33163
--local_ip_for_outbound_sockets=127.29.231.1
--tserver_master_addrs=127.29.231.62:39165
--webserver_port=43911
--webserver_interface=127.29.231.1
--builtin_ntp_servers=127.29.231.20:37607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=20
--rpc_service_queue_length=1
--rpc_num_service_threads=1 with env {}
W20240501 14:04:16.885502 2943 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240501 14:04:16.885782 2943 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240501 14:04:16.885926 2943 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240501 14:04:16.893342 2943 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240501 14:04:16.893573 2943 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.231.1
I20240501 14:04:16.902765 2943 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.231.20:37607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.231.1:33163
--rpc_num_service_threads=1
--rpc_server_allow_ephemeral_ports=true
--rpc_service_queue_length=1
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.231.1
--webserver_port=43911
--tserver_master_addrs=127.29.231.62:39165
--num_tablets_to_copy_simultaneously=20
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.231.1
--log_dir=/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type FASTDEBUG
built by None at 01 May 2024 13:43:20 UTC on efd1337a2aa3
build id 75
ASAN enabled
I20240501 14:04:16.904071 2943 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 14:04:16.905807 2943 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:04:16.918164 2948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:04:16.918649 2951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:04:16.919260 2949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:04:16.919937 2943 server_base.cc:1034] running on GCE node
I20240501 14:04:16.920549 2943 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240501 14:04:16.921458 2943 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240501 14:04:16.922658 2943 hybrid_clock.cc:648] HybridClock initialized: now 1714572256922601 us; error 33 us; skew 500 ppm
I20240501 14:04:16.922936 2943 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 14:04:16.925089 2943 webserver.cc:460] Webserver started at http://127.29.231.1:43911/ using document root <none> and password file <none>
I20240501 14:04:16.925802 2943 fs_manager.cc:359] Metadata directory not provided
I20240501 14:04:16.925940 2943 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:04:16.931015 2943 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.003s
I20240501 14:04:16.935756 2957 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 14:04:16.937062 2943 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240501 14:04:16.937217 2943 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-0/data,/tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-0/wal
uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8"
format_stamp: "Formatted at 2024-05-01 14:04:09 on dist-test-slave-4827"
I20240501 14:04:16.938102 2943 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:04:16.957443 2943 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 14:04:16.958287 2943 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 14:04:16.958557 2943 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:04:16.959503 2943 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 14:04:16.961681 2964 ts_tablet_manager.cc:522] Loading tablet metadata (0/20 complete)
I20240501 14:04:16.999859 2943 ts_tablet_manager.cc:559] Loaded tablet metadata (20 total tablets, 20 live tablets)
I20240501 14:04:17.000025 2943 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.039s user 0.003s sys 0.000s
I20240501 14:04:17.000167 2943 ts_tablet_manager.cc:574] Registering tablets (0/20 complete)
I20240501 14:04:17.003614 2964 tablet_bootstrap.cc:492] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:17.032969 2943 ts_tablet_manager.cc:590] Registered 20 tablets
I20240501 14:04:17.033066 2943 ts_tablet_manager.cc:569] Time spent register tablets: real 0.033s user 0.026s sys 0.007s
I20240501 14:04:17.041896 2943 rpc_server.cc:307] RPC server started. Bound to: 127.29.231.1:33163
I20240501 14:04:17.041993 2975 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.231.1:33163 every 8 connection(s)
I20240501 14:04:17.042953 2964 log.cc:824] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8: Log is configured to *not* fsync() on all Append() calls
I20240501 14:04:17.043434 2943 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskxseJ1W/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714572224537460-30620-0/minicluster-data/ts-0/data/info.pb
I20240501 14:04:17.053535 30620 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskxseJ1W/build/asan/bin/kudu as pid 2943
I20240501 14:04:17.057317 2977 heartbeater.cc:347] Connected to a master server at 127.29.231.62:39165
I20240501 14:04:17.057745 2977 heartbeater.cc:464] Registering TS with master...
I20240501 14:04:17.058961 2977 heartbeater.cc:511] Master 127.29.231.62:39165 requested a full tablet report, sending...
I20240501 14:04:17.063735 2638 ts_manager.cc:194] Re-registered known tserver with Master: 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1:33163)
I20240501 14:04:17.072224 2638 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.231.1:34815
I20240501 14:04:17.203635 2964 tablet_bootstrap.cc:492] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=192 overwritten=0 applied=192 ignored=0} inserts{seen=514 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:04:17.204170 2964 tablet_bootstrap.cc:492] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap complete.
I20240501 14:04:17.205363 2964 ts_tablet_manager.cc:1367] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.202s user 0.177s sys 0.023s
I20240501 14:04:17.210217 2964 raft_consensus.cc:348] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:17.210932 2964 raft_consensus.cc:729] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:17.211516 2964 consensus_queue.cc:260] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 192, Last appended: 1.192, Last appended by leader: 192, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:17.211709 2964 raft_consensus.cc:388] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:17.211819 2964 raft_consensus.cc:482] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:17.211980 2964 raft_consensus.cc:3037] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:04:17.215633 2964 raft_consensus.cc:504] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:17.216109 2964 leader_election.cc:302] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:17.216676 2964 leader_election.cc:288] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 14:04:17.216845 2983 raft_consensus.cc:2781] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:04:17.217917 2977 heartbeater.cc:503] Master 127.29.231.62:39165 was elected leader, sending a full tablet report...
I20240501 14:04:17.218029 2983 raft_consensus.cc:686] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:17.218238 2964 ts_tablet_manager.cc:1398] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.013s user 0.005s sys 0.008s
I20240501 14:04:17.218637 2964 tablet_bootstrap.cc:492] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:17.218560 2983 consensus_queue.cc:237] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 192, Committed index: 192, Last appended: 1.192, Last appended by leader: 192, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:17.225395 2638 catalog_manager.cc:5484] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:17.324882 2938 heartbeater.cc:503] Master 127.29.231.62:39165 was elected leader, sending a full tablet report...
I20240501 14:04:17.394894 2964 tablet_bootstrap.cc:492] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=191 overwritten=0 applied=191 ignored=0} inserts{seen=521 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:04:17.395386 2964 tablet_bootstrap.cc:492] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap complete.
I20240501 14:04:17.396359 2964 ts_tablet_manager.cc:1367] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.178s user 0.154s sys 0.024s
I20240501 14:04:17.397133 2964 raft_consensus.cc:348] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:17.397298 2964 raft_consensus.cc:729] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:17.397526 2964 consensus_queue.cc:260] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 191, Last appended: 1.191, Last appended by leader: 191, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:17.397657 2964 raft_consensus.cc:388] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:17.397745 2964 raft_consensus.cc:482] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:17.397830 2964 raft_consensus.cc:3037] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:04:17.399760 2964 raft_consensus.cc:504] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:17.399966 2964 leader_election.cc:302] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:17.400159 2964 leader_election.cc:288] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 14:04:17.400254 2983 raft_consensus.cc:2781] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:04:17.400465 2983 raft_consensus.cc:686] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:17.400593 2964 ts_tablet_manager.cc:1398] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240501 14:04:17.400713 2983 consensus_queue.cc:237] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 191, Committed index: 191, Last appended: 1.191, Last appended by leader: 191, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:17.400866 2964 tablet_bootstrap.cc:492] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:17.403092 2638 catalog_manager.cc:5484] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:17.583464 2964 tablet_bootstrap.cc:492] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=195 overwritten=0 applied=195 ignored=0} inserts{seen=541 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:04:17.584012 2964 tablet_bootstrap.cc:492] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap complete.
I20240501 14:04:17.585160 2964 ts_tablet_manager.cc:1367] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.184s user 0.155s sys 0.028s
I20240501 14:04:17.585784 2964 raft_consensus.cc:348] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:17.585945 2964 raft_consensus.cc:729] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:17.586163 2964 consensus_queue.cc:260] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:17.586313 2964 raft_consensus.cc:388] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:17.586392 2964 raft_consensus.cc:482] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:17.586512 2964 raft_consensus.cc:3037] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:04:17.589002 2964 raft_consensus.cc:504] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:17.589262 2964 leader_election.cc:302] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:17.589457 2964 leader_election.cc:288] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 14:04:17.589560 2983 raft_consensus.cc:2781] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:04:17.589757 2983 raft_consensus.cc:686] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:17.589994 2964 ts_tablet_manager.cc:1398] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20240501 14:04:17.590080 2983 consensus_queue.cc:237] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 195, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:17.590245 2964 tablet_bootstrap.cc:492] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:17.592280 2638 catalog_manager.cc:5484] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:17.767390 2964 tablet_bootstrap.cc:492] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=198 overwritten=0 applied=198 ignored=0} inserts{seen=568 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:04:17.767839 2964 tablet_bootstrap.cc:492] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap complete.
I20240501 14:04:17.768877 2964 ts_tablet_manager.cc:1367] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.179s user 0.154s sys 0.024s
I20240501 14:04:17.769490 2964 raft_consensus.cc:348] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:17.769641 2964 raft_consensus.cc:729] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:17.769881 2964 consensus_queue.cc:260] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 198, Last appended: 1.198, Last appended by leader: 198, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:17.770021 2964 raft_consensus.cc:388] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:17.770121 2964 raft_consensus.cc:482] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:17.770205 2964 raft_consensus.cc:3037] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:04:17.771965 2964 raft_consensus.cc:504] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:17.772174 2964 leader_election.cc:302] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:17.772408 2964 leader_election.cc:288] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 14:04:17.772464 2983 raft_consensus.cc:2781] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:04:17.772678 2983 raft_consensus.cc:686] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:17.772843 2964 ts_tablet_manager.cc:1398] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240501 14:04:17.772931 2983 consensus_queue.cc:237] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 198, Committed index: 198, Last appended: 1.198, Last appended by leader: 198, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:17.773108 2964 tablet_bootstrap.cc:492] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:17.775450 2638 catalog_manager.cc:5484] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:17.948362 2964 tablet_bootstrap.cc:492] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=197 overwritten=0 applied=197 ignored=0} inserts{seen=546 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:04:17.948782 2964 tablet_bootstrap.cc:492] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap complete.
I20240501 14:04:17.949757 2964 ts_tablet_manager.cc:1367] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.177s user 0.159s sys 0.016s
I20240501 14:04:17.950358 2964 raft_consensus.cc:348] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:17.950515 2964 raft_consensus.cc:729] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:17.950711 2964 consensus_queue.cc:260] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 197, Last appended: 1.197, Last appended by leader: 197, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:17.950850 2964 raft_consensus.cc:388] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:17.950906 2964 raft_consensus.cc:482] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:17.950981 2964 raft_consensus.cc:3037] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:04:17.952744 2964 raft_consensus.cc:504] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:17.952937 2964 leader_election.cc:302] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:17.953088 2964 leader_election.cc:288] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 14:04:17.953177 2983 raft_consensus.cc:2781] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:04:17.953378 2983 raft_consensus.cc:686] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:17.953605 2983 consensus_queue.cc:237] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 197, Committed index: 197, Last appended: 1.197, Last appended by leader: 197, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:17.953681 2964 ts_tablet_manager.cc:1398] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20240501 14:04:17.953918 2964 tablet_bootstrap.cc:492] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:17.956087 2638 catalog_manager.cc:5484] T f17c217d525f40a1b698b080175949cd P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:18.131520 2964 tablet_bootstrap.cc:492] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=189 overwritten=0 applied=189 ignored=0} inserts{seen=488 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:04:18.132035 2964 tablet_bootstrap.cc:492] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap complete.
I20240501 14:04:18.133134 2964 ts_tablet_manager.cc:1367] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.179s user 0.154s sys 0.024s
I20240501 14:04:18.133792 2964 raft_consensus.cc:348] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:18.133960 2964 raft_consensus.cc:729] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:18.134244 2964 consensus_queue.cc:260] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 189, Last appended: 1.189, Last appended by leader: 189, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:18.134400 2964 raft_consensus.cc:388] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:18.134496 2964 raft_consensus.cc:482] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:18.134588 2964 raft_consensus.cc:3037] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:04:18.136868 2964 raft_consensus.cc:504] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:18.137106 2964 leader_election.cc:302] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:18.137291 2964 leader_election.cc:288] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 14:04:18.137357 2983 raft_consensus.cc:2781] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:04:18.137562 2983 raft_consensus.cc:686] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:18.137727 2964 ts_tablet_manager.cc:1398] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240501 14:04:18.137804 2983 consensus_queue.cc:237] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 189, Committed index: 189, Last appended: 1.189, Last appended by leader: 189, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:18.137987 2964 tablet_bootstrap.cc:492] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:18.140028 2638 catalog_manager.cc:5484] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:18.319358 2964 tablet_bootstrap.cc:492] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=197 overwritten=0 applied=197 ignored=0} inserts{seen=533 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:04:18.319818 2964 tablet_bootstrap.cc:492] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap complete.
I20240501 14:04:18.320838 2964 ts_tablet_manager.cc:1367] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.183s user 0.134s sys 0.048s
I20240501 14:04:18.321467 2964 raft_consensus.cc:348] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:18.321640 2964 raft_consensus.cc:729] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:18.321874 2964 consensus_queue.cc:260] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 197, Last appended: 1.197, Last appended by leader: 197, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:18.322036 2964 raft_consensus.cc:388] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:18.322115 2964 raft_consensus.cc:482] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:18.322217 2964 raft_consensus.cc:3037] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:04:18.324050 2964 raft_consensus.cc:504] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:18.324306 2964 leader_election.cc:302] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:18.324492 2964 leader_election.cc:288] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 14:04:18.324599 2983 raft_consensus.cc:2781] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:04:18.324776 2983 raft_consensus.cc:686] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:18.324936 2964 ts_tablet_manager.cc:1398] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20240501 14:04:18.325003 2983 consensus_queue.cc:237] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 197, Committed index: 197, Last appended: 1.197, Last appended by leader: 197, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:18.325163 2964 tablet_bootstrap.cc:492] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:18.327451 2638 catalog_manager.cc:5484] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:18.494253 2964 tablet_bootstrap.cc:492] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=189 overwritten=0 applied=189 ignored=0} inserts{seen=501 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:04:18.494691 2964 tablet_bootstrap.cc:492] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap complete.
I20240501 14:04:18.495617 2964 ts_tablet_manager.cc:1367] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.171s user 0.151s sys 0.016s
I20240501 14:04:18.496274 2964 raft_consensus.cc:348] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:18.496425 2964 raft_consensus.cc:729] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:18.496655 2964 consensus_queue.cc:260] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 189, Last appended: 1.189, Last appended by leader: 189, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:18.496788 2964 raft_consensus.cc:388] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:18.496855 2964 raft_consensus.cc:482] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:18.496920 2964 raft_consensus.cc:3037] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:04:18.498739 2964 raft_consensus.cc:504] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:18.498927 2964 leader_election.cc:302] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:18.499091 2964 leader_election.cc:288] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 14:04:18.499188 2983 raft_consensus.cc:2781] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:04:18.499425 2983 raft_consensus.cc:686] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:18.499542 2964 ts_tablet_manager.cc:1398] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240501 14:04:18.499677 2983 consensus_queue.cc:237] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 189, Committed index: 189, Last appended: 1.189, Last appended by leader: 189, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:18.499804 2964 tablet_bootstrap.cc:492] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:18.502251 2638 catalog_manager.cc:5484] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:18.677973 2964 tablet_bootstrap.cc:492] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=188 overwritten=0 applied=188 ignored=0} inserts{seen=481 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:04:18.678550 2964 tablet_bootstrap.cc:492] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap complete.
I20240501 14:04:18.679701 2964 ts_tablet_manager.cc:1367] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.180s user 0.173s sys 0.003s
I20240501 14:04:18.680300 2964 raft_consensus.cc:348] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:18.680465 2964 raft_consensus.cc:729] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:18.680667 2964 consensus_queue.cc:260] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 188, Last appended: 1.188, Last appended by leader: 188, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:18.680809 2964 raft_consensus.cc:388] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:18.680866 2964 raft_consensus.cc:482] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:18.680941 2964 raft_consensus.cc:3037] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:04:18.682691 2964 raft_consensus.cc:504] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:18.682893 2964 leader_election.cc:302] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:18.683041 2964 leader_election.cc:288] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 14:04:18.683153 2983 raft_consensus.cc:2781] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:04:18.683365 2983 raft_consensus.cc:686] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:18.683545 2964 ts_tablet_manager.cc:1398] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20240501 14:04:18.683636 2983 consensus_queue.cc:237] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 188, Committed index: 188, Last appended: 1.188, Last appended by leader: 188, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:18.683781 2964 tablet_bootstrap.cc:492] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:18.686208 2638 catalog_manager.cc:5484] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:18.859059 2964 tablet_bootstrap.cc:492] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=194 overwritten=0 applied=194 ignored=0} inserts{seen=526 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:04:18.859520 2964 tablet_bootstrap.cc:492] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap complete.
I20240501 14:04:18.860531 2964 ts_tablet_manager.cc:1367] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.177s user 0.149s sys 0.027s
I20240501 14:04:18.861168 2964 raft_consensus.cc:348] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:18.861325 2964 raft_consensus.cc:729] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:18.861567 2964 consensus_queue.cc:260] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 194, Last appended: 1.194, Last appended by leader: 194, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:18.861697 2964 raft_consensus.cc:388] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:18.861799 2964 raft_consensus.cc:482] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:18.861892 2964 raft_consensus.cc:3037] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:04:18.863677 2964 raft_consensus.cc:504] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:18.863901 2964 leader_election.cc:302] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:18.864091 2964 leader_election.cc:288] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 14:04:18.864151 2983 raft_consensus.cc:2781] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:04:18.864647 2964 ts_tablet_manager.cc:1398] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240501 14:04:18.864728 2983 raft_consensus.cc:686] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:18.864914 2964 tablet_bootstrap.cc:492] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:18.864970 2983 consensus_queue.cc:237] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 194, Committed index: 194, Last appended: 1.194, Last appended by leader: 194, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:18.867596 2638 catalog_manager.cc:5484] T 0ff204737078438c933a74bd0336fde4 P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:19.045264 2964 tablet_bootstrap.cc:492] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=200 overwritten=0 applied=200 ignored=0} inserts{seen=534 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:04:19.045904 2964 tablet_bootstrap.cc:492] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap complete.
I20240501 14:04:19.047215 2964 ts_tablet_manager.cc:1367] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.182s user 0.171s sys 0.008s
I20240501 14:04:19.048032 2964 raft_consensus.cc:348] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:19.048266 2964 raft_consensus.cc:729] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:19.048589 2964 consensus_queue.cc:260] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 200, Last appended: 1.200, Last appended by leader: 200, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:19.048782 2964 raft_consensus.cc:388] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:19.048871 2964 raft_consensus.cc:482] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:19.048980 2964 raft_consensus.cc:3037] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:04:19.051259 2964 raft_consensus.cc:504] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:19.051486 2964 leader_election.cc:302] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:19.051661 2964 leader_election.cc:288] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 14:04:19.051748 2983 raft_consensus.cc:2781] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:04:19.051942 2983 raft_consensus.cc:686] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:19.052165 2964 ts_tablet_manager.cc:1398] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.005s user 0.001s sys 0.004s
I20240501 14:04:19.052208 2983 consensus_queue.cc:237] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 200, Committed index: 200, Last appended: 1.200, Last appended by leader: 200, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:19.052433 2964 tablet_bootstrap.cc:492] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:19.058449 2638 catalog_manager.cc:5484] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:19.252600 2964 tablet_bootstrap.cc:492] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=196 overwritten=0 applied=196 ignored=0} inserts{seen=561 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:04:19.253172 2964 tablet_bootstrap.cc:492] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap complete.
I20240501 14:04:19.254459 2964 ts_tablet_manager.cc:1367] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.202s user 0.164s sys 0.036s
I20240501 14:04:19.255354 2964 raft_consensus.cc:348] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:19.255569 2964 raft_consensus.cc:729] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:19.255885 2964 consensus_queue.cc:260] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 196, Last appended: 1.196, Last appended by leader: 196, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:19.256120 2964 raft_consensus.cc:388] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:19.256261 2964 raft_consensus.cc:482] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:19.256381 2964 raft_consensus.cc:3037] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:04:19.259461 2964 raft_consensus.cc:504] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:19.259733 2964 leader_election.cc:302] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:19.259956 2964 leader_election.cc:288] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 14:04:19.260042 2983 raft_consensus.cc:2781] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:04:19.260282 2983 raft_consensus.cc:686] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:19.260504 2964 ts_tablet_manager.cc:1398] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20240501 14:04:19.260571 2983 consensus_queue.cc:237] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 196, Committed index: 196, Last appended: 1.196, Last appended by leader: 196, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:19.260783 2964 tablet_bootstrap.cc:492] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:19.271725 2638 catalog_manager.cc:5484] T 80972674f56c44f7b4b684d81177cd7e P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:19.448305 2964 tablet_bootstrap.cc:492] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=197 overwritten=0 applied=197 ignored=0} inserts{seen=539 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:04:19.448797 2964 tablet_bootstrap.cc:492] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap complete.
I20240501 14:04:19.449787 2964 ts_tablet_manager.cc:1367] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.189s user 0.172s sys 0.015s
I20240501 14:04:19.450408 2964 raft_consensus.cc:348] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:19.450580 2964 raft_consensus.cc:729] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:19.450832 2964 consensus_queue.cc:260] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 197, Last appended: 1.197, Last appended by leader: 197, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:19.450999 2964 raft_consensus.cc:388] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:19.451086 2964 raft_consensus.cc:482] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:19.451196 2964 raft_consensus.cc:3037] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:04:19.453510 2964 raft_consensus.cc:504] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:19.453796 2964 leader_election.cc:302] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:19.453996 2964 leader_election.cc:288] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 14:04:19.454134 2983 raft_consensus.cc:2781] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:04:19.454602 2964 ts_tablet_manager.cc:1398] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.005s user 0.000s sys 0.004s
I20240501 14:04:19.454679 2983 raft_consensus.cc:686] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:19.454856 2964 tablet_bootstrap.cc:492] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:19.454973 2983 consensus_queue.cc:237] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 197, Committed index: 197, Last appended: 1.197, Last appended by leader: 197, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:19.458302 2638 catalog_manager.cc:5484] T 9bc0426756ed4034bfd9b99d36212481 P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:19.631712 2964 tablet_bootstrap.cc:492] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=188 overwritten=0 applied=188 ignored=0} inserts{seen=505 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:04:19.632139 2964 tablet_bootstrap.cc:492] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap complete.
I20240501 14:04:19.633112 2964 ts_tablet_manager.cc:1367] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.178s user 0.161s sys 0.016s
I20240501 14:04:19.633726 2964 raft_consensus.cc:348] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:19.633873 2964 raft_consensus.cc:729] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:19.634071 2964 consensus_queue.cc:260] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 188, Last appended: 1.188, Last appended by leader: 188, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:19.634188 2964 raft_consensus.cc:388] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:19.634253 2964 raft_consensus.cc:482] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:19.634318 2964 raft_consensus.cc:3037] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:04:19.636060 2964 raft_consensus.cc:504] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:19.636273 2964 leader_election.cc:302] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:19.636487 2964 leader_election.cc:288] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 14:04:19.636538 2983 raft_consensus.cc:2781] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:04:19.636771 2983 raft_consensus.cc:686] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:19.636988 2964 ts_tablet_manager.cc:1398] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240501 14:04:19.636982 2983 consensus_queue.cc:237] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 188, Committed index: 188, Last appended: 1.188, Last appended by leader: 188, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:19.637374 2964 tablet_bootstrap.cc:492] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:19.639353 2638 catalog_manager.cc:5484] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:19.817996 2964 tablet_bootstrap.cc:492] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=188 overwritten=0 applied=188 ignored=0} inserts{seen=499 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:04:19.818476 2964 tablet_bootstrap.cc:492] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap complete.
I20240501 14:04:19.819536 2964 ts_tablet_manager.cc:1367] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.182s user 0.167s sys 0.012s
I20240501 14:04:19.820197 2964 raft_consensus.cc:348] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:19.820415 2964 raft_consensus.cc:729] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:19.820641 2964 consensus_queue.cc:260] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 188, Last appended: 1.188, Last appended by leader: 188, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:19.820801 2964 raft_consensus.cc:388] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:19.820885 2964 raft_consensus.cc:482] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:19.821002 2964 raft_consensus.cc:3037] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:04:19.822779 2964 raft_consensus.cc:504] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:19.822979 2964 leader_election.cc:302] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:19.823125 2964 leader_election.cc:288] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 14:04:19.823235 2983 raft_consensus.cc:2781] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:04:19.823424 2983 raft_consensus.cc:686] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:19.823596 2964 ts_tablet_manager.cc:1398] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20240501 14:04:19.823658 2983 consensus_queue.cc:237] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 188, Committed index: 188, Last appended: 1.188, Last appended by leader: 188, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:19.823818 2964 tablet_bootstrap.cc:492] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:19.826035 2638 catalog_manager.cc:5484] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:20.035144 2964 tablet_bootstrap.cc:492] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=199 overwritten=0 applied=199 ignored=0} inserts{seen=550 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:04:20.035624 2964 tablet_bootstrap.cc:492] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap complete.
I20240501 14:04:20.036669 2964 ts_tablet_manager.cc:1367] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.213s user 0.169s sys 0.012s
I20240501 14:04:20.037477 2964 raft_consensus.cc:348] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:20.037662 2964 raft_consensus.cc:729] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:20.037920 2964 consensus_queue.cc:260] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 199, Last appended: 1.199, Last appended by leader: 199, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:20.038060 2964 raft_consensus.cc:388] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:20.038153 2964 raft_consensus.cc:482] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:20.038216 2964 raft_consensus.cc:3037] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:04:20.040014 2964 raft_consensus.cc:504] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:20.040215 2964 leader_election.cc:302] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:20.040470 2964 leader_election.cc:288] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 14:04:20.040536 2983 raft_consensus.cc:2781] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:04:20.040777 2983 raft_consensus.cc:686] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:20.040992 2964 ts_tablet_manager.cc:1398] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240501 14:04:20.041057 2983 consensus_queue.cc:237] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 199, Committed index: 199, Last appended: 1.199, Last appended by leader: 199, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:20.041258 2964 tablet_bootstrap.cc:492] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:20.052269 2638 catalog_manager.cc:5484] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:20.229598 2964 tablet_bootstrap.cc:492] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=193 overwritten=0 applied=193 ignored=0} inserts{seen=540 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:04:20.230057 2964 tablet_bootstrap.cc:492] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap complete.
I20240501 14:04:20.231108 2964 ts_tablet_manager.cc:1367] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.190s user 0.175s sys 0.012s
I20240501 14:04:20.231945 2964 raft_consensus.cc:348] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:20.232165 2964 raft_consensus.cc:729] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:20.232445 2964 consensus_queue.cc:260] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 193, Last appended: 1.193, Last appended by leader: 193, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:20.232647 2964 raft_consensus.cc:388] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:20.232740 2964 raft_consensus.cc:482] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:20.232856 2964 raft_consensus.cc:3037] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:04:20.234975 2964 raft_consensus.cc:504] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:20.235185 2964 leader_election.cc:302] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:20.235330 2964 leader_election.cc:288] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 14:04:20.235438 2983 raft_consensus.cc:2781] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:04:20.235618 2983 raft_consensus.cc:686] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:20.235913 2964 ts_tablet_manager.cc:1398] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20240501 14:04:20.235889 2983 consensus_queue.cc:237] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 193, Committed index: 193, Last appended: 1.193, Last appended by leader: 193, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:20.236156 2964 tablet_bootstrap.cc:492] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:20.238298 2638 catalog_manager.cc:5484] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:20.421248 2964 tablet_bootstrap.cc:492] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=198 overwritten=0 applied=198 ignored=0} inserts{seen=547 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:04:20.421752 2964 tablet_bootstrap.cc:492] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap complete.
I20240501 14:04:20.422662 2964 ts_tablet_manager.cc:1367] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.187s user 0.160s sys 0.023s
I20240501 14:04:20.423300 2964 raft_consensus.cc:348] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:20.423455 2964 raft_consensus.cc:729] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:20.423699 2964 consensus_queue.cc:260] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 198, Last appended: 1.198, Last appended by leader: 198, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:20.423828 2964 raft_consensus.cc:388] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:20.423949 2964 raft_consensus.cc:482] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:20.424038 2964 raft_consensus.cc:3037] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:04:20.426198 2964 raft_consensus.cc:504] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:20.426431 2964 leader_election.cc:302] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:20.426630 2964 leader_election.cc:288] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 14:04:20.426663 2983 raft_consensus.cc:2781] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:04:20.426820 2983 raft_consensus.cc:686] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:20.427090 2983 consensus_queue.cc:237] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 198, Committed index: 198, Last appended: 1.198, Last appended by leader: 198, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:20.427803 2964 ts_tablet_manager.cc:1398] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.005s user 0.003s sys 0.004s
I20240501 14:04:20.428098 2964 tablet_bootstrap.cc:492] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:20.429685 2638 catalog_manager.cc:5484] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:20.592800 2964 tablet_bootstrap.cc:492] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=188 overwritten=0 applied=188 ignored=0} inserts{seen=480 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:04:20.593214 2964 tablet_bootstrap.cc:492] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap complete.
I20240501 14:04:20.594146 2964 ts_tablet_manager.cc:1367] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.166s user 0.140s sys 0.024s
I20240501 14:04:20.594777 2964 raft_consensus.cc:348] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:20.594938 2964 raft_consensus.cc:729] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:20.595185 2964 consensus_queue.cc:260] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 188, Last appended: 1.188, Last appended by leader: 188, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:20.595373 2964 raft_consensus.cc:388] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:20.595456 2964 raft_consensus.cc:482] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:20.595587 2964 raft_consensus.cc:3037] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:04:20.597540 2964 raft_consensus.cc:504] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:20.597762 2964 leader_election.cc:302] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:20.597954 2964 leader_election.cc:288] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 14:04:20.598052 2983 raft_consensus.cc:2781] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:04:20.598204 2983 raft_consensus.cc:686] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:20.598517 2964 ts_tablet_manager.cc:1398] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20240501 14:04:20.598472 2983 consensus_queue.cc:237] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 188, Committed index: 188, Last appended: 1.188, Last appended by leader: 188, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:20.598783 2964 tablet_bootstrap.cc:492] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap starting.
I20240501 14:04:20.601008 2638 catalog_manager.cc:5484] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:20.773715 2964 tablet_bootstrap.cc:492] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=195 overwritten=0 applied=195 ignored=0} inserts{seen=526 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 14:04:20.774209 2964 tablet_bootstrap.cc:492] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8: Bootstrap complete.
I20240501 14:04:20.775143 2964 ts_tablet_manager.cc:1367] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent bootstrapping tablet: real 0.176s user 0.165s sys 0.008s
I20240501 14:04:20.775784 2964 raft_consensus.cc:348] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:20.775933 2964 raft_consensus.cc:729] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Initialized, Role: FOLLOWER
I20240501 14:04:20.776162 2964 consensus_queue.cc:260] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:20.776346 2964 raft_consensus.cc:388] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:04:20.776445 2964 raft_consensus.cc:482] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:04:20.776543 2964 raft_consensus.cc:3037] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 1 FOLLOWER]: Advancing to term 2
I20240501 14:04:20.778317 2964 raft_consensus.cc:504] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:20.778522 2964 leader_election.cc:302] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 538a87f7cc2b445a8ccf6b3294c1a2d8; no voters:
I20240501 14:04:20.778702 2964 leader_election.cc:288] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240501 14:04:20.778760 2983 raft_consensus.cc:2781] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 14:04:20.778952 2983 raft_consensus.cc:686] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8 [term 2 LEADER]: Becoming Leader. State: Replica: 538a87f7cc2b445a8ccf6b3294c1a2d8, State: Running, Role: LEADER
I20240501 14:04:20.779186 2964 ts_tablet_manager.cc:1398] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240501 14:04:20.779186 2983 consensus_queue.cc:237] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 195, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } }
I20240501 14:04:20.781520 2638 catalog_manager.cc:5484] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "538a87f7cc2b445a8ccf6b3294c1a2d8" member_type: VOTER last_known_addr { host: "127.29.231.1" port: 33163 } health_report { overall_health: HEALTHY } } }
I20240501 14:04:20.801191 3049 ts_tablet_manager.cc:902] T fa5ce4bdc1af4d8888c7756810d6d18d P 875af4e39aa44837abfe99827303b395: Initiating tablet copy from peer 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1:33163)
I20240501 14:04:20.807185 3053 ts_tablet_manager.cc:902] T 8dd66af8436c4f71b019990d2800ea00 P 875af4e39aa44837abfe99827303b395: Initiating tablet copy from peer 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1:33163)
I20240501 14:04:20.808292 3057 ts_tablet_manager.cc:902] T fa6f5697f90447dbb48240766d24b855 P 875af4e39aa44837abfe99827303b395: Initiating tablet copy from peer 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1:33163)
I20240501 14:04:20.811281 3059 ts_tablet_manager.cc:902] T e9dc4d74a9064cbbbf756062d4c80dfc P 875af4e39aa44837abfe99827303b395: Initiating tablet copy from peer 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1:33163)
I20240501 14:04:20.827374 3055 ts_tablet_manager.cc:902] T 628b61d5ad54485a94c4682411a5cf41 P 875af4e39aa44837abfe99827303b395: Initiating tablet copy from peer 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1:33163)
I20240501 14:04:20.844594 3058 ts_tablet_manager.cc:902] T e03fee94218743268b60937bf81a9c79 P 875af4e39aa44837abfe99827303b395: Initiating tablet copy from peer 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1:33163)
I20240501 14:04:20.846164 3061 ts_tablet_manager.cc:902] T 26835459e32949b3ad28eb9f925f9632 P 875af4e39aa44837abfe99827303b395: Initiating tablet copy from peer 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1:33163)
I20240501 14:04:20.846750 3062 ts_tablet_manager.cc:902] T d6d953d9f0ff488a818c340f64df2b7f P 875af4e39aa44837abfe99827303b395: Initiating tablet copy from peer 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1:33163)
I20240501 14:04:20.853343 3056 ts_tablet_manager.cc:902] T 377e1da98a1f4075af0ea8bd47f79ca8 P 875af4e39aa44837abfe99827303b395: Initiating tablet copy from peer 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1:33163)
I20240501 14:04:20.853857 3054 ts_tablet_manager.cc:902] T c110feabb9164a78b4d125811a7e014a P 875af4e39aa44837abfe99827303b395: Initiating tablet copy from peer 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1:33163)
I20240501 14:04:20.854282 3052 ts_tablet_manager.cc:902] T acafe3e6514a4d50b863992d8ab16573 P 875af4e39aa44837abfe99827303b395: Initiating tablet copy from peer 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1:33163)
I20240501 14:04:20.857328 3068 ts_tablet_manager.cc:902] T 8905fd25304648629180625e85507e2a P 875af4e39aa44837abfe99827303b395: Initiating tablet copy from peer 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1:33163)
I20240501 14:04:20.859045 3049 tablet_copy_client.cc:308] T fa5ce4bdc1af4d8888c7756810d6d18d P 875af4e39aa44837abfe99827303b395: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:33163
I20240501 14:04:20.870630 3071 ts_tablet_manager.cc:902] T 664d737a61d846e3bcce7000b9617b35 P 875af4e39aa44837abfe99827303b395: Initiating tablet copy from peer 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1:33163)
I20240501 14:04:20.871788 3051 ts_tablet_manager.cc:902] T 15f78e215c5c4b15a95453f3bfae1aab P 875af4e39aa44837abfe99827303b395: Initiating tablet copy from peer 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1:33163)
I20240501 14:04:20.876397 3058 tablet_copy_client.cc:308] T e03fee94218743268b60937bf81a9c79 P 875af4e39aa44837abfe99827303b395: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:33163
I20240501 14:04:20.890645 3072 ts_tablet_manager.cc:902] T 6b414d33585c40e6bf8ffb34d0877c1e P 875af4e39aa44837abfe99827303b395: Initiating tablet copy from peer 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1:33163)
I20240501 14:04:20.928728 3105 ts_tablet_manager.cc:902] T 7791050ac9a14b1a8f7efedeae29c775 P 875af4e39aa44837abfe99827303b395: Initiating tablet copy from peer 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1:33163)
I20240501 14:04:20.946539 3061 tablet_copy_client.cc:308] T 26835459e32949b3ad28eb9f925f9632 P 875af4e39aa44837abfe99827303b395: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:33163
I20240501 14:04:20.948910 3057 tablet_copy_client.cc:308] T fa6f5697f90447dbb48240766d24b855 P 875af4e39aa44837abfe99827303b395: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:33163
I20240501 14:04:20.951107 3055 tablet_copy_client.cc:308] T 628b61d5ad54485a94c4682411a5cf41 P 875af4e39aa44837abfe99827303b395: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:33163
I20240501 14:04:20.951624 3053 tablet_copy_client.cc:308] T 8dd66af8436c4f71b019990d2800ea00 P 875af4e39aa44837abfe99827303b395: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:33163
I20240501 14:04:20.958178 2970 tablet_copy_service.cc:140] P 538a87f7cc2b445a8ccf6b3294c1a2d8: Received BeginTabletCopySession request for tablet fa5ce4bdc1af4d8888c7756810d6d18d from peer 875af4e39aa44837abfe99827303b395 ({username='slave'} at 127.29.231.2:59167)
W20240501 14:04:20.958338 2959 service_pool.cc:135] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items.
I20240501 14:04:20.958573 2970 tablet_copy_service.cc:161] P 538a87f7cc2b445a8ccf6b3294c1a2d8: Beginning new tablet copy session on tablet fa5ce4bdc1af4d8888c7756810d6d18d from peer 875af4e39aa44837abfe99827303b395 at {username='slave'} at 127.29.231.2:59167: session id = 875af4e39aa44837abfe99827303b395-fa5ce4bdc1af4d8888c7756810d6d18d
I20240501 14:04:20.958818 2959 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.29.231.2:59167 (request call id 1)
I20240501 14:04:20.959084 3054 tablet_copy_client.cc:308] T c110feabb9164a78b4d125811a7e014a P 875af4e39aa44837abfe99827303b395: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:33163
I20240501 14:04:20.959332 2959 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.29.231.2:59167 (request call id 1)
I20240501 14:04:20.959750 2959 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.29.231.2:59167 (request call id 1)
I20240501 14:04:20.959954 3062 tablet_copy_client.cc:308] T d6d953d9f0ff488a818c340f64df2b7f P 875af4e39aa44837abfe99827303b395: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:33163
I20240501 14:04:20.960103 2959 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.29.231.2:59167 (request call id 1)
I20240501 14:04:20.960829 2959 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.29.231.2:59167 (request call id 1)
I20240501 14:04:20.961377 2959 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.29.231.2:59167 (request call id 1)
I20240501 14:04:20.963699 3051 tablet_copy_client.cc:308] T 15f78e215c5c4b15a95453f3bfae1aab P 875af4e39aa44837abfe99827303b395: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:33163
I20240501 14:04:20.969161 3105 tablet_copy_client.cc:308] T 7791050ac9a14b1a8f7efedeae29c775 P 875af4e39aa44837abfe99827303b395: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:33163
I20240501 14:04:20.971977 2970 tablet_copy_source_session.cc:205] T fa5ce4bdc1af4d8888c7756810d6d18d P 538a87f7cc2b445a8ccf6b3294c1a2d8: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 14:04:20.973636 2970 tablet_copy_service.cc:140] P 538a87f7cc2b445a8ccf6b3294c1a2d8: Received BeginTabletCopySession request for tablet e03fee94218743268b60937bf81a9c79 from peer 875af4e39aa44837abfe99827303b395 ({username='slave'} at 127.29.231.2:59167)
I20240501 14:04:20.973856 2970 tablet_copy_service.cc:161] P 538a87f7cc2b445a8ccf6b3294c1a2d8: Beginning new tablet copy session on tablet e03fee94218743268b60937bf81a9c79 from peer 875af4e39aa44837abfe99827303b395 at {username='slave'} at 127.29.231.2:59167: session id = 875af4e39aa44837abfe99827303b395-e03fee94218743268b60937bf81a9c79
I20240501 14:04:20.974768 3052 tablet_copy_client.cc:308] T acafe3e6514a4d50b863992d8ab16573 P 875af4e39aa44837abfe99827303b395: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:33163
I20240501 14:04:20.975502 3068 tablet_copy_client.cc:308] T 8905fd25304648629180625e85507e2a P 875af4e39aa44837abfe99827303b395: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:33163
I20240501 14:04:20.976176 3072 tablet_copy_client.cc:308] T 6b414d33585c40e6bf8ffb34d0877c1e P 875af4e39aa44837abfe99827303b395: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:33163
I20240501 14:04:20.976665 3056 tablet_copy_client.cc:308] T 377e1da98a1f4075af0ea8bd47f79ca8 P 875af4e39aa44837abfe99827303b395: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:33163
I20240501 14:04:20.977102 3135 ts_tablet_manager.cc:902] T f17c217d525f40a1b698b080175949cd P 875af4e39aa44837abfe99827303b395: Initiating tablet copy from peer 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1:33163)
I20240501 14:04:20.977093 2959 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.29.231.2:59167 (request call id 9)
I20240501 14:04:20.977452 2959 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.29.231.2:59167 (request call id 9)
F20240501 14:04:20.977566 3135 trace_metrics.cc:68] Check failed: g_intern_map->size() < 100 (100 vs. 100) Too many interned strings: (MaintenanceMgr.queue_time_us, MaintenanceMgr.queue_time_us) (MaintenanceMgr.run_cpu_time_us, MaintenanceMgr.run_cpu_time_us) (MaintenanceMgr.run_wall_time_us, MaintenanceMgr.run_wall_time_us) (apply.queue_time_us, apply.queue_time_us) (apply.run_cpu_time_us, apply.run_cpu_time_us) (apply.run_wall_time_us, apply.run_wall_time_us) (client-negotiator.queue_time_us, client-negotiator.queue_time_us) (client-negotiator.run_cpu_time_us, client-negotiator.run_cpu_time_us) (client-negotiator.run_wall_time_us, client-negotiator.run_wall_time_us) (compiler_manager_pool.queue_time_us, compiler_manager_pool.queue_time_us) (compiler_manager_pool.run_cpu_time_us, compiler_manager_pool.run_cpu_time_us) (compiler_manager_pool.run_wall_time_us, compiler_manager_pool.run_wall_time_us) (dirs.queue_time_us, dirs.queue_time_us) (dirs.run_cpu_time_us, dirs.run_cpu_time_us) (dirs.run_wall_time_us, dirs.run_wall_time_us) (dns-resolver.queue_time_us, dns-resolver.queue_time_us) (dns-resolver.run_cpu_time_us, dns-resolver.run_cpu_time_us) (dns-resolver.run_wall_time_us, dns-resolver.run_wall_time_us) (prepare.queue_time_us, prepare.queue_time_us) (prepare.run_cpu_time_us, prepare.run_cpu_time_us) (prepare.run_wall_time_us, prepare.run_wall_time_us) (raft.queue_time_us, raft.queue_time_us) (raft.run_cpu_time_us, raft.run_cpu_time_us) (raft.run_wall_time_us, raft.run_wall_time_us) (repair_pool.queue_time_us, repair_pool.queue_time_us) (repair_pool.run_cpu_time_us, repair_pool.run_cpu_time_us) (repair_pool.run_wall_time_us, repair_pool.run_wall_time_us) (server-negotiator.queue_time_us, server-negotiator.queue_time_us) (server-negotiator.run_cpu_time_us, server-negotiator.run_cpu_time_us) (server-negotiator.run_wall_time_us, server-negotiator.run_wall_time_us) (tablet-copy.queue_time_us, tablet-copy.queue_time_us) (tablet-copy.run_cpu_time_us, tablet-copy.run_cpu_time_us) (tablet-copy.run_wall_time_us, tablet-copy.run_wall_time_us) (tablet-delete.queue_time_us, tablet-delete.queue_time_us) (tablet-delete.run_cpu_time_us, tablet-delete.run_cpu_time_us) (tablet-delete.run_wall_time_us, tablet-delete.run_wall_time_us) (tablet-download-pool-15f78e215c5c4b15a95453f3bfae1aab.queue_time_us, tablet-download-pool-15f78e215c5c4b15a95453f3bfae1aab.queue_time_us) (tablet-download-pool-15f78e215c5c4b15a95453f3bfae1aab.run_cpu_time_us, tablet-download-pool-15f78e215c5c4b15a95453f3bfae1aab.run_cpu_time_us) (tablet-download-pool-15f78e215c5c4b15a95453f3bfae1aab.run_wall_time_us, tablet-download-pool-15f78e215c5c4b15a95453f3bfae1aab.run_wall_time_us) (tablet-download-pool-26835459e32949b3ad28eb9f925f9632.queue_time_us, tablet-download-pool-26835459e32949b3ad28eb9f925f9632.queue_time_us) (tablet-download-pool-26835459e32949b3ad28eb9f925f9632.run_cpu_time_us, tablet-download-pool-26835459e32949b3ad28eb9f925f9632.run_cpu_time_us) (tablet-download-pool-26835459e32949b3ad28eb9f925f9632.run_wall_time_us, tablet-download-pool-26835459e32949b3ad28eb9f925f9632.run_wall_time_us) (tablet-download-pool-377e1da98a1f4075af0ea8bd47f79ca8.queue_time_us, tablet-download-pool-377e1da98a1f4075af0ea8bd47f79ca8.queue_time_us) (tablet-download-pool-377e1da98a1f4075af0ea8bd47f79ca8.run_cpu_time_us, tablet-download-pool-377e1da98a1f4075af0ea8bd47f79ca8.run_cpu_time_us) (tablet-download-pool-377e1da98a1f4075af0ea8bd47f79ca8.run_wall_time_us, tablet-download-pool-377e1da98a1f4075af0ea8bd47f79ca8.run_wall_time_us) (tablet-download-pool-628b61d5ad54485a94c4682411a5cf41.queue_time_us, tablet-download-pool-628b61d5ad54485a94c4682411a5cf41.queue_time_us) (tablet-download-pool-628b61d5ad54485a94c4682411a5cf41.run_cpu_time_us, tablet-download-pool-628b61d5ad54485a94c4682411a5cf41.run_cpu_time_us) (tablet-download-pool-628b61d5ad54485a94c4682411a5cf41.run_wall_time_us, tablet-download-pool-628b61d5ad54485a94c4682411a5cf41.run_wall_time_us) (tablet-download-pool-664d737a61d846e3bcce7000b9617b35.queue_time_us, tablet-download-pool-664d737a61d846e3bcce7000b9617b35.queue_time_us) (tablet-download-pool-664d737a61d846e3bcce7000b9617b35.run_cpu_time_us, tablet-download-pool-664d737a61d846e3bcce7000b9617b35.run_cpu_time_us) (tablet-download-pool-664d737a61d846e3bcce7000b9617b35.run_wall_time_us, tablet-download-pool-664d737a61d846e3bcce7000b9617b35.run_wall_time_us) (tablet-download-pool-6b414d33585c40e6bf8ffb34d0877c1e.queue_time_us, tablet-download-pool-6b414d33585c40e6bf8ffb34d0877c1e.queue_time_us) (tablet-download-pool-6b414d33585c40e6bf8ffb34d0877c1e.run_cpu_time_us, tablet-download-pool-6b414d33585c40e6bf8ffb34d0877c1e.run_cpu_time_us) (tablet-download-pool-6b414d33585c40e6bf8ffb34d0877c1e.run_wall_time_us, tablet-download-pool-6b414d33585c40e6bf8ffb34d0877c1e.run_wall_time_us) (tablet-download-pool-7791050ac9a14b1a8f7efedeae29c775.queue_time_us, tablet-download-pool-7791050ac9a14b1a8f7efedeae29c775.queue_time_us) (tablet-download-pool-7791050ac9a14b1a8f7efedeae29c775.run_cpu_time_us, tablet-download-pool-7791050ac9a14b1a8f7efedeae29c775.run_cpu_time_us) (tablet-download-pool-7791050ac9a14b1a8f7efedeae29c775.run_wall_time_us, tablet-download-pool-7791050ac9a14b1a8f7efedeae29c775.run_wall_time_us) (tablet-download-pool-8905fd25304648629180625e85507e2a.queue_time_us, tablet-download-pool-8905fd25304648629180625e85507e2a.queue_time_us) (tablet-download-pool-8905fd25304648629180625e85507e2a.run_cpu_time_us, tablet-download-pool-8905fd25304648629180625e85507e2a.run_cpu_time_us) (tablet-download-pool-8905fd25304648629180625e85507e2a.run_wall_time_us, tablet-download-pool-8905fd25304648629180625e85507e2a.run_wall_time_us) (tablet-download-pool-8dd66af8436c4f71b019990d2800ea00.queue_time_us, tablet-download-pool-8dd66af8436c4f71b019990d2800ea00.queue_time_us) (tablet-download-pool-8dd66af8436c4f71b019990d2800ea00.run_cpu_time_us, tablet-download-pool-8dd66af8436c4f71b019990d2800ea00.run_cpu_time_us) (tablet-download-pool-8dd66af8436c4f71b019990d2800ea00.run_wall_time_us, tablet-download-pool-8dd66af8436c4f71b019990d2800ea00.run_wall_time_us) (tablet-download-pool-acafe3e6514a4d50b863992d8ab16573.queue_time_us, tablet-download-pool-acafe3e6514a4d50b863992d8ab16573.queue_time_us) (tablet-download-pool-acafe3e6514a4d50b863992d8ab16573.run_cpu_time_us, tablet-download-pool-acafe3e6514a4d50b863992d8ab16573.run_cpu_time_us) (tablet-download-pool-acafe3e6514a4d50b863992d8ab16573.run_wall_time_us, tablet-download-pool-acafe3e6514a4d50b863992d8ab16573.run_wall_time_us) (tablet-download-pool-c110feabb9164a78b4d125811a7e014a.queue_time_us, tablet-download-pool-c110feabb9164a78b4d125811a7e014a.queue_time_us) (tablet-download-pool-c110feabb9164a78b4d125811a7e014a.run_cpu_time_us, tablet-download-pool-c110feabb9164a78b4d125811a7e014a.run_cpu_time_us) (tablet-download-pool-c110feabb9164a78b4d125811a7e014a.run_wall_time_us, tablet-download-pool-c110feabb9164a78b4d125811a7e014a.run_wall_time_us) (tablet-download-pool-d6d953d9f0ff488a818c340f64df2b7f.queue_time_us, tablet-download-pool-d6d953d9f0ff488a818c340f64df2b7f.queue_time_us) (tablet-download-pool-d6d953d9f0ff488a818c340f64df2b7f.run_cpu_time_us, tablet-download-pool-d6d953d9f0ff488a818c340f64df2b7f.run_cpu_time_us) (tablet-download-pool-d6d953d9f0ff488a818c340f64df2b7f.run_wall_time_us, tablet-download-pool-d6d953d9f0ff488a818c340f64df2b7f.run_wall_time_us) (tablet-download-pool-e03fee94218743268b60937bf81a9c79.queue_time_us, tablet-download-pool-e03fee94218743268b60937bf81a9c79.queue_time_us) (tablet-download-pool-e03fee94218743268b60937bf81a9c79.run_cpu_time_us, tablet-download-pool-e03fee94218743268b60937bf81a9c79.run_cpu_time_us) (tablet-download-pool-e03fee94218743268b60937bf81a9c79.run_wall_time_us, tablet-download-pool-e03fee94218743268b60937bf81a9c79.run_wall_time_us) (tablet-download-pool-e9dc4d74a9064cbbbf756062d4c80dfc.queue_time_us, tablet-download-pool-e9dc4d74a9064cbbbf756062d4c80dfc.queue_time_us) (tablet-download-pool-e9dc4d74a9064cbbbf756062d4c80dfc.run_cpu_time_us, tablet-download-pool-e9dc4d74a9064cbbbf756062d4c80dfc.run_cpu_time_us) (tablet-download-pool-e9dc4d74a9064cbbbf756062d4c80dfc.run_wall_time_us, tablet-download-pool-e9dc4d74a9064cbbbf756062d4c80dfc.run_wall_time_us) (tablet-download-pool-f17c217d525f40a1b698b080175949cd.queue_time_us, tablet-download-pool-f17c217d525f40a1b698b080175949cd.queue_time_us) (tablet-download-pool-fa5ce4bdc1af4d8888c7756810d6d18d.queue_time_us, tablet-download-pool-fa5ce4bdc1af4d8888c7756810d6d18d.queue_time_us) (tablet-download-pool-fa5ce4bdc1af4d8888c7756810d6d18d.run_cpu_time_us, tablet-download-pool-fa5ce4bdc1af4d8888c7756810d6d18d.run_cpu_time_us) (tablet-download-pool-fa5ce4bdc1af4d8888c7756810d6d18d.run_wall_time_us, tablet-download-pool-fa5ce4bdc1af4d8888c7756810d6d18d.run_wall_time_us) (tablet-download-pool-fa6f5697f90447dbb48240766d24b855.queue_time_us, tablet-download-pool-fa6f5697f90447dbb48240766d24b855.queue_time_us) (tablet-download-pool-fa6f5697f90447dbb48240766d24b855.run_cpu_time_us, tablet-download-pool-fa6f5697f90447dbb48240766d24b855.run_cpu_time_us) (tablet-download-pool-fa6f5697f90447dbb48240766d24b855.run_wall_time_us, tablet-download-pool-fa6f5697f90447dbb48240766d24b855.run_wall_time_us) (tablet-open.queue_time_us, tablet-open.queue_time_us) (tablet-open.run_cpu_time_us, tablet-open.run_cpu_time_us) (tablet-open.run_wall_time_us, tablet-open.run_wall_time_us) (txn-commit.queue_time_us, txn-commit.queue_time_us) (txn-commit.run_cpu_time_us, txn-commit.run_cpu_time_us) (txn-commit.run_wall_time_us, txn-commit.run_wall_time_us) (txn-participant-registration.queue_time_us, txn-participant-registration.queue_time_us) (txn-participant-registration.run_cpu_time_us, txn-participant-registration.run_cpu_time_us) (txn-participant-registration.run_wall_time_us, txn-participant-registration.run_wall_time_us) (txn-status-manager.queue_time_us, txn-status-manager.queue_time_us) (txn-status-manager.run_cpu_time_us, txn-status-manager.run_cpu_time_us) (txn-status-manager.run_wall_time_us, txn-status-manager.run_wall_time_us) (txn-status-tablet-reload.queue_time_us, txn-status-tablet-reload.queue_time_us) (txn-status-tablet-reload.run_cpu_time_us, txn-status-tablet-reload.run_cpu_time_us) (txn-status-tablet-reload.run_wall_time_us, txn-status-tablet-reload.run_wall_time_us)
I20240501 14:04:20.977756 2959 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.29.231.2:59167 (request call id 11)
I20240501 14:04:20.978053 2959 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.29.231.2:59167 (request call id 12)
*** Check failure stack trace: ***
I20240501 14:04:20.978377 2959 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.29.231.2:59167 (request call id 13)
I20240501 14:04:20.978718 2959 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.29.231.2:59167 (request call id 13)
I20240501 14:04:20.979017 2959 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.29.231.2:59167 (request call id 13)
I20240501 14:04:20.979336 2959 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.29.231.2:59167 (request call id 13)
I20240501 14:04:20.979630 2959 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.29.231.2:59167 (request call id 13)
I20240501 14:04:20.979956 2959 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.29.231.2:59167 (request call id 13)
I20240501 14:04:20.980394 2959 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.29.231.2:59167 (request call id 13)
I20240501 14:04:20.980571 3049 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa5ce4bdc1af4d8888c7756810d6d18d. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7fce905b3dcd google::LogMessage::Fail() at ??:0
@ 0x7fce905b7b93 google::LogMessage::SendToLog() at ??:0
I20240501 14:04:20.993079 2959 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.29.231.2:59167 (request call id 13)
I20240501 14:04:20.994068 2970 tablet_copy_source_session.cc:205] T e03fee94218743268b60937bf81a9c79 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 14:04:20.994472 2970 tablet_copy_service.cc:140] P 538a87f7cc2b445a8ccf6b3294c1a2d8: Received BeginTabletCopySession request for tablet 26835459e32949b3ad28eb9f925f9632 from peer 875af4e39aa44837abfe99827303b395 ({username='slave'} at 127.29.231.2:59167)
I20240501 14:04:20.994621 2970 tablet_copy_service.cc:161] P 538a87f7cc2b445a8ccf6b3294c1a2d8: Beginning new tablet copy session on tablet 26835459e32949b3ad28eb9f925f9632 from peer 875af4e39aa44837abfe99827303b395 at {username='slave'} at 127.29.231.2:59167: session id = 875af4e39aa44837abfe99827303b395-26835459e32949b3ad28eb9f925f9632
I20240501 14:04:20.998303 2959 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.29.231.2:59167 (request call id 21)
I20240501 14:04:20.999166 3058 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e03fee94218743268b60937bf81a9c79. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:20.999563 2959 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.29.231.2:59167 (request call id 21)
I20240501 14:04:20.999599 3139 ts_tablet_manager.cc:902] T 0ff204737078438c933a74bd0336fde4 P 875af4e39aa44837abfe99827303b395: Initiating tablet copy from peer 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1:33163)
I20240501 14:04:21.000610 3140 ts_tablet_manager.cc:902] T 80972674f56c44f7b4b684d81177cd7e P 875af4e39aa44837abfe99827303b395: Initiating tablet copy from peer 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1:33163)
I20240501 14:04:21.002282 2959 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.29.231.2:59167 (request call id 24)
I20240501 14:04:21.006008 3059 tablet_copy_client.cc:308] T e9dc4d74a9064cbbbf756062d4c80dfc P 875af4e39aa44837abfe99827303b395: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:33163
I20240501 14:04:21.007057 2970 tablet_copy_source_session.cc:205] T 26835459e32949b3ad28eb9f925f9632 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 14:04:21.007542 2970 tablet_copy_service.cc:140] P 538a87f7cc2b445a8ccf6b3294c1a2d8: Received BeginTabletCopySession request for tablet 628b61d5ad54485a94c4682411a5cf41 from peer 875af4e39aa44837abfe99827303b395 ({username='slave'} at 127.29.231.2:59167)
I20240501 14:04:21.007727 2970 tablet_copy_service.cc:161] P 538a87f7cc2b445a8ccf6b3294c1a2d8: Beginning new tablet copy session on tablet 628b61d5ad54485a94c4682411a5cf41 from peer 875af4e39aa44837abfe99827303b395 at {username='slave'} at 127.29.231.2:59167: session id = 875af4e39aa44837abfe99827303b395-628b61d5ad54485a94c4682411a5cf41
I20240501 14:04:21.011437 2970 tablet_copy_source_session.cc:205] T 628b61d5ad54485a94c4682411a5cf41 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 14:04:21.012490 3071 tablet_copy_client.cc:308] T 664d737a61d846e3bcce7000b9617b35 P 875af4e39aa44837abfe99827303b395: tablet copy: Beginning tablet copy session from remote peer at address 127.29.231.1:33163
I20240501 14:04:21.013717 2959 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.29.231.2:59167 (request call id 26)
I20240501 14:04:21.013993 2959 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.29.231.2:59167 (request call id 28)
I20240501 14:04:21.014201 2959 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.29.231.2:59167 (request call id 28)
I20240501 14:04:21.014518 2970 tablet_copy_service.cc:140] P 538a87f7cc2b445a8ccf6b3294c1a2d8: Received BeginTabletCopySession request for tablet acafe3e6514a4d50b863992d8ab16573 from peer 875af4e39aa44837abfe99827303b395 ({username='slave'} at 127.29.231.2:59167)
I20240501 14:04:21.014629 2970 tablet_copy_service.cc:161] P 538a87f7cc2b445a8ccf6b3294c1a2d8: Beginning new tablet copy session on tablet acafe3e6514a4d50b863992d8ab16573 from peer 875af4e39aa44837abfe99827303b395 at {username='slave'} at 127.29.231.2:59167: session id = 875af4e39aa44837abfe99827303b395-acafe3e6514a4d50b863992d8ab16573
I20240501 14:04:21.016866 2970 tablet_copy_source_session.cc:205] T acafe3e6514a4d50b863992d8ab16573 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 14:04:21.017412 2970 tablet_copy_service.cc:140] P 538a87f7cc2b445a8ccf6b3294c1a2d8: Received BeginTabletCopySession request for tablet d6d953d9f0ff488a818c340f64df2b7f from peer 875af4e39aa44837abfe99827303b395 ({username='slave'} at 127.29.231.2:59167)
I20240501 14:04:21.018191 2970 tablet_copy_service.cc:161] P 538a87f7cc2b445a8ccf6b3294c1a2d8: Beginning new tablet copy session on tablet d6d953d9f0ff488a818c340f64df2b7f from peer 875af4e39aa44837abfe99827303b395 at {username='slave'} at 127.29.231.2:59167: session id = 875af4e39aa44837abfe99827303b395-d6d953d9f0ff488a818c340f64df2b7f
I20240501 14:04:21.018514 3061 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26835459e32949b3ad28eb9f925f9632. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:21.019049 2959 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.29.231.2:59167 (request call id 31)
I20240501 14:04:21.020146 3052 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acafe3e6514a4d50b863992d8ab16573. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:21.020790 2959 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.29.231.2:59167 (request call id 31)
I20240501 14:04:21.021888 2959 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.29.231.2:59167 (request call id 31)
I20240501 14:04:21.022707 2970 tablet_copy_source_session.cc:205] T d6d953d9f0ff488a818c340f64df2b7f P 538a87f7cc2b445a8ccf6b3294c1a2d8: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 14:04:21.023087 2970 tablet_copy_service.cc:140] P 538a87f7cc2b445a8ccf6b3294c1a2d8: Received BeginTabletCopySession request for tablet fa6f5697f90447dbb48240766d24b855 from peer 875af4e39aa44837abfe99827303b395 ({username='slave'} at 127.29.231.2:59167)
I20240501 14:04:21.023221 2970 tablet_copy_service.cc:161] P 538a87f7cc2b445a8ccf6b3294c1a2d8: Beginning new tablet copy session on tablet fa6f5697f90447dbb48240766d24b855 from peer 875af4e39aa44837abfe99827303b395 at {username='slave'} at 127.29.231.2:59167: session id = 875af4e39aa44837abfe99827303b395-fa6f5697f90447dbb48240766d24b855
I20240501 14:04:21.024446 3055 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 628b61d5ad54485a94c4682411a5cf41. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:21.025807 2970 tablet_copy_source_session.cc:205] T fa6f5697f90447dbb48240766d24b855 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 14:04:21.026263 2970 tablet_copy_service.cc:140] P 538a87f7cc2b445a8ccf6b3294c1a2d8: Received BeginTabletCopySession request for tablet 15f78e215c5c4b15a95453f3bfae1aab from peer 875af4e39aa44837abfe99827303b395 ({username='slave'} at 127.29.231.2:59167)
I20240501 14:04:21.026448 2970 tablet_copy_service.cc:161] P 538a87f7cc2b445a8ccf6b3294c1a2d8: Beginning new tablet copy session on tablet 15f78e215c5c4b15a95453f3bfae1aab from peer 875af4e39aa44837abfe99827303b395 at {username='slave'} at 127.29.231.2:59167: session id = 875af4e39aa44837abfe99827303b395-15f78e215c5c4b15a95453f3bfae1aab
I20240501 14:04:21.028005 3057 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa6f5697f90447dbb48240766d24b855. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:21.028182 2959 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.29.231.2:59167 (request call id 35)
I20240501 14:04:21.028903 3062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6d953d9f0ff488a818c340f64df2b7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:21.029218 2970 tablet_copy_source_session.cc:205] T 15f78e215c5c4b15a95453f3bfae1aab P 538a87f7cc2b445a8ccf6b3294c1a2d8: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 14:04:21.029865 2959 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.29.231.2:59167 (request call id 37)
I20240501 14:04:21.030262 2970 tablet_copy_service.cc:140] P 538a87f7cc2b445a8ccf6b3294c1a2d8: Received BeginTabletCopySession request for tablet 377e1da98a1f4075af0ea8bd47f79ca8 from peer 875af4e39aa44837abfe99827303b395 ({username='slave'} at 127.29.231.2:59167)
I20240501 14:04:21.030409 2970 tablet_copy_service.cc:161] P 538a87f7cc2b445a8ccf6b3294c1a2d8: Beginning new tablet copy session on tablet 377e1da98a1f4075af0ea8bd47f79ca8 from peer 875af4e39aa44837abfe99827303b395 at {username='slave'} at 127.29.231.2:59167: session id = 875af4e39aa44837abfe99827303b395-377e1da98a1f4075af0ea8bd47f79ca8
I20240501 14:04:21.032629 3051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15f78e215c5c4b15a95453f3bfae1aab. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:21.033200 2970 tablet_copy_source_session.cc:205] T 377e1da98a1f4075af0ea8bd47f79ca8 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 14:04:21.033882 3132 ts_tablet_manager.cc:902] T 9bc0426756ed4034bfd9b99d36212481 P 875af4e39aa44837abfe99827303b395: Initiating tablet copy from peer 538a87f7cc2b445a8ccf6b3294c1a2d8 (127.29.231.1:33163)
I20240501 14:04:21.033771 2970 tablet_copy_service.cc:140] P 538a87f7cc2b445a8ccf6b3294c1a2d8: Received BeginTabletCopySession request for tablet 7791050ac9a14b1a8f7efedeae29c775 from peer 875af4e39aa44837abfe99827303b395 ({username='slave'} at 127.29.231.2:59167)
I20240501 14:04:21.034535 2970 tablet_copy_service.cc:161] P 538a87f7cc2b445a8ccf6b3294c1a2d8: Beginning new tablet copy session on tablet 7791050ac9a14b1a8f7efedeae29c775 from peer 875af4e39aa44837abfe99827303b395 at {username='slave'} at 127.29.231.2:59167: session id = 875af4e39aa44837abfe99827303b395-7791050ac9a14b1a8f7efedeae29c775
@ 0x7fce905b37cc google::LogMessage::Flush() at ??:0
I20240501 14:04:21.038169 3049 tablet_copy_client.cc:783] T fa5ce4bdc1af4d8888c7756810d6d18d P 875af4e39aa44837abfe99827303b395: tablet copy: Starting download of 0 data blocks...
I20240501 14:04:21.038795 2970 tablet_copy_source_session.cc:205] T 7791050ac9a14b1a8f7efedeae29c775 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 14:04:21.039471 3056 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 377e1da98a1f4075af0ea8bd47f79ca8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:21.040477 3049 tablet_copy_client.cc:647] T fa5ce4bdc1af4d8888c7756810d6d18d P 875af4e39aa44837abfe99827303b395: tablet copy: Starting download of 1 WAL segments...
I20240501 14:04:21.042572 3105 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7791050ac9a14b1a8f7efedeae29c775. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:21.050406 2970 tablet_copy_service.cc:140] P 538a87f7cc2b445a8ccf6b3294c1a2d8: Received BeginTabletCopySession request for tablet 6b414d33585c40e6bf8ffb34d0877c1e from peer 875af4e39aa44837abfe99827303b395 ({username='slave'} at 127.29.231.2:59167)
I20240501 14:04:21.050592 2970 tablet_copy_service.cc:161] P 538a87f7cc2b445a8ccf6b3294c1a2d8: Beginning new tablet copy session on tablet 6b414d33585c40e6bf8ffb34d0877c1e from peer 875af4e39aa44837abfe99827303b395 at {username='slave'} at 127.29.231.2:59167: session id = 875af4e39aa44837abfe99827303b395-6b414d33585c40e6bf8ffb34d0877c1e
I20240501 14:04:21.053272 2970 tablet_copy_source_session.cc:205] T 6b414d33585c40e6bf8ffb34d0877c1e P 538a87f7cc2b445a8ccf6b3294c1a2d8: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 14:04:21.055158 2970 tablet_copy_service.cc:140] P 538a87f7cc2b445a8ccf6b3294c1a2d8: Received BeginTabletCopySession request for tablet e9dc4d74a9064cbbbf756062d4c80dfc from peer 875af4e39aa44837abfe99827303b395 ({username='slave'} at 127.29.231.2:59167)
I20240501 14:04:21.055361 2970 tablet_copy_service.cc:161] P 538a87f7cc2b445a8ccf6b3294c1a2d8: Beginning new tablet copy session on tablet e9dc4d74a9064cbbbf756062d4c80dfc from peer 875af4e39aa44837abfe99827303b395 at {username='slave'} at 127.29.231.2:59167: session id = 875af4e39aa44837abfe99827303b395-e9dc4d74a9064cbbbf756062d4c80dfc
I20240501 14:04:21.058243 2970 tablet_copy_source_session.cc:205] T e9dc4d74a9064cbbbf756062d4c80dfc P 538a87f7cc2b445a8ccf6b3294c1a2d8: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 14:04:21.058832 3072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b414d33585c40e6bf8ffb34d0877c1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:21.060681 3058 tablet_copy_client.cc:783] T e03fee94218743268b60937bf81a9c79 P 875af4e39aa44837abfe99827303b395: tablet copy: Starting download of 0 data blocks...
I20240501 14:04:21.062424 3049 tablet_copy_client.cc:523] T fa5ce4bdc1af4d8888c7756810d6d18d P 875af4e39aa44837abfe99827303b395: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 14:04:21.064404 3059 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9dc4d74a9064cbbbf756062d4c80dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:21.065189 3061 tablet_copy_client.cc:783] T 26835459e32949b3ad28eb9f925f9632 P 875af4e39aa44837abfe99827303b395: tablet copy: Starting download of 0 data blocks...
I20240501 14:04:21.066329 3052 tablet_copy_client.cc:783] T acafe3e6514a4d50b863992d8ab16573 P 875af4e39aa44837abfe99827303b395: tablet copy: Starting download of 0 data blocks...
I20240501 14:04:21.071715 2970 tablet_copy_service.cc:140] P 538a87f7cc2b445a8ccf6b3294c1a2d8: Received BeginTabletCopySession request for tablet 8dd66af8436c4f71b019990d2800ea00 from peer 875af4e39aa44837abfe99827303b395 ({username='slave'} at 127.29.231.2:59167)
I20240501 14:04:21.071920 2959 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.29.231.2:59167 (request call id 44)
I20240501 14:04:21.071938 2970 tablet_copy_service.cc:161] P 538a87f7cc2b445a8ccf6b3294c1a2d8: Beginning new tablet copy session on tablet 8dd66af8436c4f71b019990d2800ea00 from peer 875af4e39aa44837abfe99827303b395 at {username='slave'} at 127.29.231.2:59167: session id = 875af4e39aa44837abfe99827303b395-8dd66af8436c4f71b019990d2800ea00
I20240501 14:04:21.072561 3058 tablet_copy_client.cc:647] T e03fee94218743268b60937bf81a9c79 P 875af4e39aa44837abfe99827303b395: tablet copy: Starting download of 1 WAL segments...
I20240501 14:04:21.076133 3061 tablet_copy_client.cc:647] T 26835459e32949b3ad28eb9f925f9632 P 875af4e39aa44837abfe99827303b395: tablet copy: Starting download of 1 WAL segments...
I20240501 14:04:21.076740 2970 tablet_copy_source_session.cc:205] T 8dd66af8436c4f71b019990d2800ea00 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 14:04:21.077837 2970 tablet_copy_service.cc:140] P 538a87f7cc2b445a8ccf6b3294c1a2d8: Received BeginTabletCopySession request for tablet c110feabb9164a78b4d125811a7e014a from peer 875af4e39aa44837abfe99827303b395 ({username='slave'} at 127.29.231.2:59167)
I20240501 14:04:21.078033 2970 tablet_copy_service.cc:161] P 538a87f7cc2b445a8ccf6b3294c1a2d8: Beginning new tablet copy session on tablet c110feabb9164a78b4d125811a7e014a from peer 875af4e39aa44837abfe99827303b395 at {username='slave'} at 127.29.231.2:59167: session id = 875af4e39aa44837abfe99827303b395-c110feabb9164a78b4d125811a7e014a
I20240501 14:04:21.079269 3053 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8dd66af8436c4f71b019990d2800ea00. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:21.079998 3052 tablet_copy_client.cc:647] T acafe3e6514a4d50b863992d8ab16573 P 875af4e39aa44837abfe99827303b395: tablet copy: Starting download of 1 WAL segments...
I20240501 14:04:21.081851 2970 tablet_copy_source_session.cc:205] T c110feabb9164a78b4d125811a7e014a P 538a87f7cc2b445a8ccf6b3294c1a2d8: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 14:04:21.082394 2970 tablet_copy_service.cc:140] P 538a87f7cc2b445a8ccf6b3294c1a2d8: Received BeginTabletCopySession request for tablet 8905fd25304648629180625e85507e2a from peer 875af4e39aa44837abfe99827303b395 ({username='slave'} at 127.29.231.2:59167)
I20240501 14:04:21.082567 2970 tablet_copy_service.cc:161] P 538a87f7cc2b445a8ccf6b3294c1a2d8: Beginning new tablet copy session on tablet 8905fd25304648629180625e85507e2a from peer 875af4e39aa44837abfe99827303b395 at {username='slave'} at 127.29.231.2:59167: session id = 875af4e39aa44837abfe99827303b395-8905fd25304648629180625e85507e2a
I20240501 14:04:21.083077 3054 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c110feabb9164a78b4d125811a7e014a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:21.086231 2970 tablet_copy_source_session.cc:205] T 8905fd25304648629180625e85507e2a P 538a87f7cc2b445a8ccf6b3294c1a2d8: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 14:04:21.087610 3057 tablet_copy_client.cc:783] T fa6f5697f90447dbb48240766d24b855 P 875af4e39aa44837abfe99827303b395: tablet copy: Starting download of 0 data blocks...
I20240501 14:04:21.088815 3068 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8905fd25304648629180625e85507e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:21.090899 3049 tablet_bootstrap.cc:492] T fa5ce4bdc1af4d8888c7756810d6d18d P 875af4e39aa44837abfe99827303b395: Bootstrap starting.
I20240501 14:04:21.096000 3057 tablet_copy_client.cc:647] T fa6f5697f90447dbb48240766d24b855 P 875af4e39aa44837abfe99827303b395: tablet copy: Starting download of 1 WAL segments...
I20240501 14:04:21.096378 3072 tablet_copy_client.cc:783] T 6b414d33585c40e6bf8ffb34d0877c1e P 875af4e39aa44837abfe99827303b395: tablet copy: Starting download of 0 data blocks...
I20240501 14:04:21.103854 3072 tablet_copy_client.cc:647] T 6b414d33585c40e6bf8ffb34d0877c1e P 875af4e39aa44837abfe99827303b395: tablet copy: Starting download of 1 WAL segments...
I20240501 14:04:21.107937 3061 tablet_copy_client.cc:523] T 26835459e32949b3ad28eb9f925f9632 P 875af4e39aa44837abfe99827303b395: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 14:04:21.116142 3062 tablet_copy_client.cc:783] T d6d953d9f0ff488a818c340f64df2b7f P 875af4e39aa44837abfe99827303b395: tablet copy: Starting download of 0 data blocks...
I20240501 14:04:21.118836 3062 tablet_copy_client.cc:647] T d6d953d9f0ff488a818c340f64df2b7f P 875af4e39aa44837abfe99827303b395: tablet copy: Starting download of 1 WAL segments...
I20240501 14:04:21.119297 3051 tablet_copy_client.cc:783] T 15f78e215c5c4b15a95453f3bfae1aab P 875af4e39aa44837abfe99827303b395: tablet copy: Starting download of 0 data blocks...
I20240501 14:04:21.123189 3051 tablet_copy_client.cc:647] T 15f78e215c5c4b15a95453f3bfae1aab P 875af4e39aa44837abfe99827303b395: tablet copy: Starting download of 1 WAL segments...
I20240501 14:04:21.123525 3056 tablet_copy_client.cc:783] T 377e1da98a1f4075af0ea8bd47f79ca8 P 875af4e39aa44837abfe99827303b395: tablet copy: Starting download of 0 data blocks...
I20240501 14:04:21.123814 3056 tablet_copy_client.cc:647] T 377e1da98a1f4075af0ea8bd47f79ca8 P 875af4e39aa44837abfe99827303b395: tablet copy: Starting download of 1 WAL segments...
I20240501 14:04:21.124001 3058 tablet_copy_client.cc:523] T e03fee94218743268b60937bf81a9c79 P 875af4e39aa44837abfe99827303b395: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 14:04:21.125856 3055 tablet_copy_client.cc:783] T 628b61d5ad54485a94c4682411a5cf41 P 875af4e39aa44837abfe99827303b395: tablet copy: Starting download of 0 data blocks...
I20240501 14:04:21.133579 3052 tablet_copy_client.cc:523] T acafe3e6514a4d50b863992d8ab16573 P 875af4e39aa44837abfe99827303b395: tablet copy: Tablet Copy complete. Replacing tablet superblock.
@ 0x7fce905b4f59 google::LogMessageFatal::~LogMessageFatal() at ??:0
I20240501 14:04:21.135666 2959 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.29.231.2:59167 (request call id 50)
I20240501 14:04:21.136080 2959 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.29.231.2:59167 (request call id 50)
I20240501 14:04:21.136437 2959 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
I20240501 14:04:21.142315 3055 tablet_copy_client.cc:647] T 628b61d5ad54485a94c4682411a5cf41 P 875af4e39aa44837abfe99827303b395: tablet copy: Starting download of 1 WAL segments...
I20240501 14:04:21.146477 3105 tablet_copy_client.cc:783] T 7791050ac9a14b1a8f7efedeae29c775 P 875af4e39aa44837abfe99827303b395: tablet copy: Starting download of 0 data blocks...
I20240501 14:04:21.149015 3105 tablet_copy_client.cc:647] T 7791050ac9a14b1a8f7efedeae29c775 P 875af4e39aa44837abfe99827303b395: tablet copy: Starting download of 1 WAL segments...
I20240501 14:04:21.159621 3061 tablet_bootstrap.cc:492] T 26835459e32949b3ad28eb9f925f9632 P 875af4e39aa44837abfe99827303b395: Bootstrap starting.
I20240501 14:04:21.170449 3058 tablet_bootstrap.cc:492] T e03fee94218743268b60937bf81a9c79 P 875af4e39aa44837abfe99827303b395: Bootstrap starting.
I20240501 14:04:21.170897 3059 tablet_copy_client.cc:783] T e9dc4d74a9064cbbbf756062d4c80dfc P 875af4e39aa44837abfe99827303b395: tablet copy: Starting download of 0 data blocks...
@ 0x7fce932f4742 kudu::TraceMetrics::InternName() at ??:0
I20240501 14:04:21.175189 3072 tablet_copy_client.cc:523] T 6b414d33585c40e6bf8ffb34d0877c1e P 875af4e39aa44837abfe99827303b395: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 14:04:21.175868 3057 tablet_copy_client.cc:523] T fa6f5697f90447dbb48240766d24b855 P 875af4e39aa44837abfe99827303b395: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 14:04:21.176610 2959 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.29.231.2:59167 (request call id 55)
I20240501 14:04:21.177026 2959 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.29.231.2:59167 (request call id 55)
I20240501 14:04:21.177409 2959 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.29.231.2:59167 (request call id 55)
I20240501 14:04:21.178478 2970 tablet_copy_service.cc:140] P 538a87f7cc2b445a8ccf6b3294c1a2d8: Received BeginTabletCopySession request for tablet 664d737a61d846e3bcce7000b9617b35 from peer 875af4e39aa44837abfe99827303b395 ({username='slave'} at 127.29.231.2:59167)
I20240501 14:04:21.178658 2970 tablet_copy_service.cc:161] P 538a87f7cc2b445a8ccf6b3294c1a2d8: Beginning new tablet copy session on tablet 664d737a61d846e3bcce7000b9617b35 from peer 875af4e39aa44837abfe99827303b395 at {username='slave'} at 127.29.231.2:59167: session id = 875af4e39aa44837abfe99827303b395-664d737a61d846e3bcce7000b9617b35
I20240501 14:04:21.180686 3051 tablet_copy_client.cc:523] T 15f78e215c5c4b15a95453f3bfae1aab P 875af4e39aa44837abfe99827303b395: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 14:04:21.180935 2970 tablet_copy_source_session.cc:205] T 664d737a61d846e3bcce7000b9617b35 P 538a87f7cc2b445a8ccf6b3294c1a2d8: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 14:04:21.185525 3059 tablet_copy_client.cc:647] T e9dc4d74a9064cbbbf756062d4c80dfc P 875af4e39aa44837abfe99827303b395: tablet copy: Starting download of 1 WAL segments...
I20240501 14:04:21.189651 3071 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 664d737a61d846e3bcce7000b9617b35. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:04:21.190826 3056 tablet_copy_client.cc:523] T 377e1da98a1f4075af0ea8bd47f79ca8 P 875af4e39aa44837abfe99827303b395: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 14:04:21.192386 3068 tablet_copy_client.cc:783] T 8905fd25304648629180625e85507e2a P 875af4e39aa44837abfe99827303b395: tablet copy: Starting download of 0 data blocks...
I20240501 14:04:21.193284 3068 tablet_copy_client.cc:647] T 8905fd25304648629180625e85507e2a P 875af4e39aa44837abfe99827303b395: tablet copy: Starting download of 1 WAL segments...
I20240501 14:04:21.197950 3052 tablet_bootstrap.cc:492] T acafe3e6514a4d50b863992d8ab16573 P 875af4e39aa44837abfe99827303b395: Bootstrap starting.
I20240501 14:04:21.203120 3054 tablet_copy_client.cc:783] T c110feabb9164a78b4d125811a7e014a P 875af4e39aa44837abfe99827303b395: tablet copy: Starting download of 0 data blocks...
I20240501 14:04:21.203485 3053 tablet_copy_client.cc:783] T 8dd66af8436c4f71b019990d2800ea00 P 875af4e39aa44837abfe99827303b395: tablet copy: Starting download of 0 data blocks...
I20240501 14:04:21.204105 3053 tablet_copy_client.cc:647] T 8dd66af8436c4f71b019990d2800ea00 P 875af4e39aa44837abfe99827303b395: tablet copy: Starting download of 1 WAL segments...
@ 0x7fce932c0f8b kudu::ThreadPool::ThreadPool() at ??:0
I20240501 14:04:21.212488 3054 tablet_copy_client.cc:647] T c110feabb9164a78b4d125811a7e014a P 875af4e39aa44837abfe99827303b395: tablet copy: Starting download of 1 WAL segments...
I20240501 14:04:21.234437 3059 tablet_copy_client.cc:523] T e9dc4d74a9064cbbbf756062d4c80dfc P 875af4e39aa44837abfe99827303b395: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 14:04:21.236030 2959 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.29.231.2:59167 (request call id 64)
I20240501 14:04:21.236442 3055 tablet_copy_client.cc:523] T 628b61d5ad54485a94c4682411a5cf41 P 875af4e39aa44837abfe99827303b395: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 14:04:21.236503 3057 tablet_bootstrap.cc:492] T fa6f5697f90447dbb48240766d24b855 P 875af4e39aa44837abfe99827303b395: Bootstrap starting.
I20240501 14:04:21.238456 3105 tablet_copy_client.cc:523] T 7791050ac9a14b1a8f7efedeae29c775 P 875af4e39aa44837abfe99827303b395: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 14:04:21.239333 3072 tablet_bootstrap.cc:492] T 6b414d33585c40e6bf8ffb34d0877c1e P 875af4e39aa44837abfe99827303b395: Bootstrap starting.
I20240501 14:04:21.257864 3051 tablet_bootstrap.cc:492] T 15f78e215c5c4b15a95453f3bfae1aab P 875af4e39aa44837abfe99827303b395: Bootstrap starting.
I20240501 14:04:21.257925 3059 tablet_bootstrap.cc:492] T e9dc4d74a9064cbbbf756062d4c80dfc P 875af4e39aa44837abfe99827303b395: Bootstrap starting.
@ 0x7fce932bacd6 kudu::ThreadPoolBuilder::Build() at ??:0
I20240501 14:04:21.288798 3068 tablet_copy_client.cc:523] T 8905fd25304648629180625e85507e2a P 875af4e39aa44837abfe99827303b395: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 14:04:21.292691 3055 tablet_bootstrap.cc:492] T 628b61d5ad54485a94c4682411a5cf41 P 875af4e39aa44837abfe99827303b395: Bootstrap starting.
I20240501 14:04:21.294004 3105 tablet_bootstrap.cc:492] T 7791050ac9a14b1a8f7efedeae29c775 P 875af4e39aa44837abfe99827303b395: Bootstrap starting.
I20240501 14:04:21.294808 3056 tablet_bootstrap.cc:492] T 377e1da98a1f4075af0ea8bd47f79ca8 P 875af4e39aa44837abfe99827303b395: Bootstrap starting.
I20240501 14:04:21.295037 3068 tablet_bootstrap.cc:492] T 8905fd25304648629180625e85507e2a P 875af4e39aa44837abfe99827303b395: Bootstrap starting.
I20240501 14:04:21.297382 3071 tablet_copy_client.cc:783] T 664d737a61d846e3bcce7000b9617b35 P 875af4e39aa44837abfe99827303b395: tablet copy: Starting download of 0 data blocks...
I20240501 14:04:21.297657 3071 tablet_copy_client.cc:647] T 664d737a61d846e3bcce7000b9617b35 P 875af4e39aa44837abfe99827303b395: tablet copy: Starting download of 1 WAL segments...
I20240501 14:04:21.373131 3062 tablet_copy_client.cc:523] T d6d953d9f0ff488a818c340f64df2b7f P 875af4e39aa44837abfe99827303b395: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 14:04:21.374188 2959 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.29.231.2:59167 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
I20240501 14:04:21.394433 3053 tablet_copy_client.cc:523] T 8dd66af8436c4f71b019990d2800ea00 P 875af4e39aa44837abfe99827303b395: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 14:04:21.403260 3062 tablet_bootstrap.cc:492] T d6d953d9f0ff488a818c340f64df2b7f P 875af4e39aa44837abfe99827303b395: Bootstrap starting.
I20240501 14:04:21.417585 3054 tablet_copy_client.cc:523] T c110feabb9164a78b4d125811a7e014a P 875af4e39aa44837abfe99827303b395: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 14:04:21.430332 3071 tablet_copy_client.cc:523] T 664d737a61d846e3bcce7000b9617b35 P 875af4e39aa44837abfe99827303b395: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 14:04:21.433396 3053 tablet_bootstrap.cc:492] T 8dd66af8436c4f71b019990d2800ea00 P 875af4e39aa44837abfe99827303b395: Bootstrap starting.
@ 0x7fcea270d8de kudu::tserver::TabletCopyClient::TabletCopyClient() at ??:0
I20240501 14:04:21.467432 3071 tablet_bootstrap.cc:492] T 664d737a61d846e3bcce7000b9617b35 P 875af4e39aa44837abfe99827303b395: Bootstrap starting.
I20240501 14:04:21.467639 3054 tablet_bootstrap.cc:492] T c110feabb9164a78b4d125811a7e014a P 875af4e39aa44837abfe99827303b395: Bootstrap starting.
I20240501 14:04:21.493916 3049 log.cc:824] T fa5ce4bdc1af4d8888c7756810d6d18d P 875af4e39aa44837abfe99827303b395: Log is configured to *not* fsync() on all Append() calls
@ 0x7fcea2725daf kudu::tserver::RemoteTabletCopyClient::RemoteTabletCopyClient() at ??:0
@ 0x7fcea2850480 kudu::tserver::TSTabletManager::RunTabletCopy() at ??:0
@ 0x7fcea2888a8d kudu::tserver::TabletCopyRunnable::Run() at ??:0
@ 0x7fcea286b981 kudu::tserver::TSTabletManager::StartTabletCopy()::$_12::operator()() at ??:0
@ 0x7fcea286b70e std::_Function_handler<>::_M_invoke() at ??:0
@ 0xa60bcd std::function<>::operator()() at ??:?
@ 0x7fce932c4b75 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fce932c819c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7fce932c8019 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xa60bcd std::function<>::operator()() at ??:?
@ 0x7fce932a301e kudu::Thread::SuperviseThread() at ??:0
@ 0x7fce966286db start_thread at ??:0
@ 0x7fce8f46671f clone at ??:0
W20240501 14:04:21.936300 2250 connection.cc:535] client connection to 127.29.231.2:41687 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
F20240501 14:04:21.937083 3131 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: F20240501 14:04:21.937148 3104 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
*** Aborted at 1714572261 (unix time) try "date -d @1714572261" if you are using GNU date ***
F20240501 14:04:21.937083 3131 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: F20240501 14:04:21.937148 3104 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240501 14:04:21.937083 3133 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
F20240501 14:04:21.937083 3131 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: F20240501 14:04:21.937148 3104 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240501 14:04:21.937083 3133 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
F20240501 14:04:21.937079 3137 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e80000779c) received by PID 30620 (TID 0x7fbb3d575700) from PID 30620; stack trace: ***
@ 0x7fbb585ea980 (unknown) at ??:0
@ 0x7fbb51695fb7 gsignal at ??:0
@ 0x7fbb51697921 abort at ??:0
@ 0x7fbb543bedcd google::LogMessage::Fail() at ??:0
@ 0x7fbb543c2b93 google::LogMessage::SendToLog() at ??:0
@ 0x7fbb543be7cc google::LogMessage::Flush() at ??:0
@ 0x7fbb543bff59 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x3b9874 kudu::TabletCopyClientSessionITest_TestTabletCopyWithBusySource_Test::TestBody()::$_3::operator()() at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/tablet_copy_client_session-itest.cc:313
@ 0x3b926e std::__invoke_impl<>() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/invoke.h:60
@ 0x3b91ee std::__invoke<>() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/invoke.h:95
@ 0x3b91b3 _ZNSt6thread8_InvokerISt5tupleIJZN4kudu62TabletCopyClientSessionITest_TestTabletCopyWithBusySource_Test8TestBodyEvE3$_3EEE9_M_invokeIJLm0EEEEDTclsr3stdE8__invokespcl10_S_declvalIXT_EEEEESt12_Index_tupleIJXspT_EEE at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:234
@ 0x3b917e std::thread::_Invoker<>::operator()() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:243
@ 0x3b9069 std::thread::_State_impl<>::_M_run() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:186
@ 0x7fbb51d1f6df (unknown) at ??:0
@ 0x7fbb585df6db start_thread at ??:0
@ 0x7fbb5177871f clone at ??:0